Instructor: Way earlier in the course,
I mentioned that using open Large Language Models
can be great for certain use cases.
And indeed, you already saw some examples
here in this section.
For example, you could use a locally running
Large Language Model like this Gemma 3 model here
to extract text from an image.
That's one thing you could do.
You can also use these models to summarize documents
or ask questions about documents to chat with your PDF.
You don't need some paid service for that.
You can just use LM Studio,
upload or add your files here
and then use your model, your loaded locally running model
to interact with those documents.
These are all amazing use cases
because they are all about privacy.
You might not wanna share your documents
or your receipts with OpenAI or any other providers.
Well, when running the models locally, you don't have to,
and they're amazing for tasks like this.
But it's not all they're useful for.
You can, for example, also use these models
if you don't have an internet connection
and you want to generate some code, for example,
or if you need to ask some questions about code.
You might be used to using GitHub Copilot
or other models when writing code,
but what do you do if you're in a plane
without an internet connection?
Well, since these locally running models
are still Large Language Models,
they are, of course, still quite good at generating code.
Of course, relatively small
locally running Large Language Model
like this 12 billion parameters model
might not be as good as Claude 3.5
or the latest OpenAI model.
We have to be honest about that.
And of course, the knowledge cutoff date
of these problems may be a problem
just as it is the case to some degree
for these state-of-the art proprietary models though.
But nonetheless, for a lot of tasks,
the code they generate will be good enough
because, of course, it's still valid code in many situations
and if you got no internet connection,
it's definitely better than having
no backup and no help at all.
And you cannot just use them for generating code.
Of course, you can also ask questions about your code
or use them for debugging,
all without sending your data to anyone
and all without having an internet connection.