-: Welcome to this course.
My name is Maximilian Schwarzmuller.
I will be your instructor in this course
and in this course we'll dive deep into running
openAI models locally on your system, your laptop,
your desktop PC, on your server if you want to,
though the focus of this course will not be
server administration, but of course you could apply
the knowledge you gain in this course
to also run open models there.
Because in this course, we will explore in depth
how we can use tools like LM Studio or Ollama
to run openAI models, large language models
like the Gemma models by Google on any hardware,
including consumer-level hardware.
You will learn about hardware requirements
and how you can run quite powerful models,
even on low-end devices, how that's possible.
We'll take a close look at that and of course you will learn
how to leverage LM Studio and Ollama,
the tools we'll be using to run these AI models.
You will learn about advanced configuration options.
You'll see plenty of examples, and of course we'll also dive
into example use cases for using open models on your system,
because the truth is that
these AI models are extremely powerful.
We're no longer in 2023 where you essentially
had to go for paid models.
Instead now these open models, which you can run for free,
are a very viable alternative
to these paid proprietary models,
and they have some real advantages, like for example,
100% privacy because your prompts, the generated output
and any data you use in your prompts
never leaves your machine or your network.
But we'll take a close look at all that throughout
this course, and therefore, let's not waste any time.
Let's instead get started
and let's start with the most important question
to make sure that we're all on the same page.
What exactly does open model
or open Large Language Model mean?
What are these open models?