Maximilian: So when using Ollama
through the command line, as I showed it to you earlier,
you can chat with it,
and you will build a chat history here, of course.
What you can also do is configure it
with help of various slash commands,
and you can always type /?
to see a list of the available commands.
For example, you can use /show
to view some information about the currently running model.
With /show info, for example,
you get a brief overview of the model architecture,
so the model family, you could say, gemma3, in my case,
the number of parameters,
the available context length for this model,
the quantization used,
and some other pieces of information like, for example,
the parameters that have been set
for this running instance of the model, so to say,
so the parameters that are currently active
for this chat session.
One word about the context length, by the way,
this can be misleading because that is
the actual context length supported by this model.
It is not, however,
necessarily the context length that has been set
for your currently running chat session session.
And I'll get back to how to control that in just a second.
But that is something to note.
This is just the maximum context length,
not the currently active one.
You also see the capabilities like text completion,
and in case of the Gemma models also vision
so that it can analyze images.
And there's, of course, more
you can inspect about this model.
/show license shows you, well, the license,
though here it fails to grab that.
It's always a good idea to check Hugging Face for that then
to make sure that you are respecting the license.
And /show parameters shows you the currently set parameters.
Now you might wonder who set parameters
because you didn't.
You did not see me set any parameters here.
And for that you can go back to
that Ollama model detail page on their website.
And there you'll find this params area here.
And if you click on that,
you'll actually see a set of parameters,
which will be different for each model,
or which can be different for each model, I should say.
And these parameters are simply set automatically
Whenever you run a model.
You can overwrite them,
but these are default parameters that are set
whenever you start a model with Ollama.
And that's just something to be aware of
and, therefore, this is what you also see here.
By the way,
I'll get back to this weird stop thing here later.
You already know top_p, temperature, and top_k
from the LM Studio section.
In case you don't,
attached you'll find a link to that lecture
where I explain those parameters.
What's also interesting is /show system
which shows you the system prompt
that was specified for this model.
And here you see that no system message has been specified.
That is, of course, something you can change.
But here, as you see for this model,
no system message has been set.
And later you will learn
how you can set a default system message
for an entire model that will then apply
to all chat sessions started based on that model.