Maximilian: At this point,
we covered a lot of important features offered by LM Studio,
but we have barely scratched the surface of what you can do
as a power user
because as a Power User,
you can tweak the settings of your chat
and how the model generates output.
And I did already cover the System Prompt
and that you can store a System Prompt in a preset,
but that's not all you can do here.
Instead, you can also tweak the model settings
or how the model will behave here
in this chat or in this preset.
If you go to Model,
you got a bunch of settings you can change here,
and whatever you will change here
can also be saved to a preset.
So if you do save a preset,
it does include both your system prompt if you set any
and your settings here.
So what are the settings we have her?
Under Settings, most importantly,
we can set the temperature of our model here.
There are more settings we can enable.
For example, what should happen
if we leave our Context window
if there's too much content being generated
or sent to the model by us?
But I'll get back to the Context window a little bit later.
We can also control
how many CPU threads will be used during inference,
but typically, the default setting is okay here.
But what's that Temperature all about?
Well, the Temperature,
as this tooltip tells us here,
controls how much randomness
will be in the generated output.
And this Temperature here actually works together
with the Sampling settings.
There, we got Top K, Repeat Penalty and Top P and Min P.
And what are Temperature Top K, Top P,
and Min P all about now?