Maximilian: So we loaded a model
and we're able to chat with it.
And you can always start new chat sessions
by clicking this plus button here of course.
But let's stick to this one chat session we have here
because you got a couple of things you can configure
regarding this session.
For one, you got some controls down here.
You could, for example, regenerate the message.
So if you're not happy with the response you got,
but you don't wanna change your prompt,
you can click this button to get a new output,
because of course the output will not always be the same
because as explained earlier in the course,
for every token that's generated by the model,
a probability will be assigned to that token,
and then it simply depends on how you configured
for a token to be chosen.
It's not always the one with the highest probability.
So there is some randomness to that,
and that's why you can regenerate a message
to get a different result for the same prompt.
You can also copy the output of course,
and you can edit it.
So you could fine-tune the response you got,
and since it will still be part
of your overall chat history,
future messages you send to that model
would take that edited message
into account as well,
because it's always the entire chat history
of a given chat
that is sent to the model
with every new followup message you send.
You can also delete it if you're not happy with it,
then it would no longer be part of that chat history.
Now, you also got some options up here.
For one, you can duplicate that chat
if you maybe wanna continue with this chat
in one way here,
but send another followup message
for that same chat in another separate chat,
you could then duplicate it.
You could clear it to clear the entire chat history
and get rid of all the messages.
And you can also change the appearance.
So you can configure
whether it should actually be parsed as markdown
or if you wanna see the plain text.
So that would now be the plain text
using markdown formatting,
but now not parsed as markdown by LM Studio.
You could also choose Monospace to have a different font.
And you might have different options
at the point of time where you are viewing this,
but for many scenarios,
markdown is of course the option you want.
You can also tweak the font size
to make it a bit smaller.
The font weight can be changed.
And of course you can also change the message style.
So if you wanna have bubbles or block style.
If you are interacting with a reasoning model,
which this one here isn't,
you could also expand reasoning blocks by default,
change the container width of that chat window,
and automatically scroll new messages to the top.
And again, there might be more options
to fine-tune this appearance
when you're viewing this.
You can also set a system prompt
on a per-chat basis.
Now, to make sure we're all on the same page,
a system prompt is essentially some kind of base prompt
that kind of overrides all other prompts,
all other messages in a chat.
Now, that's not entirely true.
It is part of the overall chat history,
but it is treated in a prioritized way by the AI model,
or at least that's the goal.
So typically a system prompt
is used to set up general instructions
the AI model should follow with its responses.
You can almost think of it
as some prompt that's invisibly injected
in front of every other prompt
you might be sending to the model.
Though that's technically not how it works
because as explained,
it's simply one message
that's part of the overall chat history,
but it is treated with priority.
Now, if I click here,
you'll see at the moment there is no system prompt.
So a blank new chat starts without a system prompt.
But if you know that you wanna have a chat message
where certain rules apply
or where the model should behave in a certain way,
you could of course set such a system prompt.
So here I could say, "Always respond in rhymes.
No matter what the user asks you,
respond in rhymes."
If I now save this system prompt here,
it will apply to this chat.
So if I now send a followup message
like, "Please summarize your last message,"
it should go ahead and respond in rhymes
because that's what I set up in this system prompt.
So these are some ways of fine-tuning
the behavior of this model
in this specific chat,
of changing the appearance
and maybe duplicating this chat,
and of controlling these different messages,
deleting them, editing them, or regenerating them.