Maximilian: Now, back in the chat window,
which is arguably the place you'll spend
most of your time in, and back in user mode.
I wanna take a closer look at this plus button here
because this button allows you to attach images
or files to your chat.
Now, in order to work with images,
you need to work with a model that supports images
that's multimodal, and you can tell
whether that's the case for a given model
by checking if this icon here is there.
You can also go to your app settings and the model search.
And there if you select a model, either one you have
or also models you didn't download yet,
you will also see that icon there.
And if you hover over that icon,
you'll also see this info text.
This model can process image inputs.
And you of course must be working with a model
that does support image inputs in order to be able to upload
and use an image.
So for example, here, I'll open a new chat
and I will attach an image here.
And the image I do want to attach
is a car wash receipt I have.
This is the image, it's a pretty hard to read receipt
of me washing my car or of the place
where I did wash my car.
It's in German, but in the end,
it contains the amount I paid and some other information.
And I can upload this here.
And I could then use this model,
since this Gemma 3 model,
this 12 billion parameters model
does support image processing.
I could ask it to, "Please extract the core
information from this uploaded image."
And we could see whether it's able to do that or not.
It is technically able to parse images,
but let's see if it can read the content from this image,
since this is really bad quality.
Now, processing images can take a bit longer,
but it then goes ahead and this indeed doesn't look too bad.
Now, there are some mistakes in here,
like the street name is not totally correct,
but the amount I paid, for example, is correct.
And that's of course pretty impressive
since this is just a small model running locally
on our system and the quality here is not great.
By the way, for comparison, here I am using that same image
with the more powerful 27 billion parameters
Gemma 3 model.
And at least here for me, it does extract
all that information correctly.
So using these models for OCR tasks like this,
for extracting text from images,
can be one very useful use case.