In this lesson, we are going to talk about a very, I would say, very good question, which is if
GPT four vision is so good.
Why do we need multi-modal LM applications for?
And.
In order to talk about this, we need to remember the limitations of the foundational LM models.
We talk about that in a some in one of the initial lessons of the part two of the program.
So if you remember the foundational LM models like ChatGPT, for example, or anthropic or, or Falcon,
Mistral, etc., they have limited context window which means memory.
And they have a limitations regarding data privacy, data security, etc..
Do you remember all these limitations of the regular foundation LM models?
So with the multi modal foundation LM models we have the same limitations.
We have a limited context window.
We have a problem with data privacy, we have a problem with security etc..
So the same companies that.
Did not trust ChatGPT with their text because they have concerns about privacy, security, memory,
etc. are going to be the same companies that are not going to trust GPT four vision with their images
or tables exactly for the same reasons privacy, security, memory, length, etc., etc. and this is
very good for us because this allows us to build the multimodal LM applications that can solve all these
problems that GPT four vision has for many possible customers, especially a big companies, but also
mid-sized companies, public administrations, and any kind of organization or professional that has
a concern about these matters.
Okay, so the most common use case would be to ask questions about private, private multimodal documents.
Okay.
So in your company you want to use a multimodal LM with your.
Multimodal documents with your PowerPoint, PowerPoint presentations, you know, PDF documents, every
kind of documents.
But you have a problem with privacy, security, memory length, etc. that's why we are going to use
multimodal LLM applications like the one we are going to see in the example at the end of this block.
So the first thing we are going to see a before creating a multi modal LM app is going to be the alternative
ways we can use to create a multi modal LM application today.
And very important to understand how accurate are these alternative ways.
In order to focus our attention in the most efficient and most accurate method of all.
They see that in the next lesson.