In this lesson.
We will talk very quickly about some other interesting notes regarding the advanced architecture of
LLM applications.
Remember that you have a lot of documents in the attached materials.
And in this lesson, I just wanted to tell you a little bit about how you are going to find in this
attached materials for these blocks.
So you will see some information about LLM ops frameworks, about evaluation frameworks, about a optimization
techniques for uh, the RAC system, the microservices uh alternative, the microservices architecture
for LLM applications, and also a very interesting document, just highlighting the most frequent challenges
when deploying LLM applications to production.
I am not going, uh, to go into detail, uh, I think that at this point it is not a the best moment
to go in detail, uh, with this, uh, topics.
The only thing I will tell you about is about the last, uh, point.
The top challenges when deploying LLM applications to production right now are cost evaluation, reliability
of the infrastructure, and quality of the foundational model.
So with that, you can understand that advanced architecture of LLM application doesn't end with back
end front end LLM.
APIs and cloud storage.
We also have many other issues that we need to solve in the process of going into production, and you
will see that the top challenges when deploying applications to production are.
Cost.
Evaluation, which is testing the reliability of the infrastructure and the quality of the foundation
LM model that we have, uh, selected.
So just wanted to give you a quick a note of the complexity that it is involved in developing and deploying
LM applications.
This is the the kind of things we are going to see in the next lessons.
So we are going to be, uh, far from the toy demos.
We are going to be focused on professional applications.
In the next lesson, we are going to talk about a very, very important topic in this program, which
is the Rag technique.
The Rag technique is the main technique of the LM applications right now.
So it is very important for us to understand what it is and how to master it.