In this lesson, we are going to talk about some advanced concepts around the rack technique.
So the most important thing we want to share you a share with you at this point is that the rack technique
has different levels of, uh, optimization.
You have the basic technique, the basic, uh, steps, which as you saw, are very simple.
And then you have some advanced techniques in order to optimize each of these steps.
So you will see in the attached materials that we include a document with an introduction around some
of these advanced, uh, techniques around rack.
Okay.
So you will see that initially we talk about some advanced techniques around splitters.
And we will tell you that you can use different techniques in order to create the chunks of text from
the main private document.
Right.
You can use a technique like the character text splitter that uses a criterion to split the text into
fragments.
Just one criterion.
For example, a new line character.
Uh uh.
Or you can use more advanced techniques, like for example, the recursive character text splitter,
and in this case, uh, it uses one or several criteria to split the text into fragments.
For example, we can use paragraph break and line break.
This means it will first separate the fragments following the paragraph break criterion, and then if
any of the fragments is larger than the established size limit, it will separate the fragments exceeding
the maximum size using the second criterion, meaning the line break.
Okay, so don't worry about this just to tell you that there are some advanced techniques around the
splitters.
Uh, area.
Second area, the retrieval area.
In this area, you will see that there are different techniques that can help you, uh, with the performance
of this area.
I'm not going into detail because it's too early for you, but whenever you start using the rack technique
in a professional stage, you are going to appreciate some of the tips we give you here.
Third area vector databases.
You are going to see here that creating a database associated with a private document each time is not
the best way to work.
So uh, you have here different approaches in order to create the vector database once and update this
database every time you have a change.
So you will have some comments, interesting comments in the, uh, attached materials around that.
And finally you will have also an interesting note about how to use a technique, a long chain technique,
in order to debug your applications in a clear way.
So the purpose of this lesson is just to tell you that apart from the basic approach, uh, in the rack
technique, you have some advanced, advanced, uh, approaches.
Right.
So in all the different areas of the rack technique, you can use the basic approach or the most, uh,
advanced approach.
When are you going to use each of them?
Where in the proof of concept stage, you usually are going to use the basic approaches.
And when you go into production stage is where you start, uh, you know, using the optimizing, uh,
techniques.
And in the next lesson, we are going to talk about some of the challenges that you will see with the
rake technique.