Okay, so the Lang Smith team.
Has prepared some very interesting guides and recommendations that we have linked there here in the
in the notebook.
Okay.
So you have a several very interesting how to guides regarding lamb-smith tracing, how to specify the
percentage of traces you send to Lamb-smith.
This is very important because this has to do with your cost.
So we highlighted this bold as you can see.
So how to specify the percentage of traces you send to Lamb-smith.
How to add metadata and tags to traces.
How to add an annotation to one particular trace.
Here you can see all the how to guides in this section.
And here you can see the Lang chain specific guides for this section.
Then we have some use cases guides for Lang Smith tracing to monitor application sentiment, to summarize
application usage and for few shot prompting with a Lang Smith datasets.
Very interesting as well.
We have some, uh, interesting guides regarding Lang Smith evaluation.
You have one quick start guide.
Very interesting.
And also a detail a document about Lang Smith evaluation concepts.
And finally you have several very interesting how to guides regarding Lang Smith evaluation, how to
create custom evaluators, how to paraphrase examples to expand your data set, how to create new examples
using prompting and other how to guides.
The Lang Smith team has also included a list of recommendations for us when we are working on evaluation.
This is what they say.
Test early and often.
Create domain specific evaluators.
Use labels where possible.
Use aggregate levels.
Measure model stability.
Measure performance of subsets.
Evaluate production data.
Don't train on this data sets.
Test the model yourself.
Ask appropriate questions and here you have interesting resources to learn more.
Well, I think these are general recommendations.
Probably they don't apply to every case, but I think they are very good general recommendations.
Then you have a interesting a information, a link to interesting information about monitoring, a link
to a quick start guide about the prompt hub, and a couple of interesting links with more information.
This is the blog post of the announcement of a.
The general availability of Lang Smith, in my opinion, is a little bit difficult to read because they
have included so many gifts there that this is really not easy, but a well, there you have it.
And remember that we have based many of our previous lessons in the information contained here.
So probably right now you are very familiar with the content.
And this second a video is very interesting.
This is the Lang Smith in-depth by the Lang Smith team.
Also very interesting resource.
So in the next lesson we are going to see a detailed view of the next features of Lang Smith.
What are they preparing for us.
So this is going to be very interesting.
We will see that in the next lesson.