WEBVTT

00:01.000 --> 00:02.240
Hello everyone.

00:02.520 --> 00:04.960
In today's video, I will cover haystack.

00:05.480 --> 00:12.520
The reason haystack is important in the guardrails is because I'm running a lot of matrix based guardrails

00:12.720 --> 00:14.240
on haystack framework.

00:14.800 --> 00:17.600
You can choose any other framework that you wish.

00:18.080 --> 00:21.200
Conceptually, it's just a framework.

00:22.280 --> 00:28.480
It's an orchestration layer that will help you run underlining models and give you some prompts that

00:28.480 --> 00:35.320
are pre-built, but conceptually, they all work very similarly in different frameworks.

00:35.800 --> 00:39.160
Another very popular framework is Lang Chain.

00:39.680 --> 00:41.840
I chose to do this in haystack.

00:42.200 --> 00:45.440
So now let's go quickly understand what is haystack?

00:45.960 --> 00:54.080
Haystack is an open source framework by deep set for building production ready applications, retrieval,

00:54.080 --> 01:01.600
augmented generative pipelines, and state of the art search systems that work intelligently over large

01:01.600 --> 01:03.040
document collection.

01:04.200 --> 01:06.840
What are the features that haystack offers?

01:07.160 --> 01:15.480
It's technology agnostic allow users the flexibility to decide what vendor or technology that they want,

01:15.640 --> 01:19.760
and make it easy to switch out any component for another.

01:20.320 --> 01:25.280
Haystack allows you to use and compare models available from OpenAI.

01:25.680 --> 01:26.600
Cohere.

01:26.840 --> 01:34.680
Hugging face as well as your own local models or models hosted on Azure, bedrock and SageMaker.

01:35.680 --> 01:37.320
It is very flexible.

01:37.720 --> 01:40.680
Haystack provides all tooling in one place.

01:41.120 --> 01:46.840
It always acts as file conversions, cleaning, splitting, training, inference, and more.

01:47.360 --> 01:53.480
And whenever custom behavior is desirable, it's easy to create custom components.

01:53.680 --> 02:01.760
It's very extensible, provides a uniform and easy way for community and third parties to build their

02:01.760 --> 02:06.800
own components and foster an open ecosystem around haystack.

02:07.840 --> 02:13.880
So let's run all the evaluators and matrix in this section on the haystack framework.

02:14.240 --> 02:20.360
I will go through how you can install haystack, and then we'll quickly run different metrics on the

02:20.360 --> 02:21.760
haystack framework.

02:22.080 --> 02:22.880
Thank you.

02:23.040 --> 02:25.280
And I'll see you in the next video.