Now that we have covered data quality tests, we can move on to the functional testing.
This is a common practice in software engineering, and even data engineers should apply some level
of functional testing to their code.
We will focus on three primary tests, which are unit integration and end to end testing.
In order to run these tests, we will use the unit test library, which already comes with the Python
installation, and also the Pytest framework for Pytest.
Since it doesn't come in the default packages of airflow, we have already added it to requirements.txt
file as you see here.
So it is part of the base docker image.
To confirm this, let's first make sure that your Docker containers are running by running the docker
PS command.
And then we go inside one of the airflow containers, let's say the airflow worker.
So we run docker exec -18.
And then we run the pip show by test to see if it is actually installed in our base image.
And there you have it.
We got an output.
So that means that Pytest is a part of our base Docker image package installations.
Now that we have all that we need to start testing in the next lectures, we will go over each of the
three functional tests explaining what they consist of and how to implement them in our code base.