-: All right, let's walk through RunwayML
and the Gen-2 model,
which is currently one of the best
text-to-video models out there.
And this is a diffusion model like Stable Diffusion.
In fact, the RunwayML guys were part of the team
that were behind the original Stable Diffusion.
They focused more on video
after that text-to-image model was released
and been making a lot of strides.
So pretty interesting stuff.
The actual model itself is,
you know, accessed via their web interface.
They have a platform that you can use for video editing
and there's a bunch of really interesting features in there,
including some they've added more recently.
The main features I think that people are excited about,
the first feature really was text-to-video.
So being able to type in a prompt and then get a video back.
Now, bearing in mind this is pretty early days
for text-to-video.
You do get some, kind of, five second clips
that might be close to usable,
but, I would say in general it's not a great,
it is not good enough quality
to actually drop in directly into, you know,
a feature film or something like that.
This is more like B-Roll level quality, if that,
and the performance is improving exponentially.
So it's worth learning how it works now
because in 6 months, 12 months, we'll start to see,
I think movies, like actual movies or short stories
being generated with this.
Image-to-video is another thing they added more recently,
which has been really powerful.
And this allows you to give it a base image
and then turn that into a video.
That tends to work a lot better,
particularly if you're using a really good image model,
like Midjourney as the base image
because Midjourney has really great detail,
it's good for characters and then you can generate
from the generate useful video, which is really helpful.
And there's also this really cool feature
that just brought out called Motion Brush,
which is like inpainting for videos.
And they do actually have inpainting for videos as well.
But essentially this is letting you choose
one specific part of the image and animate that image,
that part of the image specifically,
bucket that under inpainting, Motion Brush,
similar kind of concept.
Take an existing video and then change some parts
of that video as well as they have,
you can remove the background,
you can change a specific aspect of the video.
So that's, I think, the future is taking a lot
of existing video footage
and changing some elements of it,
of video editing,
I think is gonna be more useful more immediately
than the purely generating a whole video from the prompt.
And now what are the use cases for RunwayML right now?
I would say creating B-Roll like this,
give here this example.
This is literally just me texting,
you know, text prompting, saying,
generate some aerial drone footage of Northern Ireland.
It made up this house, made up these cars, et cetera.
And you can still tell it's AI
and it's particularly the text
and the fact that the car is too long.
But this is pretty great actually for B-Roll,
especially if you're not producing like a Hollywood movie.
If this is something your kind of,
companies, like your startups, video production,
and you're just creating like an explainer video
or something like that, or you know,
like a non-professional video,
this can be pretty good.
You can also do video editing here
and you can see actually
how well it picks out different aspects from the screen.
So, all I did here is just click on,
this is an existing video
of a woman running through a field.
I clicked, just clicked once on the woman
and it found her exact outline.
So I think it's pretty good for that actually.
And you can remove a lot of parts of the image
or kind of add different parts,
erase the background,
whatever it is you need.
So I think that's gonna be like the main use case initially.
That is RunwayML is just a brief introduction.
Obviously there's a lot that goes into AI video generation
and it's still pretty nascent,
so I don't expect usable results straight away.
But for those who are interested,
hopefully this gives you a good understanding
of generally what is being done with it right now.