What is stable diffusion?
This is one of the most interesting image generation models
'cause it's the only one that's open source
and still state-of-the-art in terms of generation.
The diffusion models, they're all kind
of use the same underlying infrastructure.
The way that they're trained is you take tons
and tons of images from the internet
like pictures of cats
and you have the captions, the alt tags
that people have added to them
that say what's in the image.
Then you kind of add lots of noise
in the training process
until it becomes just a random image of noise.
And then if you train it on enough of those things
you can basically reverse the process.
So you could take some random noise
and then give it a caption
which is the prompt
and then it will reverse.
So it will kind of become
slowly diffused into the image.
And the really cool thing about Stable Diffusion
as I mentioned, is that it's open source.
It was released by Stability AI
and a bunch of other partners like Runway ML
and it came out
I think a university in Munich
was one of the researchers.
So
it's, pretty intense
that a model that is this good is free
and available to run on your home computer
if you have a GPU
or you have one of the new kind of
M1 or M2 Macs.
It's, it's state of the art
like it's as good as Midjourney
as good as DALL-E
which was a real surprise to everyone.
But in many ways it's better.
It has more functionality
because it's open source people have added to it.
So DreamBooth, for example
is only really available in Stable Diffusion
you can train yourself into the AI.
A few of the other features, like I mentioned DreamBooth
there is a picture of me
except as like a dwarf
a dwarf with armor on.
You know
pretty crazy you can do that.
You can use this for your profile pictures, whatever.
It has CFG scale.
So kind of gives you a few more
parameters than you get with DALL-E.
You can basically tell the image
how close you want it to be to your prompt.
And you can also add negative prompts.
So you know, this is a photograph
of a astronaut riding a horse
except not in space, right
we added the negative prompt of space.
Technical ability is the road blocker here.
You do probably need to know how to code
or at least, you know, not be afraid
of modifying a few lines here and there.
And you know, you can
obviously if you want to get it running
to power your website
or something like that, you can
if you want your own version running
you either need a very good computer
and you know, and
and or you need to understand
how cloud hosting like Google Cloud Console or
or AWS works.
Because it can
you can run into a lot of kind of
setup issues, shall we say.
But that said, you know, once, once you've got it
you can use it for pretty much
anything like profile pictures.
A lot of the profile picture websites that
that are out there or you know
automatic stock photo websites
they use Stable Diffusion.
You can actually build a business around this
because it's open source.
You're not in danger of anyone turning it off.
You could also use it for product placement.
So I haven't seen anyone
you know
at least kind of publicly
talking about this
but this is something I tried early on.
I this, this,
this picture on the right
is actually my daughter's purse
but being held by Elsa from Frozen.
And this isn't a real picture
this is purely generated by AI except
I trained Stable Diffusion on lots of pictures
of my daughter's purse.
So I can put that purse in any situation now
and use it in my prompts.
So really, really cool stuff.
The, the thing with Stable Diffusion
I think
is that
the learning curve is very difficult.
You know, if you don't know how to code
even if you do know how to code
you can run into a lot of issues.
It takes a lot of processing power to run.
You could very quickly rack up a lot
of cost if you're hosting this to yourself
so those are the things to really watch out for.
But otherwise
it's honestly magic.
You know, try it,
use it, play around with it.
Experiment.
This is a real gift that we have this.