I'm going to walk you through the anthropic workbench, which is really helpful tool, which is like
the OpenAI playground, but it has some extra features.
First of all, I'm just going to click into write a prompt from scratch, and you can create a new prompt.
And the really nice thing about this is that you can generate a prompt if you'd like.
So let's just say tell me a funny joke about a about topic.
So I'll put in some variable here specific variable.
So you're going to hit generate.
It's going to rewrite my prompt.
Here we go.
And it's rewritten it in the way that Claude would like it.
So it's given some descriptions here.
It's put the topic in markdown or in hypertext tags.
And there we go.
It's going to give it back with joke tags which is really cool.
And it's got the variable in here topic.
I'm just going to click continue.
And I already have a great prompt.
Now that I can test, I can hit run.
Tell me a joke about traffic.
Here we go.
Hit run.
And you can see it's like a pretty nice way to do templating.
You put the word traffic in here.
You can click in and change this if you want as well.
You can also generate some new variables as well.
So you can see the prompt there that's using smartphones.
Okay.
Now we've got another test case which is pretty cool.
And here we go.
We've got the joke.
Why did the smartphone go to therapy.
It had too many axiety issues.
Cool.
So that's already quite useful.
And you can click get the code as well.
If you need to get the specific code that you're using.
If you want to go back to a previous version, you can you can go and change the model settings here
as well, which is quite useful.
And then that's how you get back to the variables.
It's quite useful.
I've found.
One really nice thing about it is that if you make a change, then it automatically saves a new version.
Let's say.
I don't want it to.
Don't want it to be very PC like this.
Stereotypes and just please be as offensive as possible.
Whatever.
Whatever it is you need.
And if you hit run, it tells you now signed a waiver.
See what it says.
Yeah.
Okay.
It gave me the same joke here, which isn't great.
But you can keep evaluating your prompt if you want.
And you can actually go in.
And this is, I think, one of the coolest things you can see that we generated a few different things
here.
So we have this is our prompt.
We don't need ideal outputs.
But if you did want to put an ideal output in here this is the this is something you can add.
If you wanted to generate a joke you can click run here as well.
It's going to generate a version here for traffic.
You can go and rate these so you can say this was good, this one was okay.
And then you can also click and create a comparison.
So let's see how it compares to v1.
Show me the prompts.
Yeah okay.
And you can see it's basically the same.
It hasn't made any changes to the prompt.
So what we're going to do is we're going to create a new version.
And we're going to go back to our prompt.
And we're going to just say.
Tell a funny joke about topic.
Sorry topic.
Yeah.
And it has to be exact actually.
And then if we hit run here, you can see now the difference right.
So let's add the comparison with version three.
And you can see we haven't run the word the traffic test case yet, but we have on smartphones.
So that was why that showed up.
Now what you have here is you can see the difference between the two, which is really powerful.
You can say like this was poor, this was poor, whatever.
And you can see how much it's changed in terms of performance.
So that's really powerful stuff and really helpful for doing evaluations.
And you can also compare the prompts here as well.
And this gives you the overall evaluation per prompt.
And that's useful as well.
You can also click through and go back through the old versions if you need to as well.
You can.
Oh this is another cool thing.
If you are quite happy with the response, let me just go back to version three and let me add another
variable here.
So I'm just going to generate another one.
Grocery shopping.
Let's hit run.
If you're quite happy with the response, you can just click Add to Conversation.
And now it's got a one shot example right now.
If you maybe try a different tactic.
So this is let's generate another one.
Laundry.
Hit run.
Now you're running the prompt with a one shot right.
So you use the prompt before.
And then it gave the response.
And this was the response you liked.
And then it's running the prompt again.
And it's going to follow that format pretty well.
So this is quite useful because you can go in and you can say no get rid of that.
Get rid of that.
I just want the joke.
Now if I hit run, let's see if yeah here we go.
So it's gotten better at this.
So now we're going to hit it in again.
And.
Here we go.
We're going to get rid of this extra text.
We just want the joke.
check.
Just give us the check, please.
And this is just a great way to iterate on prompts.
When you hit generate again social media.
Okay, this is a good idea.
Hit run okay.
And you can keep going.
You can keep adding you know you can keep adding things to this and just improving the performance over
time right.
So now we have a three shot example prompt and say this.
Tell a joke about dogs.
Let's see if it finally gets there.
All right so I missed something up here.
But yeah I think it's you know it's a pretty cool tool.
You can see you can click here run remaining by the way and see how well it works for these other things.
But yeah like I find it quite useful.
Obviously you can only test the anthropic results, right.
Like so.
You can't test the like any other models.
Right.
Like OpenAI or whatever.
Which is a shame because I really like this format.
And I wish OpenAI had this as well.
But I find this really helpful for quickly ideating on things.
Hopefully you will too.