Create a Phrasee experiment

How to create a new Phrasee content experiment using the classic experiment generation workflow

Updated over a week ago

Setting up a new experiment in Phrasee is easy. Read on to learn more, or watch the short video below for a step-by-step walkthrough of setting up an experiment in the Phrasee platform.

NB: This article covers creating an experiment using Phrasee's classic experiment generation workflow. Check out this article if you use Phrasee's new experiment generation workflow.

Looking for something specific?

Create an experiment

1) To get started, click the + Create button in the top left of the screen and then select Experiment.

2) Give your experiment a unique name. Then, select the type of experiment that you want to create.

3) Now enter your human control message. Phrasee won't use this when generating language but will use it to benchmark performance.

4) Enter your expected audience size and average open rate for this audience into the Smart Split Calculator. As you start to use Phrasee, it will automatically populate your average open rate based on past experiments.

Phrasee will use this data and your primary metric goal to calculate the number of message variants required for optimal results. If required, you can override this number by selecting the drop-down.

The metrics that you can select as your primary goal include open rate, click rate, and the Phrasee Score, which uses a weighting of multiple engagement metrics. The default option is Open Rate but speak to your Customer Service rep to determine the optimization winner using a different metric.

5) Click Next.

6) Next up, you’ll brief Phrasee on the details of your experiment. Just like briefing a copywriter!

Enter the date that you're planning to send the email for this experiment. If it is an ongoing experiment, then select the expected start date.

The options available at the language generation stage are bespoke to each project and customer, so the options you see on your account may vary from what's displayed here.

7) Once you're done, click the Magic Button and wait for the awesome.

8) And, just like that, you have ten different subject lines to review and approve.

Edit or replace a Phrasee-generated message variant

Something not quite right? Requesting a change is easy. Select Request a change next to the variant you want to update and select whether to edit the existing variant or generate a replacement.

Be sure to tell Phrasee why you need to make the change so that it can continue to refine your AI content configuration.

Edit the human control by selecting the pencil icon

9) Select Approve once you're happy with all your variants. But don't worry, you can always come back to these steps and make a change later if you need to.

10) And that's it! Your new experiment is set up and ready to go.

In this final view, you can:

Copy individual variants to your clipboard by selecting the clipboard icon next to the individual variants.

Expand side panel

Click the grey arrow icon in the side bar on the right to expand the side panel. From here you can do any of the below actions.

  • Input results from your experiment

  • Copy all the variants to your clipboard

  • Download all your variants

  • Clone your experiment

  • View your experiment ID information

Did this answer your question?