All Collections
Phrasee Platform
Creating Experiments
Create a Phrasee experiment - New workflow
Create a Phrasee experiment - New workflow

How to create a Phrasee experiment with the new experiment generation workflow

Updated over a week ago

We are in the process of rolling out a new and improved content generation process when creating experiments in Phrasee. This streamlined approach enables users to generate AI-optimized content more easily and quickly. It also means you can now generate messages around new themes, events, and promotions without needing to request updates to your existing projects.

Read on for a step-by-step guide on creating an experiment using this new workflow.

Or, skip to the below items for support on something specific:

Create an experiment

1) To get started, click the + Create button in the upper-left corner of the screen and then select Experiment.

2) Give your experiment a unique name. Then, select the type of experiment you want to create.

3) Now enter your human control message. Phrasee will use this to generate AI-optimized variants of your message and for uplift reporting purposes.

Yes, that’s right. Phrasee now uses your human control during the generation process. Phrasee will automatically detect key topics within your human control and use this during the generation process. This means you have one less step in the generation process, as you no longer need to input all the details of your send.

4) Input your email send date. This should be the date you plan to send the experiment. If it is an ongoing experiment, then select the expected start date.

5) Enter your expected audience size and average open rate for this audience into the Smart Split Calculator. As Phrasee gets data from your experiments, the calculator will automatically populate your average open rate based on your project audience.

Phrasee will use this data and your primary goal metric to calculate the number of variants required for optimal testing. If needed, you can override this number using the dropdown.

The metrics you can select as your primary goal include open rate, click rate, and the Phrasee Score, which uses a weighting of multiple engagement metrics. The default option is open rate but speak to your Customer Success representative to determine the optimization winner using a different metric.

Click Next.

6) Phrasee has now analyzed your human control message to identify any key topics that appear in it. Phrasee uses these topics to specify key themes for the generative AI to consider when designing your experiment.

For example, it might highlight discount amounts, products, or sale events in your human control message.

7) You can now add or edit the topics Phrasee has highlighted in your human control.

To do this, click the + Topics button to open the topic search.

Use the search function to find suitable topics and click Add next to each one you'd like to include.

Once you're ready, click Done then Finished. You'll see your additional topics added to the Topics section under your human control.

You can still generate content without topics highlighted or if you can't find a relevant topic in the topic search. You can find more information about adding and editing topics in this section.


We strongly recommend letting Phrasee design your test, which means not all generated variants will include every topic highlighted. However, if you need a topic to be included in every variant, then you can set this up at this stage using the Allow constants topics feature.

If you don't want to do any of this, you can skip this step and continue generating your variants.

8) Click the Magic button!

And, just like that, you have ten different variants to review and approve (nine Phrasee variants plus your human control).

Follow these steps if you need to edit or replace a Phrasee-generated variant. Or there are instructions here if you need to update your human control.

Otherwise, go ahead and click Approve!

9) And that's it! Your new experiment is set up and ready to go.


In this final view, you can:

  • Copy individual variants to your clipboard by clicking the clipboard icon next to the individual variants

  • Expand the side panel by clicking the arrow at the top of the grey sidebar to:

    • Copy all the variants to your clipboard

    • Download all your variants

    • Clone your experiment by clicking the clone icon in the sidebar on the left

    • Input results from your experiment

    • View your experiment ID information


Edit or replace variants post-generation

Edit Phrasee message variant

Something not quite right? Requesting a change is easy. Select 'Request a change' next to the variant you want to update and select whether to edit the existing variant or generate a replacement.

Be sure to tell Phrasee why you need to make the change so that it can continue to refine your AI content configuration.

Edit human control line

If you need to replace your human control completely. Go back to the Setup stage and edit your line there before regenerating.

If you need to edit or add topics to your human line, click Advanced settings in the Your control variant box at the top of the screen.


A message will appear telling you to refresh your variants. Click the Refresh button in the bottom-right corner of the screen to re-generate your variants.


Edit and add topics

Should I add additional topics to my human control?

Selecting any additional topics that haven't been picked up in your control increases the specificity of the brief you're giving Phrasee and, as a result, the accuracy of the output.

Phrasee might select a topic that doesn't quite match the content you're trying to generate. If that happens, remove the topic to keep Phrasee on track and look in the topic menu for a better option.

No topics highlighted. What should I do?

If Phrasee doesn't identify any topics, that's okay. You can add topics by following the steps below or skip this step and proceed straight to generation.

Selecting any topics that haven't been picked up in your control increases the specificity of the brief you're giving Phrasee and, as a result, the accuracy of the output. If you can't find the right fit in the topic search (or even if you can't find any matching topics at all) Phrasee can still generate copy. There just might be more of a need to tweak a line or two.

Add more topics to human control

You may want to add additional topics for Phrasee to consider as it generates your message variants. For example, in the below human control example, we should add the Ends soon limited-time offer as a topic.

To do this:

1) Click the + Topics button to open the topic search.

2) Use the search function to find suitable topics and click Add next to each one you'd like to include.

3) Once you're ready, click Done then Finished. You'll see your additional topics added to the Topics section under your human control.

I've deleted a topic. How do I re-add it?

If you accidentally delete the topic for a topic, you can need easily re-add it using the topic search function.

1) Click + Topics.

2) Search for your topic and click Add next to it. Configurable topics like price, brand, discount amount, or product can be found in the second view. Click Done in the topics search box to proceed to this step.

3) Click Finished. Your topics should now be added back into the topic section.

If configurable, click on the topic to reconfigure it by selecting the cog icon. If it is a discount amount, you must choose an option from the Discount modification dropdown and specify the type of discount before you can enter an amount. Otherwise, you will get an error message.

Edit configurable topics

Some topics can be configured, indicated by the cog icon in the topic box (e.g. a specific product name, a discount amount, or a destination being promoted). To edit the value of these configurable topics, click the cog icon and input the options.

Allow constant topics

Constants allow you always to have the elected topics within the generated variants.

There is a positive correlation between diverse language and performance. The more diverse your language is in terms of linguistic features like the different emojis, words, phrases, sentiments, and syntax that you use, the better the overall performance.

Because of this, Phrasee will design experiments with as diverse of a set of messages as possible. For example, Phrasee may test some message variants that exclude the discount amount or product featured in the human control.

We strongly recommend letting Phrasee test this, but we understand sometimes you might need to include specific topics in every message variant generated.

If so, you can check the Allow constants checkbox.

This enables you to drag up to two topics into the constants area. Phrasee will always include these within the generated variants.

To remove a topic from the Allow constants section, drag the topic back into the main topics section. Do not click X, as this will delete the topic. But don't worry: If you do this, you can quickly and easily re-add the topic.

Did this answer your question?