All Collections
Optimizely
Web experiments
Optimizely - Setting up a web experiment
Optimizely - Setting up a web experiment

How to set up a Phrasee web experiment with Optimizely

Updated over a week ago

Using Phrasee's web experiment integration with Optimizely Web Experimentation, you can now create language-based web experiments that leverage Phrasee's Brand Language Optimization for higher conversions, AOV and revenue.

A one-time account configuration is required before you can get started with setting up an experiment. Check out this section for more information about getting started: Optimizely - Getting started.

Optimizely x Phrasee integration workflow

Phrasee's integration uses the below workflow to automatically push your optimized Phrasee language variants directly into your Optimizely Experiments and feedback your results into Phrasee for ongoing optimization.

How to set up an Experiment in Optimizely using Phrasee's web experiments

1) Log in to your Optimizely account and create a new A/B Experiment within the project set up for Phrasee tests.

2) Configure the settings and URL for the test and click 'Create Experiment.'

3) Delete 'Variation #1' from the list of variations. Phrasee will automatically create your language variations for the Experiment in a later step.

Select 'Edit' next to the 'Original' variation. This variation will be the Human Control variant of your site.

4) In the Optimizely editor, select the element on the page that you want to test. Update the element with your human control copy for the test. Click 'Save.'

4) Open your Phrasee account and select 'Create a new experiment.' Name your experiment and select 'Web & App' as the campaign type. Enter your human control language and choose the number of variants you want to test. We recommend testing at least five language variations. Click 'Next.'

5) In the Language Generation step, select the start date of your Experiment (send date) and then the use case for the Experiment you are running, i.e. the language element that you are testing. Hit the 'Magic Button' to generate your language variants for testing.

6) Review the language variants. You can edit the variations by hovering over the variant and selecting 'Request a change' on the right side of the screen.
โ€‹
For best results, avoid editing the Phrasee variants unless something is incorrect or needs updating for reasons such as industry compliance or your brand's guidelines.

Select 'Approve and continue'.

7) On the experiment summary page, click the Optimizely integration button to open the Integration Drawer.

8) Within the Integration Drawer, select the Optimizely Project that contains your new A/B Experiment. Next, Select the Experiment you just created. Click 'Create and Send' to publish the variants into your Optimizely Experiment for your review.

If, for any reason, you need to unlink campaigns, click 'Unlink.' This will not delete the variations from Optimizely.

9) Navigate to your Optimizely account and refresh the page to see the language variations you generated in Phrasee. Preview and verify the variants using the before finalizing test setup.

6) Select your Audience, Metrics, Traffic Allocation, and Schedule for your test.

Audience: Configure your audience for the test. This is set to all website visitors by default but you can create different Audience Segments as required. Select 'Save.'

Metrics: The metrics available here are based on the Events configured at the Project level before setting up the Experiment. For more information on this, check out this section: Optimizely - Getting started. Select your Primary Metric for the Experiment and click 'Save to Experiment.' You can select additional Events to track in Optimizely, but the Primary Metric selected is what will be pulled back into Phrasee for ongoing optimization. Select 'Save.'

Traffic Allocation: Select either 'Manual' or 'Stats Accelerator' for your Distribution Mode. Select 'Save.'

  • Select 'Manual' if you would like to manually set the traffic distribution for each variation in the Experiment.

  • Select 'Stats Accelerator' if you would like to manage the audience distribution dynamically.

Schedule: Enter the timezone, start time, and end time for your Experiment. Select 'Save.'

8) Publish your Experiment by selecting 'Start Experiment' and the option 'Publish Only.'

9) Navigate back to the campaign you set up in your Phrasee account and open the Integration Drawer. Select the Primary Goal and Experiment Schedule to match what you selected within your Optimizely Experiment.

Please note: Phrasee will not schedule the Experiment in Optimizely. The timeframe selected here informs Phrasee when to start and stop collecting results for the campaign.

10) Select 'Save Schedule,' and you're done! Once your Experiment begins, Phrasee will pull results in for each variant on a nightly basis for the duration of your experiment.

The option to stop collecting data will appear once you have saved the schedule. This allows you to end the collection of results or update the schedule as required. To do this, simply select the pink button 'Stop collecting data' in the Integration Drawer.

Did this answer your question?