Once you have created an experiment in Phrasee and approved your language variants, setting up a MVT (Multi Variate Testing) campaign in Responsys is straight forward.
Please make sure the results feedback report configured as per this article here.
In Responsys, start by editing your email in the Email Message Designer and adding the subject lines for testing.
Click on the More button and select Version test
This will display the Variant editor form which allows you to enter the subject lines generated for the test. Click the Add variant button to add up to 8 subject lines for testing. Copy and paste the Phrasee subject lines into the form and click Next
This will open the Test versions form where you can name and preview the different versions if you so wish.
Clicking the Done save your choices and completes the process in the Email Message Designer.
Remember to save the email before exiting to the campaign workbook.
The next step is to create a simple program to send the email using the MVT methodology.
From the campaign workbook screen, select Create Program
This will open the Program Designer with a simple program temple. This template is all that is needed to successfully run a MVT campaign.
Start by selecting the Scheduled filter or view event.
This will open the settings of the event that will allow you to select the audience and schedule the campaign.
Select the filter or view that contains the subscribers you wish to send the email to. If you are unsure about filters and views, please consult the Oracle documentation. If you send to a specific list you can create a permanent filter that just says select everyone from the list whose email address is not null.
Then select when you want this program to run. This is the time that you want the split test to begin. As discussed with your Phrasee Customer Success Manager, this should be four hours prior to the normal email send time.
Click Done to save your settings
Next, select the Send email campaign activity
This is where the email created is selected and the MVT parameters are defined. Start by selecting the email for the campaign. And then check the Enable multivariate testing.
Next, define the parameters of the test by selecting the Multivariate testing option.
Make sure the Start new test checkbox has been ticked.
Choose to Start on publish or Start on date/time.
Select Automatic from the Winner selection mode and choose Unique open rate from the Metric drop down menu. If Unique open rate is not an option select the Open rate option and request Unique open rate metrics be added to you account from you Oracle representative.
Enter the sample size in the Total sample % block. When generating the subject lines in Phrasee and entering the audience size, the sample size will have be recommended. Enter the the suggested percentage here. Responsys will divide the subscribers equally between the versions.
Next, select the test duration. This should be set to four hours as standard. If the hours option is not available, it will need to be enabled on your account by Oracle. Once all the settings are entered, the program is ready for publishing.
Remember, all the settings in the campaign workbook need to be completed. The campaign is now controlled and scheduled by the program and you do not need to schedule the email from the campaign workbook.
During the sending / testing process the metrics of the campaign can be checked in the program by clicking on the test icon in the top left corner of the send email campaign activity in the Program Analyze tab.
