Responsys - In-app and push message experiments

Testing AI-Powered Copywriting for push and in-app messages in Oracle Responsys

Updated over a week ago

Split testing in these channels requires some manual setup and winner selection. All of the programs created are reusable and only messages and dates need to be updated for each campaign.

Profile Extension

The first thing to setup is a Profile Extension with a field you can use to track a split test with. This is simply done by going to you Profile Lists, selecting your master list and under the Profile Extension tab selecting Create Profile Extension.

Create and name you Profile extension with a field to track if a subscriber has received a test email or not. You could create multiple fields here if you were going to run multiple campaigns concurrently.

Give your table a name

Create your messages

Now create your messages. You should create as many as Phrasee has suggested you test plus one for the main and final send. After you have created your messages it's time to create a Program to send them in a split test.

Create a split test Program

The below program is a simple example of how you can split test your messages.

Filter and Schedule

The program starts with a filter selecting everyone from your list and on the date and time you have scheduled it for.

Allocation

Once the Program starts it passes your audience to an allocation switch. This will be set to allocate a small percentage of your audience to testing and the remaining subscribers end their progress here. They will be sent the final winning message after the testing is complete. In this case 20% of the list will get test messages.

Set data

After this, the program uses the set data activity to record in the Profile Extension table you created which of the subscribers is going to be sent a test. In this case the field has been set to 1

Allocation

The second allocation should divide all your test audience into equal parts or as close to equal as possible. Where you are testing 8 messages some may have 12% and others 13%.

Send the message

After this the messages are sent.

Selecting a winner

Monitor the campaigns key performance metrics from the campaign designer insights option. Phrasee recommends waiting at least four hours before selecting a winner.

Winner program

This program is a simple filter and send program as seen below

All that is configured here is a filter to select the audience from your list that have not been marked as receiving a test email in the split test program. This filter should have been created beforehand too.

Here is an example of the filter configuration. Which selects all those audience members that have not got a 1 in the SPLITTEST field.

In the send message activity you can select a copy of the winning message. It is better to create a new copy of the winning message so that results of the final email can be monitored for any of the split test campaigns.

Did this answer your question?