While composing your email step, you can add multiple email variants (upto 5 for each step: A, B, C, D, E variants). Each variant can have a different subject and email body. After starting your campaign, you will get detailed analytics via the Stats tab and will be able to see which of the test variants works better: more email opens stand for a better subject, and more replies for a better email body.
When you add a new email variant, SmartReach.io will split the prospects in your campaign as evenly as possible, with each variant going out randomly to approximately 50% of the prospects. For example, if you have a list of 200, the system will automatically send variant A to 100 and variant B to the other 100.
Email steps are split up randomly according to the number of variants on the step. Each step is randomised independently from each other, so if [Day 1: Opening] Step variant was A, it doesn't mean this person gets A variant in the following steps as well.
Keep the following things in mind while setting up your A/B Tests:
1. Focus on the subject line if you want to optimise open rates, and the email body if you want to optimise reply rates
These are the elements you can change depending on your goal:
- Subject line
- Email body:
- Body text
- Call to action / offers
Change one element at a time and test it. If you change multiple elements in the same A/B test, the results will be confusing and you will not be able to say which change affected the results.
2. Setup the A/B test
In SmartReach.io, once you have added an email step to the campaign, you can click on 'Add variant for A/B testing' to add a new variant. You can add up to 4 variants for each step.
3. Check the results
You can see the detailed results for each step and its variants in the Stats tab of the campaign.
What happens when I delete an email variant ?
The variant and its stats are deleted.
The existing variants will be renamed. Let's say you had A, B and C variants, and you delete the B variant. Then the C variant will be renamed to B, so now you will have two variants: A and B (which was earlier C).
On deleting a variant, prospects will continue receiving emails using the rest of the variants for the step.
Let's say you have a campaign which has a Step-1 with two variants A and B. You have added 100 prospects to the campaign and started the campaign with warmup. Lets say that on the first day, 20 prospects each have received the variants A and B (so 40 prospects have received the Step 1 till now). Now, you delete variant B from the Step-1.
Then the other 60 prospects in the campaign will receive the variant A of Step-1.