Differences

This shows you the differences between two versions of the page.

--- en:how_does_a_split_test_work [2017/06/12 09:22] – bk
+++ en:how_does_a_split_test_work [2025/06/26 11:50] (current) – bk
@@ Line 1: / Line 1: @@
 ====== How does split testing work? ======
-**(not for promio.mail.one)**
+<WRAP round info 100%>
+**What is an A-B test/split test?**
-A split-run test allows you to compare different designs or subject lines in a test mailing prior to the main dispatch. \\
+It is often difficult to predict how readers will react to a campaign. This is why the most important principle in email marketing is test, test, test. The automatic A/B split tests in promio.connect make it easy to test a campaign.
-In the main dispatch, the mailing is then automatically sent to the test run’s winner.
+Set up two or more emails (with differences in,e.g., subject line, sender, or content). Each of these emails is sent to a subset of the target group. The winning email (with the highest open, click, or conversion rate) is automatically sent to the rest of the target group with a configurable time offset.
-When creating the campaign, select the type //A/B Test Campaign//.
-This box – which only becomes visible after setting up the creatives – contains all necessary settings for split testing.
+</WRAP>
+A split-run test allows you to compare different designs or subject lines in a test mailing prior to the main delivery. In the main delivery, the best-performing mailing is then automatically sent to the rest of the recipients. When creating the campaign, select the type //A/B Test Campaign//.
-{{:en:ab_test_parameter_en.png?nolink|}}
+This box, which only becomes visible after setting up the creatives, contains all necessary settings for split testing.
-  * **Test Duration**: Defines the period of time that is to elapse between test run and main dispatch in hours.
+{{:en:campaings_drafts_ab_campaigns.png?nolink&600|}}
-  * **Winner Parameter**: The mailing for the main dispatch can be determined on the basis of conversions, clicks or opens.
-  * **Target group**: Unlike standard campaigns, split testing requires the target group to be selected at the campaign level. The target group contains the addresses for both test run and main dispatch.
-  * **Test Part**: The percentage of the target group that will be used for the test run.
-The dispatch time entered under //Actions > Send Campaign > Delivery date// refers to the test run. The main dispatch follows after the testing period.
+  * **Duration test period**: Defines the period of time between test run and main delivery in hours. In this time, the winner gets identified.
+  * **Winner Parameter**: The message with the highest value in this category is declared A/B test winner. It can be determined on the basis of conversions, clicks, or opens.
+  * **Target group**: Unlike standard campaigns, split testing requires the target group to be selected at the campaign level. The target group contains the addresses for both the test run and the main delivery.
+  * **Test Part of target group**: The percentage of the target group that will be used for the test run.
-**Example:**
-  * Testing period: 3 h
-  * Campaign start: 10 o’clock
+The delivery date that has been inserted under //Actions > Send campaign > Delivery date// refers to the start of the test part. The main delivery starts after finishing the test period.
+**Example**:
+  * Duration test period: 5 h
+  * Campaign start: 10 o’clock
+The test run starts at 10 o’clock; the main delivery follows at 15 o’clock. \\
 <WRAP round alert 70%>
-Please keep in mind that coupon codes cannot be used in an A/B test campaign.
+Please keep in mind that
+  * Coupon codes cannot be used in an A/B test campaign.
+  * There is no option in A/B test campaigns to refresh the target group. This means that you should finalize your split tests as late as possible so you do not address those who signed out.
 </WRAP>
+{{tag>A/B_tests split_tests main_delivery}}

User Tools

Site Tools

Differences

Page Tools