How do I create and launch an A/B test?
A/B Test is a process in which you create different versions of your web page and test which one performs better in terms of conversion rate. The test can be based on CTA, image, heading, sub-heading or any other webpage element.
A/B testing lets web designers and marketers fine tune a prescription to build the most effective webpage.
Step 1: Creating Variations
- On the left pane on the experiment listing page, click A/B Test.
- Click on New A/B Test.
- Fill in the name of the test and the URL of the web page that you wish to conduct the A/B Test on.
- Click Create.
- In the Editor tab, you'll land on the Variation 1 by default.
- Hover your mouse anywhere on the rendered web page and the various elements will become highlighted.
- Format the variation according to your requirement by using the options from the Format tab on the right. Edit individual elements using the options that appear when you click on them.
- You can add more variations by clicking the + icon.
- Switch between Edit and Interact mode by using the toggle button on the right.
- Click Save after all your changes are made
Step 2: Setting Goals
Click Next to move to the Goals tab. Click + New Goal to add a goal to your experiment.
- You can add any or all of the goal options available:
- Engagement: Tracks the number of clicks on all the elements and links on the webpage
- Pageviews: Tracks the number of visits to a specified URL
- Click on Elements: Tracks the number of clicks on a specific element on the webpage
- Click on Links: Track the number of clicks to outbound links
- Custom Event: Tracks a specific event or set of events
- Revenue: Tracks the revenue generated by each variation
Click Save after adding the goals.
Step 3: Handpicking Audience
Click Next to reach the Audience tab.
- Under the Participation section, use the slider to set the percentage of your audience that should participate in the experiment.
- Under the Target Audience section, choose your target audience based on their behavior.
We offer targeting All visitors by default. You can choose between the preset target audience options available or create a +Custom Audience.
Step 4: Tweaking to your need
Click Next to reach the Configuration tab.
- Under the Segment Audience section, specify the traffic distribution across all the variants.
- Under the Set Mode section, choose the mode you wish to run your experiment in:
- Quick Trends: This mode is suitable for experiments that don't affect your revenue directly. Pick this mode if you're looking to find a winner in a short span of time. This mode has a statistical significance of 90%.
- Optimal: This is the default mode and is an ideal choice for almost all kinds of experiments. Pick this mode if you're looking for fairly accurate results in a reasonable amount of time. This mode has a statistical significance of 95%.
- High Accuracy: This is the best mode for critical experiments that affect your revenue directly. Pick this mode if you want to have highly accurate results without worrying about the time taken to achieve it. This mode has a statistical significance of 99%.
- In the next section, you can enable heatmap tracking for all variations in the experiment.
- Under the Schedule section, check the Launch this experiment later option to enable scheduling your experiment's launch.
You can now choose the launch date and the end date of your experiment based on your requirement
- Under the Integrations section, you can enable the required integration at the experiment level.
Step 5: Launch!
Click Next to reach the Summary tab.
The gist of your experiments, including the number of variations, goals, audience segments, and target audience, is displayed here.
- Click Launch in the top right corner to launch the experiment.
- Once your experiment has been launched, a new tab called Reports will appear alongside the Summary tab.
The Editor, Goals, Variation, and Configuration tabs will be temporarily unavailable when the experiment is running.
If you wish to make changes to your experiment, click the Pause button. The Editor, Goals, Variation, and Configuration tabs will become available. You will be able to edit any part of your experiment.
Click Relaunch to run the experiment again.
NOTE: Make sure you have added the code snippet on all the web pages part of your experiment.