Web Personalization: A/B Testing
Learn how to create A/B and Split campaigns for Web Personalisation.
Overview
A/B Testing and Split Campaigns for Web Personalisation let you create and compare multiple content variants within a single campaign. By measuring performance across variants, you can identify the experience that drives the best results and let the platform automatically serve the winning variant to the rest of your audience.
Prerequisites
Ensure the following conditions are met before creating an A/B or Split Web Personalisation campaign:
- Your website is added to the Netcore CE dashboard and the Netcore CE JavaScript is installed on it (standard prerequisite for all Web Personalisation campaigns). Refer here for the steps to do so.
- A Campaign placement rule (Website and URL) is configured for the campaign on the Setup page.
Create an A/B Campaign
- Log in to the Netcore CE dashboard.
- Go to Create > Engage with users > Web.
- Select A/B Campaign. The campaign configuration includes the following steps:
Step 1: Select the Campaign Type Log in to the Netcore CE dashboard and click CREATE > Engage with users > Web, and choose A/B campaign or Split campaign.
Step 1: Setup
- Enter the Campaign details.
- Campaign placement: choose the Website, an Operator (for example, Equals to), and the URL the campaign should run on. Click here to learn how to set up campaigns for web personlisation.
Step 2: Audience
Standard Web Personalisation audience targeting applies: Live user segment, User type (Identified/Anonymous, New/Returning), UTM parameters, User source, User location, Time of the day, and Device.
Step 3: Personalization
Configure the variants to test and define how the winning variant is selected. An A/B campaign starts with Variant A and Variant B. Click + Add Variant to add additional variants.
A maximum of 5 variants can be configured in a campaign.
Winning Criteria (A/B campaign only): Select the metric that determines the winning variant:
- Clicks: the variant with the highest click-through rate wins.
- Conversions: the variant with the highest conversion rate wins.
The winner is selected only after the configured test window ends. Statistical significance or confidence scores are not calculated or displayed.
Step 4: Configure Variant Content
- Start campaign: Start now or Start later.
- End campaign: Never ending or Specific date.
- Frequency: Choose the days of the week the campaign is active, and a time-of-day window per day. Use Copy for all to apply one day's window to the rest.
Step 5: Preview and Publish
- Review the summary on the Preview page: Setup, Audience, Personalization, and Schedule, each in a collapsible section, with tabs to flip between each variant's content.
- Click Publish Campaign to go live. A confirmation screen appears once the campaign is published.
Campaign Listing Page
Published campaigns appear under Engage > Personalized content, alongside Regular and Split campaigns. Filter the Status tab by All, Running, Draft, Scheduled, Completed, and Paused.
Edit a Live Campaign
You can edit an A/B campaign while it's still running. Below are the
- The current experiment ends immediately.
- A new version is created, with a fresh test window.
- Data from the previous version is preserved separately, not combined with the new run.
- Your active reporting view only shows the current version.
Winner Declaration Logic (A/B Campaigns)
- The first window begins once the campaign enters the Running state.
- During the test window, traffic is split equally among variants (after any control group share is reserved) and performance data is collected.
- At the end of the test window, the platform compares variants using the selected Winning Criteria (Clicks or Conversions).
- The variant with the highest metric value is declared the winner.
- The winning variant is automatically served to the remaining audience for the rest of the campaign.
Tie-Breakermore variants are tied at the end of the test window, the winner is selected at random by Netcore.
Updated about 5 hours ago
