WORKSHOP
Split Testing: An Introduction

Duration: 1 .5 hours

Workshop Objectives:

1. Grasp the concept of split testing and how it compares different variations to achieve marketing goals.
2. Learn the importance of data-driven decision-making in marketing and how split testing fosters continuous improvement, reduces risk, and enhances cost-effectiveness.
3. Explore split testing use cases in marketing campaigns, website design, user experience, email marketing, social media content, and pricing strategies.
4. Become familiar with key terms used in split testing, such as variation, control, conversion rate, statistical significance, etc.
5. Understand the split test process, from defining goals and choosing variables to data collection, analysis, and decision-making.
6. Through group discussions, engage in hands-on learning, and brainstorm split testing ideas for specific marketing use cases.

Workshop Outline:

Introduction (5 minutes)

• Welcome participants and introduction to the workshop topic
• Briefly explain split testing and how it works, comparing variations to achieve specific goals.
• Emphasise the importance of data-driven decision-making in marketing.

Part 1: Understanding Split Testing (15 minutes)

• Define split testing and its significance in marketing.
• Discuss the split testing process, including variation creation, randomisation, data collection, statistical analysis, and conclusion.
• Highlight standard metrics used in split testing, such as conversion and click-through rates.

Part 2: Why Split Testing Matters (10 minutes)

• Explore the benefits of split testing in marketing, including data-driven decision-making, optimisation, cost-effectiveness, continuous improvement, reduced risk, and enhanced user experiences.
• Share success stories or case studies showcasing how split testing has positively impacted marketing campaigns.

Part 3: Typical Applications of Split Testing (20 minutes)

• Present various use cases of split testing in marketing campaigns, website design, user experience, email marketing, social media content, and pricing strategies.
• Discuss how split testing can help marketers make informed decisions and improve campaign performance.

Activity: Group Discussion (10 minutes)

• Divide participants into small groups and assign each group a specific marketing use case from the presented list.
• Encourage participants to brainstorm ideas for split-testing experiments related to their given use case.
• Each group will share their thoughts and insights with the rest of the workshop attendees.

Part 4: Terminologies in Split Testing (5 minutes)

• Introduce essential terminologies used in split testing, such as variation, control, randomisation, conversion rate, statistical significance, confidence interval, hypothesis, test duration, traffic allocation, winner, sample size, heatmap, funnel analysis, and segmentation.

Part 5: How Split Testing Works (5 minutes)

• Explain the step-by-step process of conducting a split test, from defining the goal and choosing the variable to implementing the test data collection, analysis, and selecting a winner.
• Emphasise the importance of a well-defined plan and proper randomisation for reliable results.

Conclusion (5 minutes)

• Recap the key points covered in the workshop.
• Encourage participants to incorporate split testing into their marketing strategies to optimise performance and achieve better results.
• Provide resources for further learning and tools to conduct split tests.
• Open the floor for questions and answers.

Wrap-up (5 minutes)

• Thank participants for attending the workshop and for their active participation.
• Invite feedback and suggestions for future workshops.
• Provide contact information for follow-up inquiries.
• End the workshop with homework, in preparation for the next workshop.

Workshop Tools & Resources

Presentation – Slides to be sent to participants after the workshop

Guide – PDF to be sent to participants after the workshop

Homework

Identify an opportunity for Split testing in your organisation