This has happened to me a lot:
We were preparing a data science project, so we did an audit of previous projects. Talking to the client, she proudly mentioned that they run A/B tests from time to time. And that, in fact, they get pretty nice results.
Then we sat down to review those test results. And it almost always turned out that they made a mistake somewhere.
The promising uplifts in conversion rate were only the result of improperly implemented or wrongly evaluated tests. The 40% increases they saw were, in reality, hovering around 0%. (Or worst-case, they turned out to be 20% decreases in conversion.)
As I have written: 90% of online businesses are doing A/B testing wrong!
I created the A/B test like a Data Scientist! course so you can be the exception. I'll show you the basic concepts, best practices, and pitfalls you should avoid. I'll give you a framework, checklists and step-by-step guides. And I'll answer all the questions that an A/B testing course can possibly answer. So when you run your experiments in the future, they will be professionally executed, scientifically correct -- and most importantly, you will deliver real, long-term and outstanding results!
You'll A/B test like a Data Scientist!
For running proper A/B tests, you don't have to be a data scientist. But you have to understand the scientific background of experiments.
Don't worry, it’s not as complicated as you’d think!
You have to master 3 main domains:
The business logic and the strategy. How can you make a real impact with A/B testing? How can you deliver real value (and real profit) for your online business?
Once you understand these, all you have to do is to learn a few more best practices and watch out for the typical mistakes.
And you'll be ready to run proper A/B tests with great results!
Hi, I'm Tomi Mester, a data professional with 7+ years in the field. I've seen, managed and run hundreds of A/B tests. Besides, I was lucky enough to get to the industry's most important conferences and learn from the best professionals.
In the last few years, I collected the best methods (and improved them further in practice); I've seen all the typical mistakes; and I've tested all the best practices on real life projects.
Based on that experience, I created a framework and a knowledge base. If you learn, internalize and use it, you'll be able to run A/B tests in a professional manner, too.
And I put all this into an online course format.
The A/B Test like a Data Scientist! course is an online course. When you enroll, you'll get instant access to the course curriculum, where you will find:
This is a compact yet comprehensive course, by design. In other words, there is everything in it that you'll need and nothing that you won't.
I intend it to be the only A/B testing course you need to take. You take this course, you listen to it, you internalize it -- and then you'll simply know everything that you have to know to run experiments properly and with great results.
Here's the exact curriculum of the course:
MODULE #1 - INTRODUCTION:
MODULE #2 - IMPORTANT INITIAL BUSINESS QUESTIONS:
MODULE #3 - STATISTICAL BACKGROUND:
MODULE #4 - EXECUTION:
MODULE #5 - A FEW SMALLER ADDITIONS:
MODULE #6 - SUMMARY:
In the last few years, I’ve gotten a lot of questions on A/B testing. I'll answer all of them in the course. A few (but not all) of these:
In the last few years, over 800 students have enrolled in my data science courses. And I have two golden rules: (1) keep it simple and (2) keep it practical!
So I always put a huge emphasis on explaining everything (even the most complex concepts) in a way that enables everyone to understand it, internalize it and then apply it in real life.
In this A/B testing course, you will see real-life examples. Most of the base concepts will be introduced through my (or through my friends' and colleagues') projects.
I guarantee this: This is not another marketing BS course.
Here, we will focus on the practical parts of running experiments - and more importantly how you will be able to use them in real projects.
I recommend this course for people who don't expect A/B testing to be a fancy, one-size-fits-all marketing tool for overnight conversion boost. (Because that'd be a lie anyway.)
It's for online professionals who want to understand the science and the strategy behind A/B testing. Who see that this is a research method. And who are ready to improve their results methodically for real, long-term success.
Do you want to hear a proper "target audience," too? Fine. Here it is.
The A/B Test like a Data Scientist! course is for:
I got this question above from a course participant (before he registered). It might be a relevant question for many, so I’ve just copy-pasted the relevant part of the discussion here:
hi Tomi, quick question: How deep do we go into the topic? Is this interesting for experienced online professionals, too?
hey! Good question -- just in general: we start from scratch, and by the end of the course, we get far enough that everything regarding A/B testing will be completely clear. So I'd say that if someone has been running experiments for years, with great results, it's unnecessary for her to enroll. But for someone who just wants to get started with this field, or has been doing it for, say, half a year - but isn’t sure if she's doing it right, it's 100% that she will profit a lot from the course.
Tomi Mester is a practicing data analyst and researcher for 7+ years.
He has worked for Prezi, iZettle and several smaller companies as an analyst/consultant.
He’s the author of the Data36 blog where he writes posts and tutorials on a weekly basis about data science, AB-testing, online research and data coding.
He's an O'Reilly author and presenter at TEDxYouth, Barcelona E-commerce Summit and Stockholm Analytics Day. More info about Tomi: check out the intro video. >>
This is a brand new video course. Before I launch it for a wider audience, I'll test it with a smaller group of 30 participants. And I'd like you to be one of them!
What does this mean for you?
I’ve already put a lot of energy and work into creating the main concept, the curriculum and all of the content for this course. But I'm still in the process of the video recording and editing.
If you enroll now, you will get the first half of the course (first 3 modules) on 21 November 2019 (Thursday) -- then the second half of the course on 5 December 2019 (Thursday).
In exchange for your patience, you will get a significant discount compared to the future price:
Normal price: $297 (+VAT in EU) / attendee
Early access price: $197 (+VAT in EU) / attendee
Plus, you will get access to the course before everybody else (the public release of this course will be in early 2020). And on top of everything, you will have lifetime access to all course materials and you will get all future updates, too.
Max. number of participants: 30
PS. If you are from Hungary, please email me before you register: email@example.com.
Registration has closed.
If you'd like to be added to the waiting list, just enter your email address below, and you'll be the first to be notified when I open registration again.
I would never want you to be unhappy! If you are unsatisfied with the course, contact me (firstname.lastname@example.org) in the first 60 days and I will give you a full refund.
Is it a problem if I don't have too much initial knowledge on the topic?
No. We will start from scratch. It's useful, though, if you are familiar with the basics of online marketing.
What if I am unhappy with the course?
I would never want you to be unhappy! If you are unsatisfied with your purchase, contact me in the first 60 days and I will give you a full refund.
When does the course start and finish?
This A/B testing course is a completely self-paced online course - you decide when you start and when you finish. Also, you'll have lifetime access to all materials -- and you will get all future updates, too.
How much time does the A/B testing course take?
Watching the videos and going through the learning materials will take around 3 hours. If you go deeper into the extra materials and if you follow all recommended action steps, it might take ~8-10 hours in total.
How long do I have access to the course?
How does lifetime access sound? After enrolling, you have unlimited access to this course for as long as you like - across any and all devices you own.
Will I get an receipt/invoice?
Yes. Individuals get a receipt via email. Companies get an invoice. EU-based companies get VAT-invoices. If you need something even more special, just reach out to me (email@example.com) and we will solve your administrative issues!