Here's a typical A/B testing story.
Opening consultation for a data science project. The client proudly mentions:
"We run A/B tests all the time! And we get pretty nice results… Last time we just hit a +60% conversion increase on our main page."
Then we sit down to review those test results. And in 9 out of 10 cases it turns out that the client made a huge mistake somewhere in the process… And the promising conversion boost was only the result of improperly implemented or wrongly evaluated tests. The 60% increases they saw are, in reality, hovering around 0%. (Or worst-case, they turned out to be 20% decreases in conversion.)
Today, everyone can run an A/B test. There are easy to use point-and-click tools. In just an hour you can create and start your first experiment... Sure. But here's the thing: very few online experts can run A/B tests properly.
And as I have written: 90% of online businesses are doing A/B testing wrong!
Extremely dangerous… (for them, anyway.)
It's not their fault though. It's hard to get great at A/B testing. It can take years to learn everything:
I created this A/B testing course so you can skip the trial and error phase -- which can take years -- and get into the race with a head start. You don't have to go through all the typical mistakes to become an A/B testing expert. You can learn from others' successes and failures!
In this course, I'll provide you everything.
Not just everything you need to know about A/B testing... But frameworks, checklists and step-by-step guides that I use myself in my conversion-optimization projects.
So when you run your experiments in the future, they will be professionally executed, scientifically correct -- and most importantly, you will deliver real, long-term and outstanding results!
You'll A/B test like a pro!
For running proper A/B tests, you don't have to be a data scientist. But you have to understand the scientific background of experiments.
Don't worry, it’s not as complicated as you’d think!
You have to master 3 main domains:
The A/B testing business logic and the strategy. How can you make a real impact with A/B testing? How can you deliver real value (and real profit) for your online business?
Once you understand these, all you have to do is to learn a few more best practices and watch out for the typical mistakes... And you'll start to see more and more great results in your experiments!
Hi, I'm Tomi Mester, a data professional since 2012. I've seen, managed and run hundreds of A/B tests. Besides, I was lucky enough to get to the industry's most important conferences and learn from the best data analysts.
In the last few years, I’ve collected the best methods (and improved them further in practice); I've seen all the typical mistakes; and I've tested all the best practices on real life projects.
I have a smooth, simple and efficient A/B testing framework -- and a knowledge base that contains everything you need to know. Not to mention the cheat sheets and checklist I use in my own projects.
And you can get access to all these!
The A/B Test like a Pro! course is an online course. When you enroll, you'll get instant access to the course curriculum, where you will find:
This is a compact yet comprehensive course, by design. In other words, there is everything in it that you'll need and nothing that you won't.
I intend it to be the only A/B testing course you need to take. You take this course, you listen to it, you internalize it -- and then you'll simply know everything that you have to know to run experiments properly and with great results.
Here's the exact curriculum of the course:
MODULE #1 - INTRODUCTION:
MODULE #2 - IMPORTANT INITIAL BUSINESS QUESTIONS:
MODULE #3 - STATISTICAL BACKGROUND:
MODULE #4 - EXECUTION:
MODULE #5 - A FEW SMALLER ADDITIONS:
MODULE #6 - SUMMARY:
In the last few years, I’ve gotten a lot of questions on A/B testing. I'll answer all of them in the course. A few (but not all) of these:
In the last few years, over 800 students have enrolled in my data science courses. And I have two golden rules: (1) keep it simple and (2) keep it practical!
So I always put a huge emphasis on explaining everything (even the most complex concepts) in a way that enables everyone to understand it, internalize it and then apply it in real life.
In this A/B testing course, you will see examples from real-life business use cases. Most of the base concepts will be introduced through my (or through my data scientist friends' and colleagues') projects.
I guarantee this: This is not another marketing BS course.
Here, we will focus on the practical parts of running experiments - and more importantly how you will be able to use them in real projects.
I recommend this course for people who don't expect A/B testing to be a fancy, one-size-fits-all marketing tool for overnight conversion boost. (Because that'd be a lie anyway.)
It's for online professionals who want to understand the science and the strategy behind A/B testing. Who see that this is a research method. And who are ready to improve their results methodically for real, long-term success.
Do you want to hear a proper "target audience," too? Fine. Here it is.
The A/B Test like a Pro! course is for:
I got this question above from a course participant (before he registered). It might be a relevant question for many, so I’ve just copy-pasted the relevant part of the discussion here:
hi Tomi, quick question: How deep do we go into the topic? Is this interesting for experienced online professionals, too?
hey! Good question -- just in general: we start from scratch, and by the end of the course, we get far enough that everything regarding A/B testing will be completely clear. So I'd say that if someone has been running experiments for years, with great results, it's unnecessary for her to enroll. But for someone who just wants to get started with this field, or has been doing it for, say, half a year - but isn’t sure if she's doing it right, it's 100% that she will profit a lot from the course.
As of the current version of the course we don't use any coding languages in it. So you don't have to know any Python, SQL, R or bash.
We focus on understanding the key-concepts: the statistics, the business logic and the processes behind A/B testing. And for that we use the right point-and-click tools.
Yes, I think, everything important is covered in the course. Well, I wanted it to be compact and to-the-point... I personally don't like unnecessary-long learning materials when I learn, so I kept this in mind when I created this course.
Anyway, I keep the right to be wrong about this -- and it's possible that I missed something that should be in the course.
But that's why I added an important extra to the course: a 1-hour 1-on-1 consultation - online - for each participant of this class. There, we can discuss every question that you have after finishing the course. (I've also done this before and I've built in the typical questions/answers already into the current course curriculum... Regardless, I think the 1-on-1 call is a good opportunity to go deeper into the "nitty details" if needed -- also to discuss/brainstorm your specific project, etc...)
Tomi Mester is a practicing data analyst and researcher with 7+ years of experience.
He has worked for Prezi, iZettle and several smaller companies as an analyst/consultant.
He’s the author of the Data36 blog where he writes posts and tutorials on a weekly basis about data science, AB-testing, online research and data coding.
He's an O'Reilly author and presenter at TEDxYouth, Barcelona E-commerce Summit and Stockholm Analytics Day. More info about Tomi: check out the intro video. >>
Registration opens: 7 September 2020, 10pm (CEST)
You will have lifetime access to all course materials and you will get all future updates, too.
$197 (plus your country’s VAT if you live in the EU)
$297 (plus your country’s VAT if you live in the EU) -- if you want to add a 1 hour 1-on-1 consultation with Tomi Mester (the creator of the course)
ps. If you are from Hungary, please email me before you register: email@example.com.
The registration opens on 7 September 2020, Monday.
If you'd like to be added to the waiting list, just enter your email address below, and you'll be the first to be notified when I open registration again.
I would never want you to be unhappy! If you are unsatisfied with the course, contact me (firstname.lastname@example.org) in the first 30 days and I will give you a full refund.
Is it a problem if I don't have too much initial knowledge on the topic?
No. We will start from scratch. It's useful, though, if you are familiar with the basics of online marketing.
What if I am unhappy with the course?
I would never want you to be unhappy! If you are unsatisfied with your purchase, contact me in the first 30 days and I will give you a full refund.
When does the course start and finish?
This A/B testing course is a completely self-paced online course - you decide when you start and when you finish. Also, you'll have lifetime access to all materials -- and you will get all future updates, too.
How much time does the A/B testing course take?
Watching the videos and going through the learning materials will take around 3 hours. If you go deeper into the extra materials and if you follow all recommended action steps, it might take ~8-10 hours in total.
How long do I have access to the course?
How does lifetime access sound? After enrolling, you have unlimited access to this course for as long as you like - across any and all devices you own.
Will I get a receipt/invoice?
Yes. Individuals get a receipt via email. Companies get an invoice. EU-based companies get VAT-invoices. If you need something even more special, just reach out to me (email@example.com) and we will solve your administrative issues!