Skip to content
UdemyData SciencePaid courseAll LevelsCertificate

Complete Course on A/B Testing with Interview Guide (Udemy.com)

AB Testing, Multivariate Testing, Multi-armed Bandit, Mock Interview Questions, R Coding, Statistics, Hypothesis Testing

Created by: Preeti Semwal

Last updated November 2022

icon
What you will learn

  • How companies like Google, Facebook, Amazon use Experimentation to launch successful products
  • Ace Experimentation & A/B Testing interviews
  • A/B Testing, Multivariate Testing & Multi-armed Bandit Testing
  • Hypothesis testing, including inferential statistics, significance level, type I and II errors, p-values, statistical significance and statistical power
  • End to end process from hypothesis generation & design to implementation & analysis
  • Real world examples from Amazon, AirBnb, Square, Uber
  • Relevance of statistics and how each statistical concept fits in the big picture of A/B testing
  • Sample size calculation and test results analysis using R
  • Use experimentation to optimize websites and app
  • Sample size calculation using online calculators
  • Use experimentation to increase conversion on landing pages or in-app campaigns

How it compares

Against the other 461 rated Udemy courses in Data Science on CourseDuck:

  • Rating4.1 out of 5higher than 3% of them
  • Reviews1,159#134 of 462 by number of reviews
  • Length2.5 hoursshorter than 85% of them
  • Last updatedNovember 2022earlier than 85% of them

icon
Course Description

Have you always wondered how companies like Google, Facebook, Amazon use experimentation and AB Testing to launch successful products?

Do you want to apply online experimentation at your start-up or your current role?

Or maybe you are interviewing for a role in big Tech and wondering how to succeed in those interviews?


With the rise of smartphones, online controlled testing has really come to the forefront. If you do a google search for Experimentation or A/B testing, you will come across thousands of blogs and articles that discuss this topic. Unfortunately, most of them are either full of inaccuracies and misinterpretation of mathematical concepts Or they are too difficult to understand. This is not surprising. A/B testing is a deep area - there are many nuances involved throughout the process from conceptualization & design all the way to implementation & analysis. This course addresses this. I have designed this course to go deep into important statistical concepts but in a way that is easy to understand using everyday examples.


In just two hours, you will learn -

  • What product experimentation is and how to do it right

  • What is AB Testing, Multivariate Testing and Multi-armed Bandit Testing

  • What is the relevance of statistics in AB testing

  • What do statistical concepts such as confidence intervals, Type 1, Type 2 errors, p-value, statistical significance and statistical power mean And how do they fit in the big picture

  • And how to calculate sample size and duration for a successful AB test

  • How to excel in AB testing interviews through real interview questions


All these concepts will be reinforced with real world examples from companies such as Amazon, AirBnb, Square and Uber. I will also provide you with templates and cheat sheets that have really helped me in my career. In 2 hours, you can master product experimentation and immediately start applying it in your job or interviews . See you in the course!

icon
Udemy Discount

The discount is applied through our link. Open the course from here and Udemy's current promotional price is applied at checkout on most courses, no code to type.

Some courses are excluded from Udemy's promotions. If the price does not drop, clear your browser cookies and use the button again.

icon
Instructor Details

Preeti Semwal

There is a big shortage of courses that teach Data Science & Analytics in a way that is true to the technical depth but also marry business intuition & implementation really well. My courses address this problem and translate data science through the lens of business implementation, while going deep into the math. That means at the end of the course, not only will you  master the mathematical concepts but you will also be ready to apply them in real world setting.

I have always been passionate about scientific thinking and deep analysis. My other passion is to teach and nurture. I bring these together as an instructor.

I have more than 12 years of experience in Data Science and Analytics working in Silicon Valley for most of those years. Over the years I have worked or consulted with companies such as Deloitte, SoFi, HP, Dell, Groupon, Walmart, Allstate and Mu Sigma.

I did MBA from Kellogg School of Management and Masters in Mathematics from Indian Institute of Technology (IIT) Kanpur.

I have headed many Marketing and Product Data Science & Analytics teams. In these roles I have helped launch and scale successful products and helped Marketing teams to optimize budgets of hundreds of millions of dollars through data science. Hired, mentored and promoted several managers, data scientists and analysts over the years.

My experience includes -

icon
More Data Science courses

Free

Free

Free

Free

$124.99

Free

icon
Reviews

4.1

1,159 ratings on Udemy

Select a bar to show only those reviews.Select the bar again to show every rating.

By Danielle Harris on 5/22/2025

There is no delving into the statistics and the interview questions are not answered. A lot of jargon is introduced at the end of the course in the mock interviews which isn't touched on during the course. We do not discuss choice of statistical test or exactly how to set up the tests in R - the code is provided but the choice of test and proper set up is assumed. Some important fundamentals are discussed, but if you want details on stats or randomization, this is not really the course for you.

By Boris Reif on 7/13/2023

This course gives a good high level overview of the topics described in the course description. The concepts are explained very clearly. The R code is an additional plus but could be improved. The course can also be further improved by going into more detail of some of the concepts, such as presenting the respective equations and explanations on how to calculate things by hand etc. The slides of the course are very nice. The idea of presenting mock interviews is innovative and nicely done. Overall I enjoyed the course, it complements well with other courses on Udemy on the topic of A/B testing.

By Maksym Kovalenko on 6/7/2023

As a UX/UI designer with a relatively small background in data science due to my experience in university, I found this course rather useful to understand the process of generating hyphotheses, calculating samples. Though the testing part was more difficult to me and even with some coding stuff, I wasn't very sure how can I replicate that even with some coding background in Python before, though I appreciate that this course has given me info about A/B testing platforms that might come useful in my future job as a UX/UI Designer.

By Sofia Lukashevych on 3/31/2023

Very engaging, structured, liked parts where there is music in the background of speech (it helps my brain concentrate and not loose the attention and desire to listen), cool examples, simple but at the same time fulfilling and helpful, love that all steps in examples are explained

By Vincent, Ka Ping Ma on 3/23/2023

A wonderful course to learn A/B testing. The most attractive merits of this course that I appreciate much: 1. This course provides not only theoretical setting of A/B testing, but it emphasizes on the business intuition and reasoning. And more, there are plenty of concrete business use cases and interview questions that make this course really helpful for practical purpose. Especially the interview question part, the answers are just perfect that they are very critical in logic and also practically strict to the point to solve real-world problems. 2. There are lectures that introduce multi-variate testing and multi-armed bandit testing that often are missed in other courses. For improvement of the course, I suggest: 1. There can be bonus lectures that go in-depth to multi-variate testing and multi-armed bandit testing. 2. Some optional bonus lectures can be considered to be added, taking a math-savvy approach, that provides a solid formulation of the problems in the mathematical language. (e.g. How do we derive the formula of the sample size calculation? I am a Statistics bachelor holder, for this part I completely know how to do; Moreover, multi-variate analysis is related to a Statistics subject - Experimental Design, Multi-armed bandit problem is classical in reinforcement learning, in fact these topics can all be taught using a rigorous treatment if we want.) 3. There can be a bonus lecture that explains some R codes and libraries used.

By Nicky Glover on 4/22/2022

It was very good and covered all the key aspects of A/B testing and the statistics involved. For someone who is new to stats I found some of the concepts difficult to get my head around and will probably have to go over some of it again but it provided a good foundation.

By FNU Kumar Sangam on 2/2/2022

The concepts are explained in an easy to understand format initially. Although I did feel topics were a little short on coverage in later chapters. I noticed, there are only 28 questions asked in this course and barely 1 or 2 have been attended to by the trainer. I would have really appreciated more answers to the interview questions and elaboration on how to solve for things like network effects and seasonality etc.

By Abdulaleem Seyed on 1/28/2022

I finally learned AB testing end-to-end. This course as set me up for success. To the extent that it has helped me prepare for a product analytics interview. The fact that multivariate testing was not part of this course was good. There is no point in learning advance topics in something if You have not master the basics in my honest opinion. If you want learn AB testing this is course for you. The instructor takes time to provide the “Why” the theory, before the “What” which is the practical application. You may need to Google a little to get more insight if something does seem clear for example I needed another source to understand MDE in laymen terms. But , that was me since I wanted go deeper into the MDE topic. With that said, it took me all of 5 mins to search, read and understand the topic to the extent I can teach it myself. This is when you know someone taught you something - when you can teach it someone else.

By Pallab Das on 12/25/2021

This is introduction course on A/B test for me. Instead of running here and there and finding information in bits of pieces, this course gave me complete outlook about A/B test and area and tools I will use to enhance my skill in A/B testing. I would appreciate if it include the model answers on questions mentioned on Part 24. Overall good course for me.

By Scott Germaise on 10/20/2021

This is a really good course and the instructor is clearly an expert as well - I think - a good teacher. There's a couple of places I think could have been a little better... * Several third party testing platforms were mentioned. It might have been nice to have had a separate lecture just looking at some of those. I understand features/benefits of such products can change fast, but a quick look might have been nice. * When we got to confidence intervals and formulas, some charts/formulas were put up, but not really picked apart as well as I think they could have been. We can all read a formula, but understanding really how/why each factor is in there could use more explanation. Same with significance level. Still, I end where I began... solid intro course. Solid instructor. (And just by the way, if you're new to R and decide to install it, you may need to play with getting some of the libraries/packages to install. They didn't go in cleanly for me on a Mac and required some Googling. So if things don't work perfectly straight away, just maybe try to manually install a package or library.

Showing all 10 reviews on CourseDuck

Read all 1,159 reviews on Udemy

icon
Quality Score

No CourseDuck member has rated this course yet. Taken it? Give each part a thumbs up or down.

Content Quality
/
Video Quality
/
Qualified Instructor
/
Course Pace
/
Course Depth & Coverage
/

Overall Score : 82 / 100