Statistics Quest

Experimentation and A/B Testing

Designing, sizing, analysing and deciding from controlled experiments, with the traps that invalidate them.

Product, marketing and growth analysts who run experiments.

What it includes

  1. 04ProbabilityThe rules of chance, conditional probability and Bayes' theorem.
  2. 06Sampling and the Central Limit TheoremHow samples behave, and why averages become predictable.
  3. 07Estimation and Confidence IntervalsEstimate unknown quantities and state the uncertainty honestly.
  4. 08Hypothesis TestingTest claims with data and draw defensible conclusions.
  5. 11Experiments and A/B TestingDesign, analyse and decide from controlled experiments.
  6. CapstoneCustomer conversion experiment: ship the new checkout?Run a checkout A/B test the way a senior analyst would: pre-register the metric, effect size and sample size, check the randomisation, analyse conversion with an interval for the lift, handle revenue, guardrails and segments honestly, and make a ship / no-ship call that weighs uncertainty against money.
  7. AssessmentExperimentation and A/B Testing — final assessmentA 60-minute exam across the Experimentation pathway: probability, sampling, estimation and hypothesis testing applied to experiments, then designing, sizing, validating, analysing and deciding from A/B tests — including multi-step questions on the checkout and pricing test datasets.

Certificate of completion

Earned when every track requirement (all lessons and the track skill check), every capstone task and the final assessment are complete. It certifies completed Statistics Quest coursework; it is not an academic or professional accreditation. Track your requirements on your certificates page.