Statistics Quest

Central limit theorem

For large enough samples, the sampling distribution of the mean is approximately normal with mean μ and standard error σ/√n, whatever the shape of the population.

xˉ  ∼˙  N(μ,σ2n)as n grows\xbar \;\dot\sim\; N\Big(\mu, \frac{\sigma^2}{n}\Big) \quad \text{as } n \text{ grows}
Approximate sampling distribution of the mean
μ\mu
population mean
σ\sigma
population SD (must be finite)
nn
sample size
p^  ∼˙  N(p,p(1−p)n)when np≥10,  n(1−p)≥10\phat \;\dot\sim\; N\Big(p, \frac{p(1-p)}{n}\Big) \quad \text{when } np \ge 10,\; n(1-p) \ge 10
The same result for a proportion
pp
population proportion

When to use

Justifies z and t procedures for means and proportions when the population is not normal, provided nn is large enough.

Assumptions

Independent observations from a population with finite variance. "Large enough" depends on shape: n≈15n \approx 15–30 is often fine for moderately skewed data; strongly skewed or heavy-tailed populations (claims, incomes) can need hundreds. A normal population gives an exactly normal xˉ\xbar for any nn.

How to interpret

  • The theorem is about the sampling distribution of the mean, not about the data. The data keep their shape however large nn is.
  • The spread shrinks like 1/n1/\sqrt{n} while the shape becomes more normal.

Common mistakes

  • "With n ≥ 30 the data are normal." No: the mean is approximately normal.
  • Treating 30 as a universal threshold. Simulate or check the skewness.
  • Applying it to dependent data (time series, clustered samples) without adjustment.

Example

Waiting times are exponential with mean 4 and SD 4 minutes. For samples of n=36n = 36, xˉ\xbar is approximately N(4,0.6672)N(4, 0.667^2), so P(xˉ>5)≈P(Z>1.5)=0.0668P(\xbar > 5) \approx P(Z > 1.5) = 0.0668, even though individual waits are strongly skewed.