Statistics Quest

Bernoulli and binomial distributions

The binomial distribution counts successes in a fixed number n of independent trials that each succeed with the same probability p.

P(X=k)=(nk)pk(1−p)n−k,k=0,1,…,nP(X = k) = \binom{n}{k} p^k (1-p)^{n-k}, \quad k = 0, 1, \dots, n
Binomial pmf (Bernoulli is the case n = 1)
nn
number of trials (fixed in advance)
pp
probability of success on each trial
kk
number of successes
(nk)\binom{n}{k}
number of ways to choose which kk trials succeed
E⁡(X)=np,Var⁡(X)=np(1−p),SD⁡(X)=np(1−p)\E(X) = np, \qquad \Var(X) = np(1-p), \qquad \SD(X) = \sqrt{np(1-p)}
Mean and variance
XX
number of successes, X∼Binomial(n,p)X \sim \text{Binomial}(n, p)

When to use

Counting successes (conversions, defective items, correct guesses) out of a known number of trials. A single trial (success = 1, failure = 0) is a Bernoulli variable with mean pp and variance p(1−p)p(1-p).

Assumptions

The "BINS" conditions: Binary outcome on each trial; Independent trials; Number of trials fixed; Same probability pp on every trial. Sampling without replacement from a small population breaks independence; use the hypergeometric instead (the binomial is a good approximation when the sample is under about 10% of the population).

How to interpret

  • The distribution is symmetric when p=0.5p = 0.5 and skewed towards the longer tail otherwise.
  • The proportion of successes X/nX/n has mean pp and SD p(1−p)/n\sqrt{p(1-p)/n}.
  • Normal approximation: reasonable when np≥10np \ge 10 and n(1−p)≥10n(1-p) \ge 10; the engine computes exact binomial probabilities, so the approximation is only needed for intuition.

Common mistakes

  • "At least 3" is P(X≥3)=sf(2)P(X \ge 3) = \text{sf}(2); the engine's sf(k) is P(X>k)P(X > k).
  • Using the binomial for a count with no fixed upper limit (use Poisson) or for "trials until the first success" (use geometric).
  • Forgetting the (nk)\binom{n}{k} factor: pk(1−p)n−kp^k(1-p)^{n-k} is the probability of one particular sequence.

Example

n=10n = 10 calls, each converting with p=0.2p = 0.2. P(X=3)=0.2013P(X = 3) = 0.2013; P(X≤2)=0.6778P(X \le 2) = 0.6778; P(X≥3)=sf(2)=0.3222P(X \ge 3) = \text{sf}(2) = 0.3222. Mean =2= 2, SD =1.6≈1.265= \sqrt{1.6} \approx 1.265.