Statistics Quest

Subscription price test

A randomized price test for the monthly plan of a fictional language-learning app, Sadeem Lingo. About 9 000 visitors to the pricing page were randomly shown one of four monthly prices (49, 59, 69 or 79 SAR). Each row records the variant, traffic source, device, whether the visitor subscribed and the first-month revenue. Designed for comparing several proportions at once and for the multiple-comparisons problem: which price maximises revenue, and which differences are real?

Rows
9,000
Columns
7
One row is
one visitor to the pricing page
Version
v1

Data dictionary

ColumnTypeUnitSummaryDescription
visitor_id
Visitor
idAnonymous visitor identifier.
variant
Price variant
category4 levels: P49, P59, P69, P79Price shown: P49 = 49 SAR/month … P79 = 79 SAR/month.
price_sar
Monthly price
integerSARmean 63.95, median 59, SD 11.19, range 49–79Monthly price shown to the visitor.
traffic_source
Traffic source
category4 levels: search, social, direct, emailHow the visitor arrived.
device
Device
category2 levels: mobile, desktopDevice type.
converted
Subscribed
integermean 0.048, median 0, SD 0.2138, range 0–11 if the visitor subscribed, else 0.
revenue_sar
First-month revenue
numberSARmean 3.087, median 0, SD 14.01, range 0–94Price plus optional 15 SAR add-on for subscribers; 0 otherwise.

What it is good for

  • Compare four conversion rates with a chi-square test.
  • Run pairwise comparisons and adjust for multiple testing (Bonferroni, Holm).
  • Compare revenue per visitor (not just conversion) across prices.
  • Explain why the 'winning' variant from many comparisons may be a false positive.

Methods: chi-square test, two-proportion z-test, Bonferroni correction, Holm correction, confidence intervals, ANOVA on revenue per visitor.

Data quality notes

  • Conversion falls with price, but revenue per visitor peaks at a middle price — the differences in revenue are small and noisy.
  • In this particular sample the observed revenue per visitor is highest at 49 SAR, although the true optimum (by construction) is 59 SAR — a concrete example of how noisy a 'winner' can be.
  • Variants are not exactly equal in size (random assignment).
  • No missing values.

Provenance and licence

Visitors are assigned to the four prices with equal probability. True conversion rates fall with price: 6.0%, 5.4%, 4.4%, 3.6%, adjusted by traffic source (email 1.5×, search 1.1×, social 0.7×, direct 1.0×, averaging ≈1). A subscriber adds an optional 15 SAR add-on with probability 0.2. True revenue per visitor is therefore highest at 59 SAR, but the differences between neighbouring prices are small relative to sampling noise.

Synthetic data · CC0-1.0 (synthetic data generated by Statistics Quest) · generated deterministically (seed 20241006). It does not describe real people or organisations; any resemblance is coincidental.

Preview

Dataset

Subscription price test

9,000 rows · one row = one visitor to the pricing page · synthetic data

VisitorPrice variantMonthly price (SAR)Traffic sourceDeviceSubscribedFirst-month revenue (SAR)
V0001P5959searchmobile00
V0002P5959searchmobile00
V0003P5959socialmobile00
V0004P5959emailmobile00
V0005P6969directmobile00
V0006P4949emailmobile00
V0007P5959searchdesktop00
V0008P4949searchdesktop00
V0009P6969emailmobile00
V0010P5959emailmobile00
V0011P5959directmobile00
V0012P6969socialmobile00

Used in