DataIntermediate 2 to 3 hours

Hypothesis Testing (A/B Test)

Determine if a website change actually improved conversion, or if it was just noise.

The Scenario

An e-commerce site ran an A/B test on their checkout button colour. Control (blue) had 1,200 conversions out of 15,000 visitors. Variant (green) had 1,350 conversions out of 15,000 visitors. The product manager is celebrating, but is the difference statistically significant?

The Brief

Conduct a hypothesis test. State your null and alternative hypotheses, choose the right test, calculate the result, and write your recommendation to the product manager.

Deliverables

  • The null and alternative hypotheses stated formally
  • The statistical test you chose (z-test for proportions, chi-square, etc.) and why
  • The test statistic, p-value, and your conclusion at α = 0.05
  • A one-paragraph recommendation to the product manager in plain English

Submission Guidance

Show your working. A p-value without the calculation behind it is not convincing. If you would not ship this change, say so and explain why.

Submit Your Work

Your submission is graded against the rubric on the right. If you pass, you get a public Badge URL you can share on LinkedIn. There is no draft save, so work offline first and paste your finished response here.

This appears on your public Badge.

0/20000 charactersMarkdown supported

One per line or comma separated. Up to 5 links.

By submitting, you agree your submission text, name, and evaluation will appear on a public Badge URL.