LightMySky
En anglais

Significance Tests for Chemical Data

Two results that differ may differ only because measurements scatter. A significance test states how likely that scatter is to explain the difference, which turns an argument about numbers into a decision with a stated risk.

No account needed. Progress saves in this browser.

What a learner can do afterwards

  • Chooses between comparing a mean with a known value and comparing two means, and runs the right test
  • Compares two spreads with an F-test and says what a significant result implies about the methods
  • States a null hypothesis, quotes the confidence level and interprets the outcome in chemical terms
  • Applies an outlier test and explains why discarding a result needs a stated rule

1 · Read

Two results that differ may differ only because measurements scatter. A significance test states how likely that scatter is to explain the gap, which turns an argument about numbers into a decision with a stated risk. Start from the null hypothesis, the claim of no real difference, and quote your confidence level: 95 percent confidence leaves 5 percent, or 0.05, as the bar.

Try it together

Javier and Ercilia each asked 100 shoppers about the trip to the mall, and both found the same average, 6.0 miles. But Javier's answers spread by about 4.0 miles while Ercilia's spread by about 7.0 miles. Trust the smaller spread: its average sits on steadier ground. A test that compares two spreads, such as an F-test, tells you whether that gap in scatter beats random noise, and a significant result means the precisions really differ, so you must not pool the two sets.

Pick the test that fits the shape of your data. One batch of readings against a certified value, like a balance checked against 100.0 mg, calls for a one-sample test. Morning and evening readings of the same flask come in pairs, so subtract each pair and test the single column of differences. Readings from different batches in two labs are independent, so compare the two means directly. A large P-value, like 0.40 against a 0.05 bar, means you fail to reject the null, which is never a proof that it is true.

Good to know

Never throw out a result just because it looks odd. Discarding needs a rule you stated before testing, applied through a proper outlier test. And when a small P-value like 0.03 beats your 0.05 bar, call the result significant, then say in plain chemical terms what it does and does not prove.

Name the null, run the test that fits your data, and read the P-value as a decision with a stated risk.

More to read

Bringing It Together: Homework

Two supervisors, Javier and Ercilia, each asked 100 shoppers how far they live from the mall. Both found the same average distance, 6.0 miles. But the answers scattered differently. Javier's answers spread out by about 4.0 miles, while Ercilia's spread out by about 7.0 miles.

Same average, different scatter. So which survey should you trust? The one with the smaller spread. Javier's smaller spread means most of his answers sat closer to the average, so his estimate is more reliable. Ercilia's larger spread means her data bounced around more, so her average is shakier even though the number looks identical.

This is why chemists never look at an average alone. Two methods can give the same mean result while one is much more precise. A test that compares the two spreads, such as an F-test, tells you whether the difference in scatter is bigger than random noise. If it is, the method with the smaller spread is the more precise one, and that matters when you decide which method to trust.

2 · Watch

En anglais

Take it off screen

Print a worksheetA4 with an answer key page for grown-ups. No screen, no internet.

Where it sits

Then practise

16 questions wait behind this lesson, each with its answer explained. Every answer feeds the sky: stars light as they are learned, and dim when it is time to come back.

Spotted a problem on this page? Tell us
Significance Tests for Chemical Data · Science, ages 18 to 20 · LightMySky