Significance Tests for Chemical Data · seed 1 · A4, ink-friendly. The answer key prints on its own page for grown-ups.

Deciding when a difference is real

Science · Chemistry · ages 18-20
Name ______________________   Date ____________
  1. In a paired significance test, you first subtract the two values in each pair, then run the test on the single column of differences.

    Circle one:   True   False

  2. A chemist weighs the same flask every morning and every evening for 10 days, and wants to know if the scale drifts between morning and evening. Which test fits this data?

    • A paired t-test on the daily differences
    • An independent two-sample t-test treating mornings and evenings as separate groups
    • A one-sample test against the known flask mass
    • A test comparing two proportions
  3. A student claims a new titration matches the standard method on average. What is the null hypothesis?

    • The two methods have equal true means
    • The new method has a higher true mean
    • The two methods used equal sample sizes
  4. You test at 95 percent confidence. As a decimal, what is the significance level?

    Answer: ______________

  5. A student claims a new titration method gives the same average result as the standard method. What is the correct null hypothesis for testing this claim?

    • The two methods have equal population means
    • The new method has a higher mean than the standard method
    • The two methods have equal sample sizes
    • The two methods have equal spreads
  6. A P-value of 0.40 at the 5 percent level proves the null hypothesis is true.

    Circle one:   True   False

  7. Lab A measures the purity of 8 batches of salt with a titration, and Lab B measures 8 different batches of the same salt with a sensor. The chemist wants to know if the two methods give different average purity. Which test should be run?

    • A paired t-test, because both labs measure purity
    • An independent two-sample t-test, because the batches are different and unpaired
    • A one-sample test against the certified purity
    • A chi-square test of counts
  8. A lab wants to check whether its new balance gives an average reading that matches the certified reference value of 100.0 mg. Only the lab's own repeated readings are available. Which test applies?

    • A one-sample t-test comparing the mean of the readings with the known value
    • A paired t-test on the differences between pairs
    • An independent two-sample t-test against another lab
    • An F-test comparing two spreads
  9. Two analysts measure the same standard solution with two different methods. An F-test on the two spreads gives a significant result at the 5 percent level. What does this significant F-test tell the chemist?

    • The two methods differ in precision, so the results should not be pooled as if the spreads were equal
    • The two means must be different
    • One analyst made a mistake and should repeat the work
    • The F-test checks whether the means are equal
  10. Your test at 95 percent confidence returns a P-value of 0.03. Which reading is correct?

    • The result is significant, but it does not prove the claim beyond doubt
    • The claim is proven true with 97 percent certainty
    • The test failed because 0.03 sits below 0.05
LightMySky · lightmysky.comW1-mt_2-SDgPjOQk-s1

Answer key

For grown-ups. Fold this page away before handing over the rest.

Deciding when a difference is real W1-mt_2-SDgPjOQk-s1

  1. True · A paired test reduces two columns of data to one column of differences, which is what the t-test then analyzes.
  2. A paired t-test on the daily differences · Each day gives one matched pair, so the pairing must be kept and analyzed with a paired t-test.
  3. The two methods have equal true means · The null always states the no-difference case.
  4. 0.05 · 100 minus 95 is 5 percent, which is 0.05.
  5. The two methods have equal population means · The null hypothesis is the statement of no difference, so it says the two true means are equal.
  6. False · It only means the scatter could explain the gap. Failing to reject is not proof.
  7. An independent two-sample t-test, because the batches are different and unpaired · The two groups are separate samples with no natural pairing, so the independent two-sample t-test is the right choice.
  8. A one-sample t-test comparing the mean of the readings with the known value · With one sample of readings and a single known target value, the one-sample t-test is the correct choice.
  9. The two methods differ in precision, so the results should not be pooled as if the spreads were equal · An F-test compares two variances, and a significant result says the two spreads really differ, meaning one method is more precise than the other.
  10. The result is significant, but it does not prove the claim beyond doubt · Beating the bar means significance, yet a decision with a stated risk is never absolute proof.
Worksheet · LightMySky