Testing Thousands of Genes at Once: False Discovery Rate and What q Means · seed 1 · A4, ink-friendly. The answer key prints on its own page for grown-ups.

One test is easy, twenty thousand are not

Science · Genetics & Evolution · ages 23-24
Name ______________________   Date ____________
  1. You apply Bonferroni to 20,000 genes with an overall budget of 0.05. Which p values count as hits?

    • Only p below 0.05
    • Only p below 0.0000025
    • Only p below 0.5
  2. You run 20,000 gene tests, each with a 5 percent false alarm rate. About how many chance false alarms do you expect?

    • About 1,000
    • About 5
    • About 20,000
  3. A q value of 0.05 means about 5 percent of the whole gene list at that cutoff are expected false discoveries.

    Circle one:   True   False

  4. Scanning thousands of genes, why is false discovery rate control often more useful than Bonferroni?

    • It runs faster on computers
    • It needs no p values at all
    • Guarding against any single false alarm buries real signals
  5. What does Bonferroni-style family wise error control cap?

    • The chance of even one false alarm across the whole list
    • The fraction of false discoveries within the hit list
    • The number of genes you may test
  6. You run 10,000 tests, each with a 5 percent false alarm rate. Chance false alarms are about the rate times the test count. Type that number.

    Answer: ______________

  7. A student reads q equals 0.05 as a 5 percent chance that this one gene is a false alarm. What is wrong?

    • Nothing: that is exactly what q means
    • q speaks about the whole list, not about one gene
    • q values only apply below 0.01
  8. Pre filtering drops untrustworthy genes before testing. Why does this raise discoveries?

    • It changes the meaning of the q value
    • It shrinks the test count so real signals clear the bar
    • It removes the need for any control
LightMySky · lightmysky.comW1-mt_mIQ27rphrC-s1

Answer key

For grown-ups. Fold this page away before handing over the rest.

One test is easy, twenty thousand are not W1-mt_mIQ27rphrC-s1

  1. Only p below 0.0000025 · Bonferroni divides the budget: 0.05 over 20,000 is 0.0000025.
  2. About 1,000 · Multiply the rate by the count: 0.05 times 20,000 is about 1,000.
  3. True · The q value speaks about the list as a whole, not about one gene.
  4. Guarding against any single false alarm buries real signals · Bonferroni's bar is so strict that true effects cannot clear it, while FDR tolerates a known small fraction.
  5. The chance of even one false alarm across the whole list · Family wise control guards the strict event of any false alarm at all.
  6. 500 · 0.05 times 10,000 is 500.
  7. q speaks about the whole list, not about one gene · The 5 percent is the expected false fraction across the list, not a per gene probability.
  8. It shrinks the test count so real signals clear the bar · Fewer tests mean a gentler correction, so true effects pass while the promise holds.
Worksheet · LightMySky