Reproducibility in Practice: Data, Code and What Another Lab Can Rerun · seed 1 · A4, ink-friendly. The answer key prints on its own page for grown-ups.

Hand over work that reruns

Science · Scientific Inquiry · ages 23-24
Name ______________________   Date ____________
  1. How does reproducing differ from replicating?

    • Reproducing repeats the experiment fresh
    • Replicating re-runs your script only
    • Reproducing re-runs analysis; replicating repeats the experiment
  2. What does reproducibility require of a stranger?

    • Rebuilding every figure without asking you
    • Believing every claim without checking
    • Rewriting your code from scratch
  3. A reproducible package pins data, code, and tool versions plus the run command.

    Circle one:   True   False

  4. Rerunning your script on your data confirms what?

    • The phenomenon in nature
    • Your analysis and claims
    • Every future experiment
  5. A stranger reruns your package and the figure differs. What do you suspect first?

    • Fraud by the stranger
    • A law of nature changed
    • An unpinned version or a missing step
  6. Where do raw DNA sequences belong?

    • A sequence archive with metadata
    • A screenshot in a slide deck
    • An inbox attachment alone
  7. What must your README contain so figures rebuild years later?

    • The exact command plus pinned versions
    • Your biography and funding history
    • Opinions about rival labs
  8. A lab re-runs your script on your data and declares the phenomenon confirmed. What is wrong?

    • Scripts can never be rerun
    • Same-data reruns check analysis, not nature
    • Phenomena need no confirmation
LightMySky · lightmysky.comW1-mt_QuHuEyasFt-s1

Answer key

For grown-ups. Fold this page away before handing over the rest.

Hand over work that reruns W1-mt_QuHuEyasFt-s1

  1. Reproducing re-runs analysis; replicating repeats the experiment · One tests code, the other tests nature.
  2. Rebuilding every figure without asking you · No questions asked is the bar.
  3. True · Each unpinned piece is a future failure.
  4. Your analysis and claims · Same data cannot test nature twice.
  5. An unpinned version or a missing step · Drift hides in unpinned pieces.
  6. A sequence archive with metadata · Deposit by data type with metadata.
  7. The exact command plus pinned versions · Command plus versions freeze the run.
  8. Same-data reruns check analysis, not nature · Confirmation needs fresh data.
Worksheet · LightMySky