--- title: "Systematic Error, Controls and the Design of a Measurement" description: "Independent repeats can reduce random uncertainty of a mean, but a shared systematic offset remains. Calibration, null tests, controls and blinding address different risks of bias. An uncertainty budg" canonical: https://lightmysky.com/learn/science/systematic-error-controls-and-the-design-of-a-measurement-mt_rGjB_JcsLJ source: https://lightmysky.com/learn/science/systematic-error-controls-and-the-design-of-a-measurement-mt_rGjB_JcsLJ.md retrieved: 2026-11-12 --- > **Agent view.** This is the Markdown twin of the page, for tools and assistants. > When to use this site, and the call that answers each job: https://lightmysky.com/agent-instructions.md > API description (OpenAPI 3.1): https://lightmysky.com/openapi.json · Authentication: https://lightmysky.com/auth.md > Pricing: https://lightmysky.com/pricing.md · Catalog: https://lightmysky.com/llms.txt · Full catalog: https://lightmysky.com/llms-full.txt > Every machine-readable file on this domain: https://lightmysky.com/.well-known/ai-catalog.json > Ask for Markdown with `Accept: text/markdown`, a `.md` address, or `?mode=agent`. # Systematic Error, Controls and the Design of a Measurement Independent repeats can reduce random uncertainty of a mean, but a shared systematic offset remains. Calibration, null tests, controls and blinding address different risks of bias. An uncertainty budget records the contributions and the rule used to combine them. Subject: Science · Area: Scientific Inquiry · Ages 22 to 24 Page: https://lightmysky.com/learn/science/systematic-error-controls-and-the-design-of-a-measurement-mt_rGjB_JcsLJ ## Ready when they can - Separates random from systematic contributions in a described experiment - Proposes a null test or a blind analysis for a stated risk of bias - Builds an error budget and identifies which term dominates ## Lesson: Random scatter versus built-in bias For independent repeats with stable, zero-mean random errors, averaging reduces random uncertainty of the mean. It does not reduce the scatter of individual readings. A fixed systematic offset shifts their common center and remains in the mean. Systematic effects can also depend on conditions, such as a scale factor that changes the size of each reading. Error is a difference from the true value, which is usually unknown. A reference standard helps estimate that difference, subject to its own uncertainty. Here, absolute error means the magnitude of the difference from the reference. For a positive reference value, absolute relative error in percent is 100 × absolute difference / reference value. This difference is not an uncertainty bound. *(drawing: The sign helps determine a correction. The absolute difference is 4 g. Divide by the 250 g reference and multiply by 100: 1.6% absolute relative error.)* A null test uses conditions under which the model predicts zero signal. Random noise can still produce nonzero readings. Compare the estimated signal with its uncertainty. A persistent departure larger than expected from noise calls for investigation, not an automatic verdict of bias. A result compatible with zero does not rule out every systematic effect; the test checks only effects to which it is sensitive. Calibration compares readings with reference standards and can reveal or correct response bias; correction uncertainty remains. A control group supplies a comparison baseline. Blind analysis hides treatment identities while analysts make choices, then reveals them after the analysis is fixed. This reduces expectation-driven choices. It does not change instrument noise or sample size, and other bias can remain. An uncertainty budget lists sources, their sizes and their effects on the reported result. Correct known signed offsets first, then budget the uncertainty that remains. Here, entries are upper bounds in common output units: add them for a conservative total, not a standard deviation. Other models use different rules. If each source can be reduced by the same fraction at the same cost, reducing the largest contribution lowers this total most. Using fertilizer A only on wet plots and B only on dry plots confounds fertilizer with moisture: their effects cannot be separated. Divide the field into moisture zones and randomly assign both fertilizers within each zone. Keep other procedures comparable. Randomization reduces allocation bias but does not guarantee balance in one trial. An untreated group gives a no-fertilizer baseline; it is not required just to compare A with B. **Recap.** Averaging can reduce random uncertainty of a mean. Check systematic effects with suitable controls, and combine uncertainty contributions using a stated model. *Original lesson, questions and flashcards written for this learning dataset.* ## Practice 8 questions on this page, each with its working shown. ## Needs first - [Combining Uncertainties and Reading a Result off a Graph](https://lightmysky.com/learn/science/combining-uncertainties-and-reading-a-result-off-a-graph-mt_kn8RhTDEOK) - [Fitting a Model to Data: Least Squares, Chi-Square and Goodness of Fit](https://lightmysky.com/learn/science/fitting-a-model-to-data-least-squares-chi-square-and-goodness-of-fit-mt_NN0WYlp0md) ## Optional connections - [Errors, Power and the Design of a Test](https://lightmysky.com/learn/mathematics/errors-power-and-the-design-of-a-test-mt_D7ZXbvSD0l) - [Calibration, the Blank and What Makes a Measurement Trustworthy](https://lightmysky.com/learn/science/calibration-the-blank-and-what-makes-a-measurement-trustworthy-mt_UNkQFonlWJ) ## Opens up - [Reading a Primary Paper: The Claim, the Figure and the Missing Control](https://lightmysky.com/learn/science/reading-a-primary-paper-the-claim-the-figure-and-the-missing-control-mt_DZE7z5vu9X) - [Reading a Paper: the Claim, the Evidence and the Assumption](https://lightmysky.com/learn/science/reading-a-paper-the-claim-the-evidence-and-the-assumption-mt_YFgMvbohC0)