Bayes' Rule and Updating a Belief
Bayes' rule turns the probability of evidence given a cause into the probability of the cause given the evidence. It explains why a test that is right almost always can still be wrong most of the time it fires, when what it looks for is rare.
What a learner can do afterwards
- Compute a posterior from a prior, a likelihood and a rate of false positives
- Explain the base rate effect on a rare condition with an accurate test
- Update a belief twice with two pieces of evidence and get the same answer either order
1 · Read
Bayes rule turns the chance of the evidence given the cause into the chance of the cause given the evidence. Multiply the prior by the likelihood, then divide by every way the evidence can fire, hits plus false alarms. The top is the true path to a positive, and the bottom is all paths.
Picture a condition in 1 of 100 people and a test that catches 99 of 100 sick ones while flagging 1 of 100 healthy ones. In 10,000 people there are 99 true positives and 99 false ones, so about half of all positives are mistakes. Accuracy on each group separately never promised that a positive means sick.
A false positive flags a healthy person, while a false negative clears a sick one. When the condition is rare, the healthy crowd is huge, so even a tiny false alarm rate buries the true hits. Always weigh a positive against the base rate before you trust it.
Each new result updates the last answer: yesterday posterior becomes today prior. Run the same Bayes step again with the fresh evidence. Because both results just narrow the same crowd, the order you fold them in changes nothing.
Bayes divides true hits by all positives, rare conditions make most positives false, and extra evidence updates the same answer in any order.
2 · Watch
Take it off screen
Where it sits
8 questions wait behind this lesson, each with its answer explained. Every answer feeds the sky: stars light as they are learned, and dim when it is time to come back.