AI and Fairness in Decisions
Whether AI should make important decisions about people: jobs, loans, justice; who is responsible when AI makes unfair decisions; introduction to algorithmic fairness
What a learner can do afterwards
- Give an example of an important decision that AI might help make (hiring, medical diagnosis, loan approval)
- Explain why letting AI make decisions about people can be risky if the system is biased
- Suggest who should be responsible if an AI system makes an unfair decision
The lesson
AI now helps make some very big decisions about real people, not just recommending videos or sorting photos. It can help a company decide who gets called for a job interview, help a bank decide who gets a loan, or help a doctor spot a warning sign in a scan. These are called high-stakes decisions, because getting them wrong can really hurt someone's life.
A company sorts 100 job applications from two equally qualified groups. The AI invites 80 out of 100 from Group A to interview, but only 40 out of 100 from Group B. Nothing about their actual skills was different, so this gap is a warning sign that the AI learned an unfair pattern.
Bias like this can sneak in when an AI copies unfair patterns from old, biased data. That is exactly why letting an AI decide something about a person is risky: an unfair pattern can repeat itself thousands of times before anyone notices.
Because the AI cannot understand fairness, people stay responsible: the company that chooses to use it, the engineers who built and tested it, and the rules that require someone to check its decisions.
AI can help with big decisions about people, but when it is biased, humans, not the program, must stay responsible for fixing it.
Watch it
Where it sits
Learn first
This opens up
Where this leads
Jobs that lean on this skill. Follow one to see everything it is built on.
8 questions wait behind this lesson, each with its answer explained. Every answer feeds the sky: stars light as they are learned, and dim when it is time to come back.