LightMySky
En anglais

AI and Fairness in Decisions

Explore whether AI should make important decisions about people, including decisions about jobs, loans and justice. Learn who is responsible when AI makes unfair decisions and the basics of algorithmic fairness.

No account needed. Progress saves in this browser.

What a learner can do afterwards

  • Give an example of an important decision that AI might help make (hiring, medical diagnosis, loan approval)
  • Explain why letting AI make decisions about people can be risky if the system is biased
  • Suggest who should be responsible if an AI system makes an unfair decision

1 · Read

You have learned how AI bias can affect groups. AI can help choose interview candidates, assess loan applications or spot warning signs in medical scans. These are high-stakes decisions: mistakes can seriously affect people's lives. Choosing a playlist song usually has much smaller effects.

Try it together

Imagine 100 job applicants in Group A and another 100 in Group B. Both groups are equally qualified. A tool invites 70 from A and 20 from B. This gap is a warning sign to investigate. It does not prove what caused the difference.

Group A70Group B20
Each group has 100 equally qualified applicants in this made-up example. Check why their results differ.

A biased tool can reject suitable people by copying unfair patterns. In a made-up case, two areas have equal crime levels, but one has more arrests because it has more policing. Treating the arrest gap as proof of more crime can lead to unfair recommendations.

People who build and use AI have responsibilities to check and address unfair results. An organization cannot avoid that duty by saying 'the computer decided'. In a hospital, a qualified health professional should review an AI warning before it guides treatment. People need a way to question and correct unfair decisions.

Try it together

To compare counts, subtract the smaller from the larger. Our interview gap is 70 minus 20, or 50 more invitations. A count difference measures a gap. Judging fairness also needs information about qualifications, how decisions were made and who was affected.

20304050607050 more

Investigate unequal results in important decisions. People using AI remain responsible for checking and addressing unfair treatment.

Lesson, questions and flashcards written for this dataset. Applicant counts and the policing scenario are hypothetical teaching examples.

The reading was independently written for this dataset. The three linked videos are Code.org productions indexed by Khan Academy. Their publisher license terms have not been verified.

More to read

A review needs someone who can act

Imagine a tool rejects an interview application because a document is missing. The applicant explains that the upload failed. The missing file does not establish that the applicant lacks the skill it describes.

A reviewer should check the relevant information and correct the mistaken record. The organization should also investigate whether the upload problem affected other applicants.

Correcting one decision helps that applicant. Checking the process can reveal a problem affecting many people.

A review route needs someone able to change an unfair result. A complaints form alone cannot do that if nobody investigates or acts on what people report.

Explore more

2 · Watch

En anglais

Take it off screen

Print a worksheetA4 with an answer key page for grown-ups. No screen, no internet.

Where it sits

Learn first

Optional connections

This opens up

Where this leads

Jobs that lean on this skill. Follow one to see everything it is built on.

Then practise

8 questions wait behind this lesson, each with its answer explained. Every answer feeds the sky: stars light as they are learned, and dim when it is time to come back.

Spotted a problem on this page? Tell us
AI and Fairness in Decisions · Computing, ages 9 to 11 · LightMySky