LightMySky

The Ethics of the Tools We Build

Systems that rank, predict and decide about people distribute harm without anyone choosing to harm anyone. Applied ethics is where the frameworks meet a specific technology and have to say something concrete.

No account needed. Progress saves in this browser.

What a learner can do afterwards

  • Take one automated decision system and say who bears the cost when it is wrong
  • Apply two of the three moral frameworks to the same technology case and compare their verdicts
  • Explain why a duty owed to future people or to a species is harder to argue for than a duty to a neighbour

1 · Read

Ethics is not a garnish you sprinkle on finished code. Every dataset carries past choices, every threshold picks winners and losers, and every default nudges behaviour. Take a hiring filter trained on old hires. If the past favoured men, the tool learns to favour men. Calling it objective just hides the choice.

Responsible building starts there. Name who could be harmed, measure the errors per group, and design the appeal path before launch. Someone always pays when the system is wrong: rejected applicants, flagged tenants, misdiagnosed patients.

Try it together

Run two frameworks over one case and compare. Results thinking totals the good across everyone, so it might bless a biased triage tool that still saves more lives overall. Duty thinking asks whether anyone was used without consent along the way, and refuses the trade the moment one group becomes a mere means.

Good to know

Two further traps. First, technology is neutral is a dangerous line, since it treats a biased tool as maths instead of a human choice with losers. Second, future people sharpen every clash. They cannot speak or consent, so duties to them rest on shakier ground than duties to the neighbour your tool rejects today.

Every automated choice has losers, so test the errors per group and judge the tool with both results and duties.

2 · Watch

Take it off screen

Print a worksheetA4 with an answer key page for grown-ups. No screen, no internet.

Where it sits

Then practise

8 questions wait behind this lesson, each with its answer explained. Every answer feeds the sky: stars light as they are learned, and dim when it is time to come back.

Spotted a problem on this page? Tell us
The Ethics of the Tools We Build · Personal & Social Development, ages 16 to 18 · LightMySky