The Gram-Schmidt Process
Turn any basis into an orthonormal one by subtracting off projections onto what has already been built, which gives the QR factorisation used by numerical solvers.
What a learner can do afterwards
- Orthonormalise a small basis by hand
- State what the process preserves at every stage
- Read the QR factorisation off the completed process
1 · Read
Gram-Schmidt turns any basis into an orthonormal one by repeated cleanup. Take each vector in turn, subtract off the parts pointing along the vectors you already cleaned, and scale what remains to length one. Each subtraction is a projection, so the formula reads as geometry rather than symbol pushing. Start with a two vector example on paper before trying anything bigger.
Clean (1, 0) and (1, 1). The first vector is already unit length, so keep it. Project (1, 1) onto (1, 0): the dot is 1, so the projection is (1, 0). Subtract to get the remainder (0, 1), which snaps perpendicular to the first vector. As a second drill, normalise (6, 8): its length is 10, so dividing gives (0.6, 0.8). Copy one such example fully by hand, computing each projection yourself.
Watch what never changes during the cleanup: the span of the vectors handled so far always matches the span of the originals. That invariant is the point of the whole process: you gain orthogonality step by step while keeping the same space. Note that the order of the input vectors matters for the intermediate steps, though the final span stays put.
Read the QR factorisation straight off your finished work. The multipliers you used in the subtractions are exactly the entries of R, and the cleaned vectors form Q. So every hand computation is secretly one matrix equation: A equals Q times R, the form numerical solvers rely on.
Subtract projections, scale to unit length, keep the span, and read off Q and R.
2 · Watch
Take it off screen
Where it sits
8 questions wait behind this lesson, each with its answer explained. Every answer feeds the sky: stars light as they are learned, and dim when it is time to come back.