--- title: "Hilbert Spaces and Orthogonal Projection in Infinite Dimensions" description: "A complete inner-product space keeps the geometry of angles and projections when the dimension is infinite. Closest points to a closed subspace still exist and are unique, and every bounded functional" canonical: https://lightmysky.com/learn/mathematics/hilbert-spaces-and-orthogonal-projection-in-infinite-dimensions-mt_xmKq8SAgvy source: https://lightmysky.com/learn/mathematics/hilbert-spaces-and-orthogonal-projection-in-infinite-dimensions-mt_xmKq8SAgvy.md retrieved: 2026-11-12 --- > **Agent view.** This is the Markdown twin of the page, for tools and assistants. > When to use this site, and the call that answers each job: https://lightmysky.com/agent-instructions.md > API description (OpenAPI 3.1): https://lightmysky.com/openapi.json · Authentication: https://lightmysky.com/auth.md > Pricing: https://lightmysky.com/pricing.md · Catalog: https://lightmysky.com/llms.txt · Full catalog: https://lightmysky.com/llms-full.txt > Every machine-readable file on this domain: https://lightmysky.com/.well-known/ai-catalog.json > Ask for Markdown with `Accept: text/markdown`, a `.md` address, or `?mode=agent`. # Hilbert Spaces and Orthogonal Projection in Infinite Dimensions A complete inner-product space keeps the geometry of angles and projections when the dimension is infinite. Closest points to a closed subspace still exist and are unique, and every bounded functional is an inner product with a single fixed vector. Subject: Mathematics · Area: Calculus & Analysis · Ages 23 to 24 Page: https://lightmysky.com/learn/mathematics/hilbert-spaces-and-orthogonal-projection-in-infinite-dimensions-mt_xmKq8SAgvy ## Ready when they can - Project onto a closed subspace and check that the residual is orthogonal to it - Expand a vector in an orthonormal basis and read off Parseval's identity - State the Riesz representation theorem and say what it identifies with what ## Lesson: Projecting in infinite dimensions An inner product generalizes the dot product: it is linear in x, obeys =conjugate(), and >=0 with equality only for x=0. Its norm is ||x||=sqrt(); =0 means orthogonal. A sequence is Cauchy if, for every epsilon>0, ||x_n-x_m||=0 for every m in M. It is the unique closest point. Onto span{u}, u nonzero, p=(/)u. In real R^2, projecting (4,2) onto the x-axis gives p=(4,0) and residual (0,2). Check membership as well as orthogonality. An orthonormal family has unit vectors with =0 for distinct indices. An orthonormal basis is complete: its finite linear combinations are dense. Using inner products linear in the first argument, c_n= and v=sum c_n e_n in norm. Parseval gives ||v||^2=sum |c_n|^2. To find one missing coefficient's size, subtract the known squared sizes from ||v||^2 and take the square root. Riesz representation applies to a real or complex Hilbert space. Every bounded linear functional f has a unique vector y with f(x)= for all x, and ||f||=||y||. We use inner products linear in the first argument and conjugate-linear in the second. Thus a fixed y gives a linear map of x. For real coordinates, f(x)=a dot x is represented by a. Closed subspaces contain their convergent sequence limits. Let d=inf{||v-m||:m in M} and take m_n in M with ||v-m_n|| tending to d. Expanding inner products gives ||a+b||^2+||a-b||^2=2||a||^2+2||b||^2, the parallelogram identity. Here it yields ||m_n-m_k||^2<=2||v-m_n||^2+2||v-m_k||^2-4d^2, so m_n is Cauchy. Completeness gives its ambient limit; closedness puts it in M. A non-closed subspace may still have a closest point for a particular vector. For an orthonormal series, square summability makes partial sums Cauchy: squared tail norms are sums of |c_n|^2. In a Hilbert space they converge in norm. With c_n=, a complete family recovers every v; an incomplete one need not. c00 consists of sequences with finitely many nonzero entries, using the l2 norm. Standard e_n has entry 1 at n and 0 elsewhere. Then s_N=sum_{n<=N}(1/n)e_n is Cauchy, but its infinite-support limit is outside c00. To check Riesz uniqueness, suppose = for every x. Then =0 for every x. Choosing x=y-z gives ||y-z||^2=0, so y=z. In a complex space, the representing vector of a times f is conjugate(a)y, because the second inner-product argument is conjugate-linear. The representing vector's norm equals the functional norm. **Recap.** Cauchy completeness gives norm limits. Closed subspaces give unique projections. Complete orthonormal bases recover vectors, and Riesz represents bounded functionals. *Original lesson, questions and flashcards on Hilbert spaces, orthogonal projection and Riesz representation, written for this learning dataset.* ## Practice 14 questions on this page, each with its working shown. ## Needs first - [The Hahn-Banach Theorem and the Dual Space](https://lightmysky.com/learn/mathematics/the-hahn-banach-theorem-and-the-dual-space-mt_pJuHFxkvjS) - [Normed Spaces, Completeness and Banach Spaces](https://lightmysky.com/learn/mathematics/normed-spaces-completeness-and-banach-spaces-mt_y_jueKnovX) ## Optional connections - [Fourier Series](https://lightmysky.com/learn/mathematics/fourier-series-mt_DJ3iwfj7NK) - [Orthogonal Projection and Least Squares](https://lightmysky.com/learn/mathematics/orthogonal-projection-and-least-squares-mt_kGvRrYJrat) ## Opens up - [States as Vectors: Dirac Notation and the State Space](https://lightmysky.com/learn/science/states-as-vectors-dirac-notation-and-the-state-space-mt_9g0aNMxQ8M) - [Conditional Expectation Given a Sigma-Algebra](https://lightmysky.com/learn/mathematics/conditional-expectation-given-a-sigma-algebra-mt_i2sxZc-ER8) - [Compact Self-Adjoint Operators and the Spectral Theorem](https://lightmysky.com/learn/mathematics/compact-self-adjoint-operators-and-the-spectral-theorem-mt_P_Jr9LWFQj)