Engineering/Mathematics/Linear Transformations
Surjective Transformations, Spanning Sets and Dimension
Applying a linear transformation to a spanning set of the domain always produces a spanning set of the range, so a single basis is enough to construct the range and to decide surjectivity. The resulting dimension inequality rules out surjectivity from the shapes alone.
- Advanced level
- Stream: transformations
- Reading time 15 min
- Ref KVS-ENG-MATH-0100
- Taxonomy
- Engineering / Mathematics
- Level
- Advanced
- Prerequisite
- Surjectivity, range, spanning sets and dimension
- Preserves
- Spanning — not linear independence
- Basis test
- surjective the images of one basis of span
- Hard limit
- surjective
Overview
Surjectivity is defined by an existence statement over the whole codomain, which is not something that can be checked one target at a time. The structural results on this page replace that statement with a finite construction. Applying a linear transformation to a spanning set of the domain produces a spanning set of the range, so the entire range — an infinite set — is generated by as many vectors as there are members in a spanning set of . Choose a basis of and the generation is as economical as possible.
This is the exact counterpart of the way injectivity interacts with linear independence, with the two notions exchanged. An injection preserves independence; a surjection is characterised through spanning. The parallel is not decorative: it explains why the two properties are tested by mirror-image computations and why their dimension consequences point in opposite directions. An injection cannot compress, so . A surjection cannot manufacture dimensions it was not given, so .
The practical procedure follows immediately. Take any basis of the domain, apply the transformation to each of its vectors, and ask whether the resulting set spans the codomain. If it does, the transformation is surjective; if it spans only a proper subspace, that subspace is the range and the transformation is not surjective. Because the image set is usually linearly dependent, it must generally be culled before a basis of the range is obtained, and the culling is a routine row reduction.
Two cautions govern the use of these results. The dimension inequality is necessary but never sufficient: a transformation from a large space into a small one can still miss most of the codomain, and only the spanning computation settles the question. And the image of a basis of is a spanning set of the range, not automatically a basis of it — independence is precisely what a non-injective transformation destroys.
Definition
Spanning Set
SSVSA set of vectors in a vector space spans when every vector of can be written as a linear combination of finitely many members of ; equivalently . A spanning set need not be linearly independent, and a spanning set that is independent is a basis.
Restated because every theorem on this page is a statement about spanning sets being carried from the domain into the codomain.
Surjective Linear Transformation
SLTA linear transformation is surjective when for every there exists with . Equivalently, the range of equals the whole codomain, .
Surjectivity depends on the declared codomain. Every transformation is surjective onto its own range, so the target space must be named for the claim to have content.
Range of a Linear Transformation
RLTThe set of all outputs of , always a subspace of the codomain. Its dimension is the rank of .
The results on this page are, in the first instance, statements about how to generate this subspace from finitely many vectors.
Concepts
Images of a spanning set span the range
Let span and set . Claim: spans . Take any . By definition of the range there is a with , and because spans there are scalars with . Applying and using linearity, , which exhibits as a linear combination of . Every element of the range is therefore reachable from , so spans it. Note that automatically lies inside the range, so no reverse inclusion argument is needed.
Why a basis is the right spanning set to use
The theorem holds for any spanning set of the domain, but the cost of the construction is one evaluation of per member, so the smallest spanning set is the cheapest. That is a basis, with exactly members. Using a basis also bounds the rank immediately: the range is spanned by vectors, so , whatever the transformation does. For abstract domains — polynomials, matrices, function spaces — the natural basis is usually obvious, which is what makes the method practical where no coefficient matrix is given.
Culling the image set to a basis
The images of a basis span the range but are generally dependent, because a non-injective transformation collapses independence. To obtain a basis of the range, coordinatise the images in a fixed basis of the codomain, place them as rows of a matrix, row-reduce, and discard the zero rows. The surviving rows form a basis of the same subspace. Alternatively place the images as columns and retain those in pivot positions, which returns a basis consisting of actual images rather than synthetic combinations. Either way the count of surviving vectors is the rank of .
The basis characterisation of surjectivity
Let be a basis of and the set of its images. Then is surjective if and only if spans . Forward: surjectivity means , and spans the range, so spans . Backward: assume spans and take any . Write , then define . Linearity gives , so the required input exists and is surjective. The backward direction is constructive: it does not merely assert a preimage, it builds one from the spanning coefficients.
The dimension inequality and what it does not say
Suppose is surjective and, for contradiction, . A basis of has vectors, and their images span by the characterisation above. So , a space of dimension , is spanned by or fewer vectors with — impossible, since no spanning set can be smaller than the dimension. Hence . Used in contrapositive form this rules out surjectivity from the shapes alone. It is emphatically not sufficient: the transformation on the worked example below maps a four-dimensional domain onto a two-dimensional range inside a three-dimensional codomain, satisfying the inequality comfortably while failing to be surjective.
Range membership, preimages and composition
A vector lies in the range exactly when its preimage is non-empty, which is the bridge between the spanning description of the range and the consistency description of a linear system. Surjectivity is also preserved under composition: if and are surjective, then given , surjectivity of supplies with and surjectivity of supplies with , so . Chaining the dimension inequality along the composition gives , so a pipeline can only lose reach, never gain it.
Testing surjectivity through a spanning set
Equations
Images of a spanning set span the range
EQ-SSRLT-01The construction that generates an infinite subspace from finitely many evaluations of .
Push-through of a linear combination
EQ-SSRLT-02The identity behind the spanning result: a combination of inputs maps to the same combination of the images, with the coefficients unchanged.
Basis characterisation of surjectivity
EQ-SLTB-01Here is any basis of the domain . A finite test for an existence statement quantified over the whole codomain.
Dimension inequality for surjections
EQ-SLTD-01A surjection cannot manufacture dimension. Used in contrapositive form it disposes of a candidate from the shapes alone.
Rank bounds
EQ-SLTD-02The range is spanned by images and sits inside , so both dimensions bound the rank. Surjectivity is the case where the second bound is attained.
Range membership and preimages
EQ-RPI-01Links the spanning description of the range to the consistency description of the corresponding linear system.
Composition of surjections
EQ-CSLTS-01Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Linear transformation | The map under test | function from U to V | |
| Second transformation | A map composed after | function from V to W | |
| Basis of the domain | An independent spanning set of , with members | finite subset of U | |
| Image set | The set ; it spans the range and, when is surjective, spans | finite subset of V | |
| Range | The subspace of generated by | subspace of V | |
| Spanning coefficients | Scalars expressing a target as a combination of the images; used to build a preimage | complex scalars | |
| Domain dimension | ; the number of evaluations of needed to generate the range | non-negative integer | |
| Codomain dimension | ; the minimum size of any spanning set of | non-negative integer | |
| Span of a set | The set of all linear combinations of members of | subspace |
Worked Numerical Example
Problem statement
A controller parameterisation converts a block of tuning gains into a quadratic closed-loop numerator polynomial by the linear rule below. Determine whether every quadratic numerator can be produced, construct the range from the images of a basis, and identify the structural limitation if surjectivity fails.
State the parameterisation
The four gains combine into the three coefficients of a quadratic:
Check the dimension precondition
The domain has dimension and the codomain has dimension . Since , the dimension inequality does not rule out surjectivity. This settles nothing on its own; four gains might still act along only two independent directions.
Apply to a basis of the domain
Take the single-entry basis , which sets one gain to and the rest to in turn. The four images span the range:
Coordinatise and row-reduce
Read each image against the basis of , stack the four coordinate vectors as rows, and reduce:
Read the rank and the verdict
Only two non-zero rows survive, so while . The images do not span the codomain, so by the basis characterisation is not surjective — despite four gains acting on three coefficients. The dimension inequality was satisfied and told us nothing.
Cull the image set to a basis
Two of the four images are redundant, and the reduction names which: and . Discarding them costs nothing. Either of two bases may then be quoted — the original images , or the cleaner pair read from the reduced rows, which spans the same subspace:
Identify the structural constraint
Write a general element as , giving , , . Eliminating and leaves one linear law, which is exactly the statement that the polynomial vanishes at . Every attainable numerator carries a fixed zero at , so a target such as , for which the expression evaluates to , cannot be produced by any gain setting.
Repair the parameterisation
Let the third gain also influence the linear coefficient, changing the rule to . The image of becomes , and the coordinate array now reduces to rank . The images span , so the revised parameterisation is surjective and every quadratic numerator is reachable.
The original parameterisation offers four tuning gains but only two independent directions of influence, and it silently imposes a fixed closed-loop zero at on every achievable design. No tuning effort can remove that zero, so an apparently rich four-parameter design space is in fact a two-parameter family — a limitation that surfaces immediately from the spanning test and would otherwise appear as an unexplained floor on achievable performance. Adding one coupling term restores full spanning and with it the ability to place all three numerator coefficients independently.
Applications & Industry Use
Achievable closed-loop dynamics from a tuning set
Applying the parameterisation to a basis of the tuning space generates every achievable closed-loop polynomial. If the images fail to span the target polynomial space, some pole or zero locations are structurally unreachable, and no amount of tuning will place them.
Workspace coverage from actuator directions
The images of the unit actuator commands span the reachable velocity space of a mechanism. Comparing the rank of that image set with the dimension of the task space determines whether the mechanism has full task-space authority in the configuration examined.
Reachable wavefront corrections
A deformable mirror maps actuator strokes to a wavefront expressed in a modal basis. Applying the influence map to a basis of actuator commands produces a spanning set of correctable wavefronts; modes outside its span are uncorrectable, which sets a hard floor on residual aberration.
Coverage of the syndrome space
A parity-check map must be surjective onto the syndrome space for every syndrome pattern to correspond to a real error class. Applying the map to a basis of received-word space and checking that the images span the syndrome space is the design-time verification of that requirement.
Independently controllable specifications
Applying the linearised blend model to a basis of feed adjustments generates the reachable specification changes. The rank of that set is the number of specifications that can be moved independently; anything less means certain specifications are locked together by the feed chemistry.
Expressive range of a blend-shape rig
A character rig maps blend-shape weights linearly to vertex displacements. The images of the individual weights span the achievable deformation space, and its dimension bounds how many independent expressions the rig can represent regardless of how many sliders it exposes.
Design Considerations
Screen by dimension, then compute
The inequality costs nothing and eliminates impossible designs immediately. But a passing dimension check proves nothing at all, as the worked example demonstrates. Treat it strictly as a screen and always follow it with the spanning computation.
More parameters is not more authority
A design exposing many tuning parameters may still act along very few independent directions. The number that matters is the rank of the image set, not the parameter count. Reporting the rank alongside the parameter count prevents a false impression of design freedom.
Spanning is preserved, independence is not
The images of a basis always span the range, but they are a basis of the range only when is injective. Assuming otherwise leads to inflated rank claims and to bases that contain redundant members. Cull the image set explicitly rather than assuming it is already independent.
Report the missing directions, not just the failure
When the images do not span the codomain, eliminating the coordinates yields the linear laws every achievable output satisfies. Those laws are the actionable output: they name the structural limitation, and a single vector violating them is a concrete demonstration for a design review.
The backward proof is a construction
The characterisation does not merely assert that a preimage exists when the images span ; the spanning coefficients of a target are directly the coordinates of a preimage in the chosen basis. Implementations should exploit this, obtaining the required input from the same solve that establishes spanning rather than from a second computation.
Rank near the boundary is fragile
A design whose image set spans the codomain only marginally — with a tiny smallest singular value — is surjective in exact arithmetic and useless in practice, because reaching some outputs demands unbounded parameter values. Report the smallest singular value against the parameter limits, not the rank alone.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Fixes the notation for spans, mappings, composition and dimension used throughout, including the arrow form and the composition symbol in . |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Deciding whether an image set spans the codomain is a rank determination, delivered in production by the singular value decomposition (xGESVD) or a rank-revealing QR (xGEQP3). |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Governs the arithmetic in which the image coordinates and their rank are computed, and why a marginal spanning verdict must be reported with the singular value that supports it. |
ISO 24998 | Optics and photonics — Adaptive optics terminology | Adaptive optics systems are specified by the modal space their actuators can reach; the spanning test on this page is the algebraic form of the correctable-mode requirement. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the span expressions, quantified statements and coordinate arrays on this page as semantic markup rather than images, keeping them searchable and accessible. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Design-stage parameterisations with exact coefficients, where the structural constraint on the range is the deliverable. | Gives exact constraint equations and an unambiguous spanning verdict, but coefficient growth limits the practical scale. |
| IEEE 754 binary64 with SVD rank test | Image sets computed from identified or measured models, the normal engineering case. | Robust, and the singular values grade how nearly spanning fails; costs several times a plain elimination. |
| IEEE 754 binary64 with pivoted QR | Large basis sets where a full decomposition is uneconomical but the redundant images must be named. | Cheaper and identifies which images are redundant, but the rank boundary is less sharply resolved. |
| Original-image basis from column reduction | Applications where each image corresponds to a physical parameter and the basis must consist of real parameter effects. | Maximum interpretability of which parameters matter, but the basis may be poorly conditioned for numerical projection. |
| Constraint (implicit) representation of the range | Runtime feasibility testing of targets against a fixed parameterisation. | Reduces a feasibility check to evaluating a few linear forms, but constructing a parameter setting from constraints requires a separate solve. |
| Finite field arithmetic | Parity-check and syndrome coverage questions, where the codomain is a space over a finite field. | Exact with bounded operand size; a set may span over the rationals yet fail to span over the field in use. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of the spanning test
Evaluating on basis vectors costs applications of the defining rule. Reducing the resulting coordinate array costs about operations. Since surjectivity requires , the dominant term is , negligible at the dimensions typical of design-time checks.
Hand procedure
Place the coordinatised images as the rows of a matrix and row-reduce. The number of non-zero rows is the rank, and comparison against gives the verdict directly. Rows that reduce to zero exhibit the redundant images, and the operations that produced them are the explicit dependence relations.
Building a preimage from the spanning coefficients
When the images span , solving for the coefficients that express a target as a combination of the images yields a preimage immediately: in terms of the original basis. When the coefficient system is underdetermined and a minimum-norm solution is usually the sensible choice.
Library routes
numpy.linalg.matrix_rank compared against answers the spanning question numerically; scipy.linalg.orth returns an orthonormal basis of the span. Symbolic systems accept the images directly and expose Matrix.rank() and Matrix.rref() over the rationals, which suits abstract domains where no coefficient matrix exists in advance.Verification discipline
Two checks catch most errors. Confirm that every original image satisfies every derived constraint on the range, and confirm that the rank plus the number of independent constraints equals . When the verdict is surjective, spot-check by choosing a random target, computing the spanning coefficients, building the preimage, and evaluating on it.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Reading the dimension inequality as sufficient | high | Concluding surjectivity from without computing the span of the images. | State the inequality as necessary only, and always follow a passing check with the spanning computation. |
| Treating the image of a basis as a basis of the range | high | Assuming the images inherit independence as well as spanning. | Only injective transformations preserve independence. Cull the image set by row reduction before quoting a basis or a rank. |
| Counting parameters instead of rank | medium | Reporting design freedom from the number of tuning parameters rather than the dimension of their image. | Compute the rank of the image set. Redundant parameters inflate the count without adding reachable directions. |
| Applying the test to a non-spanning set | medium | Using an independent but non-spanning subset of the domain in place of a basis. | The spanning half of the basis property is essential. A non-spanning set generates only part of the range and understates the rank. |
| Inconsistent coordinatisation of the images | medium | Reading one image against one basis ordering of the codomain and another against a different ordering. | Fix a single ordered basis of the codomain at the outset and apply it identically to every image. |
| Exact-zero rank test on floating-point images | high | Declaring that the images span the codomain because no computed pivot is exactly zero. | Use a tolerance scaled by the norm of the coordinate array, and report the smallest singular value with the verdict. |
| Assuming surjectivity of from surjectivity of | medium | Reversing the composition result, which constrains only the combined reach. | From a surjective composition conclude that is surjective; nothing follows about , which may miss part of . |
| Discarding the constraint equations | low | Reporting only that the images fail to span, without eliminating coordinates to name the missing directions. | Derive the constraints from the reduced array; they cost nothing extra and are the actionable diagnosis. |
FAQs
Why do the images of a spanning set automatically span the range?
Because linearity carries a linear combination of inputs to the same linear combination of their images. Every element of the range is of some input, that input is a combination of the spanning set, and pushing the combination through writes the output as a combination of the images with identical coefficients.
Do the images of a basis form a basis of the range?
They span the range but need not be independent. Independence survives only when is injective, so for a general transformation the image set must be culled by row reduction before it can be quoted as a basis. Its size after culling is the rank.
If the domain has larger dimension than the codomain, is the transformation surjective?
Not necessarily. The inequality is necessary for surjectivity but never sufficient. A transformation from a four-dimensional space into a three-dimensional one can easily have a two-dimensional range, as the worked example on this page shows.
How is this different from the injective case?
The two are mirror images. Injectivity preserves linear independence and forces ; surjectivity is characterised by spanning and forces . Together, in the case of equal dimensions, either property alone implies the other and hence invertibility.
What does it mean when the images span only a proper subspace?
The transformation has a structural limitation: eliminating coordinates from the span produces linear equations that every achievable output satisfies. Those equations describe exactly what cannot be reached, and any vector violating them is a concrete unattainable target.
How do I actually build a preimage once I know the images span the codomain?
Express the target as a linear combination of the images; the coefficients obtained are the coordinates of a preimage in the basis you started with. When the domain dimension exceeds the codomain dimension the coefficient system is underdetermined, so choose the minimum-norm solution or fix the free parameters against a secondary objective.
Does surjectivity survive composition of transformations?
Yes. If both stages are surjective the composition is, and the argument works backwards through the chain: a target in the final space is hit by an intermediate vector, which is in turn hit by an input. The dimensions must be non-increasing along the chain, so a pipeline can only lose reach.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section SLT, subsections SSSLT, SLTD and CSLT. Licensed under the GNU Free Documentation License v1.2.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Halmos, P. R. Finite-Dimensional Vector Spaces, 2nd edition. Springer, 1974.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
- Skogestad, S. and Postlethwaite, I. Multivariable Feedback Control: Analysis and Design, 2nd edition. Wiley, 2005.
AI Suggested Questions
- Build a transformation from a 5-dimensional space to a 3-dimensional one that satisfies the dimension inequality but has a 2-dimensional range, and show the culled image set.
- Show how the spanning coefficients of a target vector translate directly into a preimage, with a worked underdetermined example.
- Why does an injective transformation preserve independence while a surjective one is characterised by spanning? Explain the duality precisely.
- For a deformable mirror influence matrix, how do I determine which wavefront modes are uncorrectable?
- Prove that if S∘T is surjective then S is surjective, and give a concrete T that is not surjective in such a composition.
- If my image coordinate array has singular values 8, 2 and 1e-11, should I report the transformation as surjective?
Related Calculators
Check whether a set of vectors spans a target space, cull it to a basis, and report the rank with a selectable tolerance.
Surjectivity TesterApply a transformation to a chosen basis, test whether the images span the codomain, and report the constraints on the range.
Dimension Compatibility CheckerCompare domain and codomain dimensions to screen for impossible injections and surjections before any computation.
