Engineering/Mathematics/Linear Transformations
Injective Transformations, Independence and Dimension
An injective linear transformation carries linearly independent sets to linearly independent sets, and testing the images of a single basis is enough to decide injectivity outright. The immediate consequence is a dimension inequality that rules out injectivity without any calculation at all.
- Advanced level
- Stream: transformations
- Reading time 15 min
- Ref KVS-ENG-MATH-0097
- Taxonomy
- Engineering / Mathematics
- Level
- Advanced
- Prerequisite
- Injectivity, kernels, bases and dimension
- Preserves
- Linear independence — not spanning
- Basis test
- injective the images of one basis of are independent
- Hard limit
- injective
Overview
Injectivity is defined by a condition on pairs of vectors, but its real force is structural. An injective linear transformation does not merely avoid collisions between individual inputs; it preserves the entire independence structure of the domain. Whenever a set of vectors in admits only the trivial relation of linear dependence, the same is true of the set of their images in . Nothing is flattened, nothing is folded, and the geometry of independence is transported intact.
That observation converts an infinite verification into a finite one. To decide whether is injective, take any one basis of the domain, apply to each of its vectors, and test the resulting set for linear independence. If the images are independent, is injective; if they are dependent, is not. Because a basis is finite for any finite-dimensional space, this reduces the question to a single rank computation on a matrix built from the images. It also explains why injectivity is so cheap to test in practice even for transformations whose domain is a space of polynomials or matrices, where no coefficient matrix is handed to you.
The dimension consequence follows immediately and is the most-used result of the group. If is injective and is a basis of with vectors, then the images of form an independent set of the same size inside . A vector space cannot contain more independent vectors than its dimension, so . Contrapositively, a transformation from a larger space into a smaller one is never injective, whatever formula defines it. This is a one-line test that disposes of entire classes of models before any arithmetic is done.
Together these results establish the correct mental picture: an injective transformation embeds a faithful copy of the domain inside the codomain. The image of a basis of is a basis of the range of , so the range is a subspace of with exactly dimensions. Everything about — independence, spanning within the range, dimension — is reproduced there. What injectivity does not deliver is coverage: the embedded copy may be a proper subspace, and filling out the codomain is the separate business of surjectivity.
Definition
Relation of Linear Dependence
RLDFor a set in a vector space, a relation of linear dependence is an equation with specified scalars . The relation is trivial when every . The set is linearly independent when the trivial relation is the only one.
Restated here because every proof on this page begins by writing down an arbitrary relation of linear dependence on the image set and pulling it back through the transformation.
Basis
BA set of vectors in a vector space that is both linearly independent and spans . Every finite-dimensional vector space has a basis, all its bases have the same number of vectors, and that number is .
The basis test for injectivity holds for any basis of the domain. There is no need to choose a distinguished one, which is what makes the test practical for abstract spaces.
Embedding
An injective linear transformation, viewed as identifying the domain with a subspace of the codomain. The image of the domain under an embedding is a subspace of whose dimension equals , and on which is a one-to-one correspondence.
Concepts
Injections preserve linear independence
Let be injective and let be a linearly independent subset of . Claim: is linearly independent in . Begin with an arbitrary relation . By linearity the left-hand side equals , so the combination lies in the kernel of . Injectivity makes the kernel trivial, so that combination equals — which is a relation of linear dependence on the independent set , forcing every . The only relation on is the trivial one, so is independent. Note where each hypothesis is used: linearity to move the scalars inside, injectivity to make the kernel trivial, independence of to finish.
The basis test is an equivalence
Let be a basis of and let . Then is injective if and only if is linearly independent. Forward: a basis is independent, so the preservation result applies directly. Backward: assume is independent and take . Write , which is possible because spans . Then is a relation of linear dependence on the independent set , so every and therefore . The kernel is trivial and is injective. The backward direction is where the spanning half of the basis property is used; independence alone would not suffice.
The dimension inequality and its contrapositive
Suppose is injective and, for contradiction, that . Take a basis of ; it has vectors, and their images form a linearly independent set of distinct vectors inside . But a vector space of dimension cannot contain a linearly independent set of more than vectors. With this is impossible, so the assumption fails and . Used in contrapositive form this is the cheapest test in the subject: if the domain has strictly larger dimension than the codomain, no injective linear transformation between them exists. A map from to , for example, has and is non-injective regardless of its entries.
Necessary, not sufficient
The inequality is a necessary condition for injectivity, never a sufficient one. The zero transformation from to satisfies the inequality comfortably and is as far from injective as a map can be. Passing the dimension test only means the question has not yet been settled and the independence computation must still be done. Confusing the two directions is the single most common error in applying these results.
The image of a basis is a basis of the range
If is injective and is a basis of , then is independent by the preservation result and spans the range of , because every output is of some linear combination of and therefore the matching combination of . So is a basis of the range, and . The rank of an injective transformation equals the dimension of its domain, and its nullity is zero. This is the precise sense in which an injection places an undistorted copy of inside : the copy is the range, and it has exactly the right dimension.
Injectivity survives composition
If and are both injective, so is . Assume , that is . Injectivity of gives , and injectivity of then gives . Chaining the dimension inequality along the composition yields . The converse is only partial: if is injective then must be injective, but need not be — is only constrained on the range of .
Testing injectivity through a basis
Equations
Preservation of linear independence
EQ-ILTLI-01The image of an independent set under an injection is independent, with the same number of distinct vectors.
Pull-back of a relation of linear dependence
EQ-ILTLI-02The identity that makes the proof work: a relation among the images is the image of a combination of the originals, which must therefore lie in the kernel.
Basis characterisation of injectivity
EQ-ILTB-01Here is any basis of the domain . A finite test for an infinitely quantified property; it holds for every basis, so any convenient one may be chosen.
Dimension inequality for injections
EQ-ILTD-01An injection cannot compress. Used in contrapositive form it rules out injectivity from the shapes alone.
Rank and nullity of an injection
EQ-ILTD-02An injective transformation has zero nullity, so its rank consumes the entire dimension of the domain.
Composition of injections
EQ-CILTI-01Injectivity is preserved by chaining, so a pipeline of identifiable stages is identifiable end to end.
Dimension chain along a composition
EQ-ILTD-03Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Linear transformation | The map under test | function from U to V | |
| Second transformation | A map composed after | function from V to W | |
| Basis of the domain | An independent spanning set of , with vectors | finite subset of U | |
| Image of the basis | The set , tested for linear independence in | finite subset of V | |
| Relation coefficients | Scalars in a relation of linear dependence on the image set | complex scalars | |
| Domain dimension | ; also the number of vectors in and in | non-negative integer | |
| Codomain dimension | ; the maximum size of any independent set in | non-negative integer | |
| Kernel | Trivial exactly when is injective; the object the pull-back argument passes through | subspace of U | |
| Range | The embedded copy of inside , with as a basis when is injective | subspace of V |
Worked Numerical Example
Problem statement
A quadratic strain profile across a beam section, , is encoded for transmission as a block of derived quantities by the linear rule . Decide whether the encoding is injective using the basis test, and confirm that the dimension inequality is not violated.
State the encoding
The encoder forms two sums and two differences of the profile coefficients:
Check the dimension precondition
The domain of quadratic polynomials has dimension ; the codomain has dimension . Since , the dimension inequality does not rule out injectivity. This settles nothing on its own — it only means the computation is worth doing.
Apply to a basis of the domain
Take the monomial basis , corresponding to , and in turn:
Coordinatise the images
Read each matrix in the order (top-left, top-right, bottom-left, bottom-right) to obtain coordinate vectors in , and stack them as rows:
Row-reduce and count
Apply , scale by , then clear column 2 from rows 1 and 3:
Draw the conclusion
Three non-zero rows for three image vectors, so the rank is and the images of the basis are linearly independent. By the basis characterisation, is injective: distinct strain profiles always produce distinct encoded blocks. The range has dimension inside the four-dimensional , so the encoding is not surjective.
Use preservation on a different independent set
Independence is preserved for every independent set, not just for the chosen basis. Take , which is independent in . Its images must be independent in , and indeed neither is a scalar multiple of the other:
Contrast with a shape that cannot work
Suppose instead the encoder were required to compress a sensor block into four numbers, . Here , so the dimension inequality is violated and no such encoder is injective, whatever coefficients are chosen. Some pair of distinct sensor blocks must always collide.
The three-into-four encoding is lossless: the encoded block determines the strain profile uniquely, and a decoder exists on the range. The range is a three-dimensional subspace of , so one linear constraint is satisfied by every legitimate encoded block — a free integrity check for the receiver. The six-into-four variant is provably lossy before a single coefficient is chosen, which is the kind of conclusion the dimension inequality delivers at zero cost.
Applications & Industry Use
Generator matrices for block codes
A linear block encoder maps message symbols to channel symbols. Injectivity is unique decodability, and the basis test is exactly the requirement that the columns of the generator matrix be independent. The dimension inequality is the reason no useful code compresses: is forced.
Sensor suite sizing
Before selecting instruments, the count of independent measurements is compared with the number of state variables to be resolved. If the state space has more dimensions than the measurement vector, no linear estimator can identify the state and the suite must be expanded. This screening uses only dimensions, no sensor models.
Preserving the independence of a frame
A modelling transform applied to a set of independent basis vectors must return an independent set, or the local frame collapses and normals, tangents and bitangents become degenerate. Testing the images of the three axis vectors is the standard cheap check for a degenerate transform.
Identifiability screening of reaction networks
Parameter vectors are mapped linearly to observable time-course features in a local analysis. Comparing the number of parameters against the number of independent observables gives an immediate upper bound on identifiability, before any expensive profile-likelihood computation is attempted.
Fixture and probe layout
A coordinate measuring routine samples a part at a fixed set of points and infers a small number of form parameters. The map from parameters to probe readings must be injective for the fit to be meaningful, and the basis test applied to the parameter basis is the design-time criterion for probe layout.
Linear layers in block ciphers
The diffusion layer of a block cipher is a linear transformation over a finite field that must be invertible, hence in particular injective. The design check is that images of the standard basis remain independent over that field, which is a rank computation in modular arithmetic.
Design Considerations
Run the dimension test first, every time
It costs nothing, requires no coefficients, and eliminates a large fraction of candidate designs. Only when does the independence computation become worth performing. Reversing the order wastes effort on models that were doomed by their shapes.
Never read the inequality backwards
does not imply injectivity. The zero transformation satisfies it for every pair of spaces and is maximally non-injective. Treat the inequality strictly as a necessary condition and state it as such in any written analysis.
Any basis will do — choose the cheap one
The basis characterisation holds for every basis of the domain, so pick the one that makes evaluating trivial: standard unit vectors for , monomials for polynomial spaces, single-entry matrices for matrix spaces. Choosing an awkward basis multiplies the arithmetic without changing the verdict.
Independence is preserved; spanning is not
An injection carries independent sets to independent sets, but it does not carry spanning sets of to spanning sets of — only to spanning sets of the range. Assuming otherwise silently conflates injectivity with surjectivity and produces claims about coverage that the hypothesis does not support.
The rank is the by-product worth keeping
The same reduction that answers the injectivity question returns and, when the test fails, an explicit dependence relation among the images. That relation pulls back to a non-zero kernel vector, which is the constructive form of the failure. Discarding it and reporting only pass or fail throws away the diagnosis.
Chain injectivity deliberately across a pipeline
Because compositions of injections are injective, a processing chain is identifiable end to end if each stage is. The corollary is that a single non-injective stage destroys identifiability for the whole chain irrecoverably, so the weakest stage should be identified and fixed rather than compensated downstream.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Fixes the notation for mappings, composition and dimension used throughout, including the arrow form and the composition symbol in . |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | The independence test on the image set is a rank determination, delivered in production by column-pivoted QR (xGEQP3) or the singular value decomposition (xGESVD). |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Determines the arithmetic in which the image coordinates are computed and reduced, and therefore why near-dependence rather than exact dependence is the practical failure mode. |
ISO/IEC 18033-3 | Information technology — Security techniques — Encryption algorithms — Block ciphers | Block cipher diffusion layers are specified as invertible linear maps over finite fields; the independence-of-basis-images criterion on this page is the design-time check for that requirement. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the set notation, matrices and quantified statements on this page as structured markup rather than images, keeping them searchable and accessible. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Symbolic transformations, textbook-scale designs, and any claim of injectivity that must hold exactly rather than numerically. | Delivers an unambiguous independence verdict, but the intermediate fractions grow quickly and the approach does not scale to large image sets. |
| IEEE 754 binary64 with an SVD rank test | Image vectors computed from measured or floating-point coefficients, which is the normal engineering case. | Robust, and the singular values grade how close the images are to dependence; costs several times a plain elimination. |
| IEEE 754 binary64 with pivoted QR | Large basis sets where a full decomposition is uneconomical but the dependent members must still be identified. | Cheaper and names the dependent images, but the rank estimate degrades when the singular values decay gradually. |
| Finite field arithmetic modulo a prime | Coding theory and cipher design, where independence of the images is required over the field the code actually uses. | Exact, fast and with bounded operand size; independence over a finite field can differ from independence over the rationals for the same integer data. |
| Integer arithmetic with a determinant or Smith normal form | Square cases with integer entries, where an exact non-zero determinant certifies independence outright. | A single decisive number, but only applicable when the number of images equals the codomain dimension, and determinants overflow quickly. |
| Dimension counting alone | Early screening, before any coefficients are available. | Free and conclusive when it fails, but silent when it passes; it can never establish injectivity. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of the basis test
Evaluating on basis vectors costs applications of the defining formula. Reducing the resulting coordinate array costs about operations. Since is required for injectivity anyway, this is dominated by and is negligible for the modest dimensions typical of design-time checks.
Doing it by hand
Write the coordinate vectors as the rows of a matrix rather than the columns. Row reduction then answers the independence question by counting non-zero rows, and any row that reduces to zero exhibits a dependence relation directly in terms of the operations applied. Placing them as columns answers the same question but makes the relation harder to read off.
Choosing between exact and numerical verdicts
In exact arithmetic the images are independent or they are not. In floating point the meaningful quantity is the smallest singular value of the coordinate array relative to the largest. Report that ratio alongside the verdict: a transformation whose images are independent by a margin of is, for engineering purposes, not injective.
Library route for abstract domains
Symbolic systems accept the images directly and expose Matrix.rank() and Matrix.rref() over the rationals, which is the natural route when the domain is a polynomial or matrix space. For numerical work, build the coordinate array explicitly and call numpy.linalg.matrix_rank; there is no need to construct an abstract representation of first.
Extracting the kernel vector from a failed test
If the images are dependent, the reduction produces scalars , not all zero, with . By linearity the vector is a non-zero element of the kernel, expressed in the domain's own terms. This pull-back turns an abstract failure into a concrete counterexample and costs no extra computation.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Reading the dimension inequality as sufficient | high | Concluding that makes injective. | State the inequality only as a necessary condition, and always follow a passing dimension check with the independence computation. |
| Testing a spanning set instead of a basis | medium | Applying the characterisation to a spanning set that is not independent, whose images are then dependent for trivial reasons. | The test requires a basis. Reduce a spanning set to a basis first, or the dependent verdict carries no information about . |
| Concluding the images span the codomain | high | Assuming that an injection carries a basis of to a basis of . | The images form a basis of the range, a subspace of of dimension . Spanning is surjectivity and needs a separate argument. |
| Coordinatising images in inconsistent orders | medium | Reading matrix entries row-wise for one image and column-wise for another when building coordinate vectors. | Fix one ordering of the codomain basis at the start and apply it identically to every image. |
| Exact-zero rank test on floating-point images | high | Declaring independence because no computed pivot is exactly zero. | Use a tolerance scaled by the norm of the coordinate array, and report the margin with the verdict. |
| Assuming injectivity of from injectivity of | medium | Reversing the composition result, which only constrains on the range of . | From an injective composition conclude only that is injective; test separately on its whole domain. |
| Ignoring the pull-back of a dependence relation | low | Reporting only that the test failed, without converting the relation into an explicit kernel vector. | Record the coefficients from the reduction and form ; the diagnosis is free once the reduction is done. |
| Applying the results to a non-linear map | low | Using the pull-back identity for a function that does not preserve addition and scalar multiplication. | Verify linearity first; every proof on this page moves scalars through and fails immediately without it. |
FAQs
Why is testing the images of one basis enough to decide injectivity?
Because a basis both spans the domain and is independent. Spanning lets every kernel candidate be written as a combination of basis vectors, and independence of the images then forces all its coefficients to vanish, so the kernel is trivial. Both halves of the basis property are used, which is why an arbitrary independent set will not do.
Does an injective transformation carry a basis of the domain to a basis of the codomain?
Only to a basis of its range. The images are independent and span the range, so they form a basis of that subspace, but the range may be a proper subspace of the codomain. Reaching all of is surjectivity, a separate property.
If the dimension inequality holds, is my transformation injective?
Not necessarily. The inequality is only necessary. The zero transformation from into satisfies it and sends everything to the zero vector. After a passing dimension check the independence of the basis images must still be computed.
What happens to injectivity when I compose transformations?
It is preserved: the composition of two injections is injective. In the other direction, an injective composition forces to be injective, but says nothing about outside the range of . Practically, one non-injective stage in a chain destroys identifiability for the whole chain.
How do these results relate to rank and nullity?
An injective transformation has nullity zero, so its rank equals the dimension of its domain. Since the rank can never exceed the dimension of the codomain, the inequality falls straight out of the rank-nullity accounting.
Can an injective transformation exist between spaces of equal dimension?
Yes, and in that case it is automatically surjective as well, hence invertible. When the range is a subspace of with the full dimension of , which forces it to be all of . Equal dimensions are what make the two properties collapse into one.
What do I do with the dependence relation when the test fails?
Pull it back. If with the not all zero, then is a non-zero kernel vector written in the domain's own language. It generates witness pairs and names the input combination the transformation cannot see.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section ILT, subsections ILTLI, ILTD and CILT. Licensed under the GNU Free Documentation License v1.2.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Halmos, P. R. Finite-Dimensional Vector Spaces, 2nd edition. Springer, 1974.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
- MacWilliams, F. J. and Sloane, N. J. A. The Theory of Error-Correcting Codes. North-Holland, 1977.
AI Suggested Questions
- Construct a linear transformation from P3 into M22 that satisfies the dimension inequality but is still not injective, and show the dependent basis images.
- Prove that if S∘T is injective then T is injective, and give a concrete S that is not injective in such a composition.
- For an injective transformation, why is the image of a basis a basis of the range but not of the codomain?
- Show how a dependence relation among basis images pulls back to an explicit kernel vector, with a worked 4x3 example.
- How does the independence-of-basis-images criterion translate into the design rule for a generator matrix of a linear block code?
- If the coordinate array of my basis images has singular values 5, 2 and 1e-13, is the transformation injective in any useful sense?
Related Calculators
Enter a set of vectors or coordinatised images and get an independence verdict, the rank, and any dependence relation found.
Injectivity TesterApply a transformation to a chosen basis, test the images, and report injectivity together with the rank of the range.
Dimension Compatibility CheckerCompare domain and codomain dimensions to screen for impossible injections and surjections before any computation.
