Engineering/Mathematics/Linear Transformations
Injective Linear Transformations
A linear transformation is injective when distinct inputs are guaranteed to produce distinct outputs. Linearity collapses that infinite pairwise requirement into a single homogeneous system, so injectivity is decided by one row reduction.
- Core level
- Stream: transformations
- Reading time 14 min
- Ref KVS-ENG-MATH-0095
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Linear transformations, homogeneous systems
- Also called
- One-to-one map, injection
- Test
- Only maps to
- Matrix case
- injective has full column rank
- Disproof cost
- One pair of inputs with equal outputs
Overview
Every function raises the question of whether it loses information. If two different inputs are sent to the same output, the output cannot be traced back to a unique cause, and any attempt to reverse the map is ambiguous. A function that never does this is called injective, or equivalently one-to-one. For a linear transformation the condition reads: whenever , it must follow that .
Stated that way, injectivity looks like an impossible thing to verify. It quantifies over every pair of vectors in an infinite domain. Linearity is what rescues the situation. Because , an equality of outputs is exactly the statement that the difference of the inputs is sent to the zero vector. The whole infinite family of pairwise comparisons therefore collapses to a single question about one vector: which inputs does annihilate? That question is a homogeneous system, and homogeneous systems are settled by one row reduction.
The engineering reading is direct. A linear transformation models a measurement chain, an actuator mixing network, a sensor array or a coordinate change. Injectivity is the property that the model is identifiable: an observed output determines the state that produced it, at most one state can be responsible, and the inverse problem — when it is solvable at all — has a unique answer. A non-injective model has a blind direction, a family of inputs that the instrument cannot tell apart.
Injectivity is one of two structural properties that a linear transformation may possess; the companion property is surjectivity, which asks whether every element of the codomain is actually produced. The two are independent of each other, and a transformation possessing both is invertible. Injectivity is the one allied with linear independence and with dimension counting from below: an injective map cannot compress, so the domain can never be larger than the codomain.
Definition
Injective Linear Transformation
ILTLet be a linear transformation between vector spaces and . Then is injective if, for every pair of vectors , the equality forces . Equivalently, distinct inputs always yield distinct outputs.
The terms one-to-one and injection are synonyms in common use. Injectivity is a property of the function on its whole domain, not of any particular input.
Linear Transformation
LTA function between vector spaces that respects both operations: for all , and for all scalars and all . Every statement on this page depends on these two rules and on their immediate consequence .
Restated here because the argument that reduces injectivity to a homogeneous system uses linearity twice and would fail for an arbitrary function.
Witness Pair for Non-Injectivity
A pair of vectors in the domain with . A single such pair is a complete disproof of injectivity; no further argument is required, and no examination of the rest of the domain is needed.
Concepts
The asymmetry between proving and disproving
Injectivity is a universally quantified statement, so the two directions cost very different amounts of work. To disprove it, exhibit one witness pair: two distinct inputs with identical outputs. That is a finite, checkable object. To prove it, an argument must cover every pair in the domain, which cannot be done by examples. The standard proof therefore starts from the assumed equality with and arbitrary, and derives by algebra alone. This asymmetry is worth internalising: an engineer testing a model for identifiability should look first for a counterexample, because finding one is cheap and finishes the question.
Linearity converts the definition into a homogeneous system
Assume . Subtract, and use linearity in the form . The hypothesis becomes . Write : the conclusion is precisely the statement . So is injective exactly when the only vector it sends to the zero vector is the zero vector itself. When , and , that condition is the requirement that the homogeneous system has only the trivial solution — a single row reduction of settles it.
The matrix criterion: full column rank
For with of size , reduce and count pivot columns. If every one of the columns is a pivot column, there are no free variables, the only solution of is trivial, and is injective. If any column is free, each free variable generates a non-zero that annihilates, and the map is not injective. Two corollaries follow at once. A square gives an injective precisely when is nonsingular. And if the rank cannot reach , so a transformation from a larger space to a smaller one is never injective.
Manufacturing a witness pair on demand
When a transformation fails to be injective, the failure is never isolated — it is systematic. Let satisfy . Then for any in the domain, , so and form a witness pair. A single annihilated direction therefore produces an entire parallel family of collisions, one for every point of the domain. This is why non-injectivity of a physical model is not a rare edge case but a permanent, everywhere-present ambiguity.
Abstract domains behave identically
Nothing in the argument requires the domain to be a space of column vectors. For a transformation from cubic polynomials to matrices, the same subtraction produces , and equating coefficients turns that single equation into a homogeneous linear system in the differences of the coefficients. If the resulting coefficient matrix is nonsingular, only the trivial solution survives and the two polynomials must be identical. The lesson generalises: injectivity of a transformation between any pair of finite-dimensional spaces reduces to a rank computation once bases are fixed.
Why the property is called identifiability in practice
Interpret as an instrument: is a physical state and the recorded data. Injectivity says the data determine the state uniquely, so estimating from is a well-posed question. Failure of injectivity is failure of identifiability, and no amount of noise-free data, extra averaging or better estimation algorithm can recover the lost information — the ambiguity is in the map, not the measurement. The only remedies are structural: add an independent sensing channel, or add prior constraints that exclude all but one member of each ambiguous family.
Deciding whether a linear transformation is injective
Equations
Defining condition for injectivity
EQ-ILT-01Equal outputs can only arise from equal inputs. The quantifier ranges over the entire domain, which is why examples cannot establish the property.
Contrapositive form
EQ-ILT-02Distinct inputs give distinct outputs. Logically identical to the definition and often the more intuitive reading.
Reduction to a single annihilated vector
EQ-ILT-03The consequence of linearity that turns a two-vector condition into a one-vector condition. Everything computational on this page follows from it.
Trivial-annihilator criterion
EQ-ILT-04The practical test. The set of vectors satisfying is the kernel of , so this states that injectivity is equivalent to a trivial kernel.
Matrix transformation criterion
EQ-ILT-05Injectivity of a matrix transformation is full column rank: every column of is a pivot column, so no free variables exist.
Systematic construction of a witness pair
EQ-ILT-06One annihilated direction produces a collision at every point of the domain, not merely at one.
Dimension obstruction
EQ-ILT-07A transformation into a strictly smaller space must collide. The formula defining plays no part in this conclusion.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Linear transformation | The map under test, written | function from U to V | |
| Domain | The vector space of admissible inputs | vector space over C | |
| Codomain | The vector space in which outputs are recorded | vector space over C | |
| First input vector | An arbitrary element of the domain | element of U | |
| Second input vector | A second arbitrary element of the domain, compared with | element of U | |
| Difference vector | ; the vector whose annihilation decides injectivity | element of U | |
| Coefficient matrix | The matrix representing when and | m x n matrix | |
| Domain dimension | Number of input coordinates, equal to the column count of | positive integer | |
| Codomain dimension | Number of output coordinates, equal to the row count of | positive integer |
Worked Numerical Example
Problem statement
An actuator bank drives three independent commands into a structure, and four strain gauges record the response. The response model is linear, with . Determine whether the gauge readings identify the command vector uniquely, and if not, exhibit two command vectors the instrument cannot distinguish.
State the model
The four gauge readings are linear in the three commands . Collect the coefficients into a matrix:
Set up the injectivity test
Suppose two command vectors give identical gauge readings, . Subtracting and applying linearity gives , that is with . Injectivity holds exactly when this homogeneous system has only the trivial solution.
Row-reduce the coefficient matrix
Apply , , , then scale and clear the second column. The reduced row-echelon form is:
Read the pivot pattern
Pivot columns are 1 and 2, so . Column 3 carries no leading one, so is a free variable and the system has non-trivial solutions. By the full-column-rank criterion, is not injective: the three columns of are linearly dependent.
Extract an annihilated direction
Setting and back-reading the two pivot rows gives and . Verify directly against the original matrix — the check must be made on , not on its reduced form:
Build the witness pair
Choose any command vector, say , and set . These are distinct commands. Evaluating both:
Repair the instrument
The dependence is a property of the sensing geometry, not of the data. Relocating the fourth gauge so that its response row becomes changes the matrix to . Reducing gives leading ones in all three columns, so , the homogeneous system has only the trivial solution, and the modified instrument is injective.
The original four-gauge array is blind along the command direction : any two commands differing by a multiple of that vector produce byte-identical readings, so the array cannot identify the applied command. Adding four sensors did not help because only two of the four rows were independent. Changing one gauge location to break the dependence restores full column rank and with it a unique inverse reading.
Applications & Industry Use
Sensor array identifiability
A sensor array measures a linear functional of the physical state. Injectivity of the sensing map is the condition that the recorded vector determines the state. Testing rank of the sensing matrix at design time is far cheaper than discovering during commissioning that two fault conditions produce the same signature.
Uniquely decodable linear codes
A linear encoder maps a message block to a longer codeword. Injectivity of the encoder is the minimum requirement for decodability: two distinct messages sharing a codeword make error-free decoding impossible even on a noiseless channel. Generator matrices are therefore always chosen with full column rank.
Degenerate transformation detection
Modelling transforms composed from scales, shears and projections may silently become rank-deficient. A non-injective transform flattens geometry, so distinct vertices coincide, surface normals vanish and shading fails. Checking injectivity of the linear part detects the collapse before it reaches the rasteriser.
Distinguishing feed compositions
Online analysers report a small number of linear combinations of species concentrations. If the analyser map is not injective, two different feed compositions produce identical readings and control action based on those readings is directed at an ambiguous state. Rank analysis of the analyser response matrix identifies which species pairs are indistinguishable.
Damage localisation
Damage is modelled as a change in a stiffness parameter vector, which maps linearly to a change in measured modal response for small perturbations. Non-injectivity means two damage locations produce the same response change, so the monitoring system can detect damage but not localise it. Sensor placement is chosen precisely to restore injectivity.
Identifiable regression models
In a linear model the design matrix maps parameters to fitted values. When it lacks full column rank, infinitely many parameter vectors give an identical fit and individual coefficients are meaningless, even though predictions remain well defined. Detecting this before interpretation prevents confident statements about unidentifiable quantities.
Design Considerations
Check dimensions before touching the formula
If the transformation cannot be injective, whatever its coefficients. This one-line test disposes of many cases immediately and should always precede a row reduction. The converse is not available: permits injectivity but does not deliver it.
Injectivity is a property of the map, not of the data
It is tempting to conclude from a data set in which all observed outputs happen to be distinct that the map is injective. It is not evidence. Injectivity is decided by the rank of the transformation, and a rank-deficient map will produce distinct outputs for most randomly chosen input pairs while still being ambiguous along a specific direction.
Rank deficiency is a knife edge in exact arithmetic and a gradient in floating point
Over the rationals a matrix either has full column rank or it does not. In floating point, near-dependence between columns is the practical concern: the map is technically injective but numerically close to a map that is not, and inverting it amplifies noise enormously. Report the smallest singular value or a condition number alongside the rank, never the rank alone.
Adding rows is not the same as adding information
Extra output channels increase the row count of but only help if they increase the rank. A sensor that measures a linear combination of existing channels adds a row of zeros to the reduced form and leaves the ambiguity untouched. Design sensor placement against the rank of the assembled matrix, not against the sensor count.
Prefer a constructive disproof
When a transformation fails the test, report the annihilated direction rather than only the fact of failure. The direction is physically meaningful — it names the combination of inputs the instrument cannot see — and it immediately generates witness pairs for validation and regression tests.
Injectivity does not imply the map can be undone
An injective transformation can be reversed on its range, but if the range is a proper subset of the codomain there is no function defined on all of that inverts it. Full invertibility requires surjectivity as well. Do not read injectivity as a licence to write without checking the second property.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Item 2-8.4 fixes the notation for mappings, and the standard prescribes the arrow form together with the terms injective, surjective and bijective used throughout this page. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Governs the arithmetic in which the rank test is executed. Exact cancellation to zero is not reproducible in binary64, so an injectivity decision taken by comparing a pivot against zero requires an explicit tolerance. |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Column-pivoted QR (xGEQP3) and the singular value decomposition (xGESVD) are the production instruments for deciding full column rank, and therefore for deciding injectivity of a matrix transformation. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the transformation notation and matrices on this page as semantic markup rather than images, keeping them searchable and machine-readable. |
IEC 60751 | Industrial platinum resistance thermometers and sensors | A representative instrumentation standard: calibration relations of this kind are linearised into sensing matrices whose column rank determines whether a multi-probe installation can identify a temperature field uniquely. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Small symbolic models where the question is structural: does a designed sensing geometry lose a direction? | Gives an unambiguous yes or no with no tolerance, but coefficient growth makes it impractical above a few hundred columns. |
| IEEE 754 binary64 with an SVD rank test | Measured or estimated coefficient matrices, the normal engineering case. | Robust and standard, at the cost of work and a tolerance choice that must be documented alongside the answer. |
| IEEE 754 binary64 with pivoted QR | Large systems where a full SVD is too expensive but a rank estimate with a permutation is enough. | Several times cheaper than SVD and reveals which columns are the dependent ones, but the rank estimate is less reliable for matrices with a gradual singular value decay. |
| IEEE 754 binary32 | Embedded or GPU pipelines where memory bandwidth dominates and the sensing matrix is known to be well conditioned. | Roughly seven significant digits leaves little margin between a genuinely dependent column and a merely correlated one. |
| Fixed-point integer arithmetic | Fixed-geometry sensing matrices baked into an embedded controller with known integer coefficients. | Deterministic and exact for the stated geometry, but overflow during elimination must be bounded a priori and any recalibration invalidates the analysis. |
| Finite field arithmetic | Linear codes and cryptographic maps, where injectivity of the encoder is the decodability condition. | Exact and fast with no growth in operand size; note that column rank over a finite field can differ from rank over the rationals for the same integer matrix. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of the decision
Deciding injectivity of for of size with costs one elimination, about floating-point operations. A rank-revealing QR is a small constant factor more; a singular value decomposition is roughly an order of magnitude more but returns the margin by which the test passes or fails.
Doing it by hand
Reduce the coefficient matrix only — there is no augmented column, because the right-hand side is zero and stays zero under every row operation. Count leading ones and compare against the column count. Carrying a column of zeros through the reduction is a common waste of effort and an occasional source of arithmetic error.
Library routines
numpy.linalg.matrix_rank(A) answers the question for a numeric matrix via the SVD, with a tolerance derived from the largest singular value and the machine epsilon. scipy.linalg.null_space(A) returns an orthonormal basis for the annihilated directions, which is the constructive form of the answer. Symbolic systems expose Matrix.nullspace() and Matrix.rank() over the rationals.Verifying a claimed witness pair
Substitute both vectors into the original transformation, not into any reduced or factored form. An arithmetic slip during elimination produces a vector that annihilates the reduced matrix but not the original one, and the check on catches it immediately.
Injectivity under composition
If and are both injective, the composition is injective: equal outputs of the composition force equal outputs of by injectivity of , and then equal inputs by injectivity of . In matrix terms, a product of full-column-rank matrices with compatible shapes retains full column rank. This makes injectivity a property that survives pipelining of processing stages.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Concluding injectivity from examples | high | Testing a handful of input pairs, observing distinct outputs, and declaring the map one-to-one. | Prove it by reducing to the homogeneous system. Examples can only disprove injectivity, never establish it. |
| Confusing injective with surjective | high | Reading both as vague statements about the map being well behaved, or assuming one implies the other. | Injective constrains inputs (no collisions); surjective constrains outputs (nothing missed). For non-square shapes at most one of them can hold. |
| Testing the wrong homogeneous system | medium | Row-reducing an augmented matrix with a non-zero right-hand side while investigating injectivity. | Injectivity depends only on the coefficient matrix. Reduce alone; a right-hand side belongs to a consistency question, not this one. |
| Assuming more outputs guarantees injectivity | medium | Believing that , more measurements than unknowns, is sufficient. | Only the rank matters. Check explicitly; redundant sensors add rows without adding rank. |
| Exact-zero pivot test on floating-point data | high | Comparing a computed pivot against zero, so rounding noise of order is accepted as a genuine pivot. | Use a scaled tolerance relative to the matrix norm, or decide rank from singular values and report the margin. |
| Ignoring near-dependence | medium | Reporting full column rank for a matrix whose smallest singular value is many orders below the largest. | Report the condition number with the rank. A technically injective but ill-conditioned map is unusable for inverse problems. |
| Treating injectivity as invertibility | medium | Writing after establishing only that distinct inputs give distinct outputs. | Confirm surjectivity as well, or restrict the codomain to the range before speaking of an inverse. |
| Applying the property to a non-linear map | low | Using the difference argument on a function that is not a linear transformation. | Verify additivity and scalar-multiple preservation first. Without them, is false and the whole reduction collapses. |
FAQs
How is injectivity different from a matrix being nonsingular?
Nonsingularity is defined only for square matrices; injectivity is defined for any linear transformation. For a square matrix the two coincide: is injective exactly when is nonsingular. For a rectangular the corresponding condition is full column rank, which is the natural generalisation.
Can a linear transformation from a larger space to a smaller one ever be injective?
No. If then any transformation from to must send some non-zero vector to zero, and that produces collisions everywhere. This is a purely dimensional obstruction and holds regardless of the coefficients defining the map.
Why is it enough to check whether only the zero vector is annihilated?
Because linearity converts an equality of outputs into an equality of a difference with zero: is equivalent to . If the only vector sent to zero is the zero vector, the difference must vanish and the inputs must agree.
Does injectivity mean I can compute the input from the output?
It means at most one input corresponds to a given output, so the answer is unique when it exists. It does not guarantee existence: an output outside the range has no preimage at all. Practical inversion also requires the map to be well conditioned, otherwise the unique answer is numerically unreliable.
How does injectivity behave under composition of transformations?
It is preserved. If and are both injective then so is , because a collision in the composition forces a collision in , hence in . The converse is only partial: if is injective then must be injective, but need not be.
What is the fastest reliable way to test injectivity numerically?
Compute the singular values of the coefficient matrix and compare the smallest against a tolerance scaled by the largest and by the machine epsilon. This is what a library rank function does. A pivoted QR factorisation is a cheaper alternative when the matrix is large and the singular value gap is clear.
If a transformation is not injective, how much information is lost?
Exactly the dimension of the set of annihilated vectors. If that set has dimension , then every output has a -parameter family of inputs mapping to it, and the outputs determine the input only up to that family. The number is the nullity of the coefficient matrix.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section ILT, subsection EILT. Licensed under the GNU Free Documentation License v1.2.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
- IEEE 754-2019, IEEE Standard for Floating-Point Arithmetic. Institute of Electrical and Electronics Engineers.
AI Suggested Questions
- Give me a 5x3 matrix whose transformation is injective and a 5x3 matrix whose transformation is not, and show the row reduction that distinguishes them.
- If a sensing matrix is technically full column rank but has condition number 10^9, what does that mean physically for identifiability?
- Prove that if the composition S∘T is injective then T must be injective, and give an example where S is not.
- How do I choose a numerical tolerance for a rank test so that the injectivity decision is defensible in an engineering report?
- Show how an injective linear transformation between abstract polynomial spaces reduces to a matrix rank calculation once bases are chosen.
- What is the relationship between injectivity of a linear transformation and the number of degrees of freedom in its inverse problem?
Related Calculators
Enter a coefficient matrix and get a verdict on injectivity, the pivot pattern, and an explicit annihilated direction when the test fails.
Matrix Rank & Nullity CalculatorCompute rank, nullity and the pivot column set with a selectable numerical tolerance.
Null Space Basis CalculatorProduce a basis for the set of vectors a matrix annihilates, in exact rational or floating-point arithmetic.
