Engineering/Mathematics/Representations
Matrix Representations of Invertible Transformations
If is invertible then its matrix representation is an invertible matrix, and the representation of is obtained by inverting that matrix and swapping the bases: . Inverting an abstract transformation therefore reduces to inverting one square array.
- Advanced level
- Stream: representations
- Reading time 16 min
- Ref KVS-ENG-MATH-0112
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Matrix representation, matrix inverse, invertible transformations
- Key identity
- Requires
- , so the representation is square
- Test
- invertible the representation is non-singular
- Delivers
- An explicit closed-form formula for
Overview
A linear transformation is invertible when there is a second linear transformation undoing it in both directions. Established directly, this is an awkward property to verify: it requires exhibiting a candidate inverse or proving injectivity and surjectivity separately. Matrix representation collapses the question. Once bases are fixed, invertibility of the transformation is exactly invertibility of a square matrix, which is decided by row reduction, a determinant or a factorisation.
The central theorem does more than decide the question. It states that the representation of the inverse transformation is the inverse of the representation, with the roles of the two bases exchanged. The subscript exchange is not decoration: maps back to , so its domain basis is and its codomain basis is . Written with the labels in place, the identity reads , and the composition rule then confirms that multiplying the two representations in either order gives an identity matrix.
The proof is a clean application of the composition rule. Composing with gives the identity transformation, whose representation relative to a single basis used at both ends is the identity matrix. Composing in the other order gives the identity on the other space. The two products therefore satisfy the defining property of a matrix inverse, so the representation is invertible and its inverse is identified precisely.
The practical payoff is a routine for producing closed-form inverses. Represent the transformation on a convenient pair of bases, invert the matrix, then apply the fundamental theorem in reverse: coordinatise the input with , multiply by the inverted matrix, and decode with . The result is an algebraic formula for obtained without solving a single equation in the abstract spaces. The same theorem also completes the chain of equivalences for non-singular matrices, adding the statement that the transformation defined by a square matrix is invertible exactly when the matrix is.
Definition
Invertible Linear Transformation
IVLTA linear transformation is invertible when there exists a linear transformation with and , where and are the identity transformations on the two spaces. The transformation is unique and is written . Equivalently, is invertible exactly when it is both injective and surjective.
Invertibility forces for finite-dimensional spaces, so an invertible transformation always has a square representation. An invertible transformation is precisely an isomorphism between the two spaces.
Matrix Inverse
MIA square matrix of size is invertible when there is a matrix of the same size with . Such a matrix is unique when it exists, and a square matrix is invertible precisely when it is non-singular — equivalently when it row-reduces to the identity, has rank , or has non-zero determinant.
Identity Transformation
IDLTThe transformation with for every . Relative to one basis used for both domain and codomain its representation is the identity matrix ; relative to two different bases the same construction yields a change-of-basis matrix.
Concepts
The inverse representation theorem
Suppose is invertible, is a basis of and is a basis of . Then is an invertible matrix and . The proof composes in both directions: represents relative to at both ends, which is , and represents relative to at both ends, which is again . Both defining products hold, so the identification is complete.
Reading the subscripts as a consistency check
The exchanged labels are forced by the direction of the maps. Because takes vectors of to vectors of , its domain basis is and its codomain basis is . Written out, the product has matching inner labels and outer labels , exactly as the composition rule requires. Any expression in which the inner labels disagree is wrong regardless of whether the shapes conform, and in the square case shape agreement provides no protection.
Invertibility of the transformation and of the matrix are the same question
Because the kernel of corresponds to the null space of the representation and the range to the column space, is injective exactly when the representation has trivial null space and surjective exactly when its columns span. For a square representation these two conditions coincide, and each is equivalent to non-singularity. Hence a single row reduction settles invertibility, and any of the standard non-singularity tests — reduction to the identity, rank , non-zero determinant, no zero eigenvalue — can be used interchangeably.
A formula for the inverse transformation
Applying the fundamental theorem to gives . Carrying a symbolic vector through that expression produces a closed-form algebraic description of the inverse. This is the standard method for inverting a transformation on polynomials, matrices or any other abstract space: the entire difficulty is transferred into one matrix inversion, which is a solved problem.
Matrices and their transformations are invertible together
Specialising to with the standard basis at both ends, the transformation has representation exactly . The theorem then says is invertible if and only if is an invertible transformation. This is the bridge that lets every property of non-singular matrices be restated as a property of transformations, and conversely, and it is the last equivalence added to the standard list of non-singular matrix equivalences.
The non-singular equivalences, extended
For a square matrix of size , all of the following say the same thing: is non-singular; row-reduces to the identity; the null space of is trivial; the system has a unique solution for every ; the columns of are linearly independent; is invertible; the column space of is ; the columns of form a basis of ; the rank of is ; the nullity of is zero; ; zero is not an eigenvalue of ; and the transformation is invertible. The last item is the contribution of this section, and it converts a list about arrays into a list about functions.
Inverting a linear transformation through a representation
Equations
Representation of the inverse transformation
EQ-IMR-01The bases exchange roles because maps back to .
Both defining products
EQ-IMR-02The first product represents and the second represents .
Closed-form inverse transformation
EQ-IMR-03Coordinatise in the codomain, multiply by the inverse matrix, decode in the domain. Carrying a symbolic vector through gives an algebraic formula.
Invertibility criterion
EQ-IMR-04Valid for a square representation. All standard non-singularity tests apply and give the same verdict, independent of the bases chosen.
Necessary dimension condition
EQ-IMR-05An invertible transformation is an isomorphism, and isomorphic finite-dimensional spaces have equal dimension.
Matrix transformation on standard bases
EQ-IMR-06With standard unit vectors at both ends the representation is the matrix itself, which is why matrix invertibility and transformation invertibility are the same statement.
Augmented reduction for the inverse
EQ-IMR-07Row-reducing the representation augmented with an identity block produces the inverse representation in the right-hand block.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Invertible transformation | The map from onto being inverted | isomorphism U to V | |
| Inverse transformation | The unique linear transformation undoing in both directions | isomorphism V to U | |
| Representation of | Square array of size encoding relative to and | n x n non-singular matrix | |
| Representation of the inverse | Square array encoding relative to and ; equals the matrix inverse | n x n non-singular matrix | |
| Identity matrix | Representation of the identity transformation on either space | n x n matrix | |
| Common dimension | Shared dimension of and , and the size of the representation | positive integer | |
| Codomain coordinatisation | Encodes the input of as a column vector | invertible map V to C^n | |
| Domain decoding | Rebuilds an element of from its coordinates | invertible map C^n to U | |
| Determinant | Scalar test for non-singularity of a square representation | complex number |
Worked Numerical Example
Problem statement
A data acquisition channel fits a quadratic model to a signal and reports its values at three sampling instants. Recovering the model from the three samples is the inverse transformation — quadratic interpolation. Build the representation of the sampling map, invert it, and read off a closed-form interpolation formula.
State the transformation
Let send a quadratic to its values at , and , so . It is linear because evaluation at a fixed point is linear. Both spaces have dimension , so a square representation is possible and invertibility is not immediately excluded.
Build the representation
Take and the standard basis of . Evaluating: , and . These are the columns.
Test for non-singularity
Expanding along the first row gives , which is non-zero. The representation is therefore non-singular, so is an invertible transformation and a unique quadratic passes through any three prescribed values at these nodes.
Invert the representation
Row-reducing , or dividing the adjugate by the determinant, gives the inverse. By the theorem this array is , the representation of the interpolation map relative to and .
Confirm the product is the identity
Multiplying the two representations verifies the inverse before it is used. Row two of against the columns of the inverse gives , and ; the remaining rows check similarly.
Assemble the closed-form inverse
Apply the inverse representation to a symbolic sample vector and decode the result with against the monomial basis.
Check the formula on known data
The samples of at the three nodes are . Substituting gives a linear coefficient of and a quadratic coefficient of , recovering exactly. Substituting recovers the constant polynomial .
Interpret the entries
The three rows of the inverse representation are the coefficients of the Lagrange interpolation basis for nodes , and expressed in monomials. The theorem has therefore not merely inverted a matrix but produced a standard numerical formula, with the guarantee that no other quadratic fits the data.
Sampling a quadratic at three distinct nodes is an invertible transformation, and inverting its representation yields a ready-to-use interpolation formula. The determinant of is a first indication of conditioning: nodes clustered together would drive it towards zero, warning that reconstruction from samples becomes numerically unstable long before it becomes impossible.
Applications & Industry Use
Inverting a calibration model
A calibration maps a physical quantity to an instrument reading through a linear model. Recovering the quantity from the reading is the inverse transformation, and representing the calibration on a convenient basis turns the recovery into one matrix inversion. The determinant and condition number of the representation quantify how far measurement noise is amplified during the inversion.
Input reconstruction and feedforward design
Designing a feedforward controller means inverting the map from control inputs to steady-state outputs. When that map is represented on physically meaningful bases, invertibility of the representation decides whether every desired output is achievable, and the inverse representation is the feedforward gain matrix itself.
Colour space conversion
Conversion between a device RGB space and a reference tristimulus space is a linear transformation between three-dimensional spaces, represented by a matrix relative to the primaries of each space. The reverse conversion is the matrix inverse, and a poorly conditioned primary set produces a conversion that exaggerates sensor noise in the recovered coordinates.
Undoing a modelling transform
Picking, collision queries and shadow mapping all require mapping world coordinates back into object coordinates. That inverse transform is the inverse of the modelling representation, and engines cache it precisely because inverting per query would be wasteful. Degenerate scaling makes the representation singular and the inverse undefined, which is the usual cause of vanishing geometry.
Invertible maps over finite fields
Linear diffusion layers in block ciphers and generator matrices in linear codes must be invertible over a finite field so that decoding is possible. The same theorem applies with the scalars taken from that field, and invertibility is tested by the same rank condition, with the determinant required to be a non-zero field element rather than merely a non-zero real number.
Frame inversion in kinematic chains
The map carrying velocities from one link frame to another is invertible whenever the frames are related by a proper rigid motion. Inverting its representation gives the reverse mapping directly, and the guaranteed existence of that inverse is why kinematic chains can be traversed in either direction without re-deriving the geometry.
Design Considerations
Check the dimensions before anything else
Invertibility requires equal dimensions, so a rectangular representation ends the discussion immediately. When the dimensions are unequal but a partial inverse is wanted, the correct instruments are a one-sided inverse or a pseudoinverse, which solve a different problem and carry different guarantees.
Prefer solving to inverting when only outputs are needed
If the requirement is to apply to a handful of vectors, factorise the representation and solve, rather than forming the inverse explicitly. Solving is both cheaper and more accurate. Form the explicit inverse when the deliverable is a reusable gain matrix or a symbolic formula, which is exactly the case in the worked example above.
Choose bases that keep the representation well conditioned
Invertibility is a yes-or-no property of the transformation, but the numerical difficulty of inverting depends on the bases. Sampling nodes that are close together, or basis vectors that are nearly parallel, produce representations with small determinants and large condition numbers. Reporting the condition number alongside the inverse is a cheap and informative safeguard.
Use the determinant as a symbolic test, not a numerical one
A non-zero determinant is a correct criterion in exact arithmetic and a poor one in floating point, because its magnitude scales with the -th power of the entries and says little about conditioning. For numerical work decide invertibility from a rank-revealing factorisation or the smallest singular value, and keep the determinant for symbolic or small integer cases.
Track the basis exchange in code
The inverse representation is indexed by then , the reverse of the original. Storing representations as bare arrays makes this exchange invisible and permits silently wrong compositions. Wrapping the array with its ordered basis pair lets the exchange be performed and checked automatically when an inverse is taken.
Exploit structure rather than inverting generically
If the representation is orthogonal or unitary, its inverse is its adjoint and no inversion is needed. If it is triangular, inversion is a back-substitution. If it is a permutation, the inverse is a reordering. Selecting a basis that produces such structure converts an inversion into something far cheaper and exactly representable.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Provides xGETRF for the LU factorisation that decides non-singularity and xGETRI for the explicit inverse, together with condition estimation via xGECON, which is the recommended numerical replacement for a determinant test. |
ISO 15076-1 | Image technology colour management — Architecture, profile format and data structure | Defines the colour transformation matrices whose inverses convert between device and reference colour spaces, a direct industrial instance of inverting a matrix representation. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Governs the rounding behaviour that makes an explicitly formed inverse less accurate than a factorise-and-solve approach, and that turns a nearly singular representation into an unreliable one. |
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Fixes the notation for inverse maps, inverse matrices and the identity, keeping the distinction between as a transformation and as an array typographically explicit. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the nested superscripts of as structured markup so the exchanged basis labels survive search indexing and screen reading. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Deriving a closed-form formula for an inverse transformation, as in interpolation or symbolic control design. | Produces an exact formula with recognisable coefficients, but entry size grows quickly with dimension and the method does not scale to large representations. |
| IEEE 754 binary64 with LU factorisation | Numerical inversion or repeated application of an inverse in an engineering pipeline. | Fast and well understood, with backward error bounds available, but the explicit inverse is less accurate than solving and should be avoided unless the matrix itself is the deliverable. |
| Orthogonal or unitary representation | The basis can be chosen orthonormal and the transformation preserves inner products, as in rotations and orthogonal transforms. | The inverse is the adjoint, so it is exact and free, and conditioning is perfect; the constraint is that not every transformation admits such a basis. |
| Finite field scalars | Diffusion layers, generator matrices and any setting where the underlying scalars are a finite field. | Inversion is exact and cheap with no conditioning concerns, but invertibility depends on the field: a matrix invertible over the rationals may be singular modulo a given prime. |
| Fixed-point entries | An inverse gain matrix must be evaluated on embedded hardware without floating-point support. | Deterministic and compact, but the inverse must be scaled offline and its entries can span a much wider dynamic range than the forward representation. |
| Structured triangular or banded storage | The chosen bases make the representation triangular or narrowly banded, for instance a nested or hierarchical basis. | Inversion reduces to substitution at cost, but the inverse of a banded matrix is generally dense, so the structure should be kept in factored form rather than inverted explicitly. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of inversion versus solving
Factorising an representation costs about operations and each subsequent solve costs . Forming the explicit inverse costs roughly and every later application still costs . Explicit inversion therefore pays only when the inverse itself is needed as an object — as a formula, a stored gain, or an input to further symbolic work.
The augmented reduction procedure
By hand, write the representation beside an identity block and row-reduce until the left block is the identity. The right block is then the inverse representation. If the left block cannot be reduced to the identity, the representation is singular and the transformation is not invertible; the reduction detects this without a separate test.
Verification in two independent ways
Confirm the matrix product equals the identity in both orders, and separately confirm on a non-trivial element that in the original space. The second check exercises the coordinatisation and decoding steps as well as the arithmetic, and it catches the common error of failing to exchange the bases.
Library behaviour
NumPy exposes numpy.linalg.inv and numpy.linalg.solve; the documentation recommends the latter for applying an inverse, for accuracy reasons. SymPy's Matrix.inv works exactly and accepts a method argument, and it will raise rather than return a meaningless result for a singular matrix. SciPy's scipy.linalg.lu_factor with repeated lu_solve calls is the appropriate pattern when many right-hand sides share one representation.
Conditioning and the meaning of a small determinant
The relative error in an inverted representation is bounded roughly by the condition number times the unit round-off. A determinant close to zero is suggestive but not decisive, since scaling a matrix by a constant scales its determinant by the -th power while leaving the condition number unchanged. Estimate the condition number directly and report it with any inverse used in production.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Failing to exchange the bases | high | Labelling the inverted matrix as instead of , so subsequent compositions use mismatched coordinates. | Derive the label from the direction of the map: starts in , so comes first. Check that inner subscripts match in every product. |
| Assuming a square representation is invertible | high | Treating equal dimensions as sufficient, when the representation may still be singular. | Test explicitly by rank, reduction to the identity, or a factorisation, before attempting to invert or to claim the transformation is an isomorphism. |
| Attempting to invert a rectangular representation | medium | Applying the theorem when the domain and codomain have different dimensions. | Check dimensions first. When they differ, consider a one-sided inverse or a pseudoinverse and state clearly which problem is being solved. |
| Using an exact-zero determinant test on floating-point entries | high | Deciding invertibility from a computed determinant that is small but non-zero purely because of rounding. | Use a rank-revealing factorisation or the smallest singular value with a documented tolerance, and treat a tiny determinant as a warning about scaling rather than a verdict. |
| Forming an explicit inverse for a single solve | low | Habitual use of an inversion routine where a factorisation and one triangular solve would do. | Reserve explicit inversion for cases where the inverse matrix is the deliverable; otherwise factor once and solve. |
| Decoding the inverse with the wrong coordinatisation | high | Applying instead of to the result of the inverse representation, so the formula returns an object of the wrong space. | Remember that delivers elements of , so the final decoding must use the domain basis . |
| Ignoring the conditioning of the chosen bases | medium | Selecting sampling nodes or basis vectors that are nearly dependent, producing a technically invertible but numerically hopeless representation. | Report the condition number with the inverse, and redesign the basis or the node placement when it is large relative to the data accuracy. |
| Assuming invertibility transfers across fields | low | Reusing a representation invertible over the rationals in a finite-field setting where its determinant reduces to zero. | Test invertibility in the field actually in use, and for modular work check the determinant is a unit modulo the chosen modulus. |
FAQs
Why do the bases swap when the transformation is inverted?
Because the inverse maps in the opposite direction. The domain of is , whose basis is , and its codomain is , whose basis is . The representation of is therefore indexed then . Writing the labels out makes the composition products legible and provides a free check on any manipulation.
Does the choice of bases affect whether the transformation is invertible?
No. Invertibility is a property of the transformation, and every representation of an invertible transformation is a non-singular matrix. What does change with the bases is the numerical difficulty: some choices yield well conditioned representations and others yield nearly singular ones, even though all are mathematically invertible.
How do I get a formula for the inverse rather than just numbers?
Apply the inverse representation to a symbolic coordinate vector and decode the result. Because simply rebuilds an object from its coordinates, the entries of the product become the coefficients of the formula. This is the standard route to closed-form inverses on spaces of polynomials or matrices.
Can a transformation between spaces of different dimensions ever be invertible?
Not in the finite-dimensional setting. An invertible transformation is an isomorphism, and isomorphic spaces have equal dimension. A map from a larger space cannot be injective and a map to a larger space cannot be surjective, so at least one of the two requirements always fails.
What is the connection to the list of non-singular matrix equivalences?
This section adds one more equivalent statement to that list: the transformation defined by multiplication by is invertible. Because the representation of that transformation on standard bases is itself, invertibility of the matrix and of the transformation are literally the same assertion, and every other item on the list can now be read either way.
Is the determinant a good way to test invertibility in practice?
Only in exact arithmetic or for very small integer matrices. In floating point the determinant scales badly with dimension and with the magnitude of the entries, so it is a poor proxy for how close a representation is to singular. A rank-revealing factorisation or the smallest singular value is a far better instrument.
If I already have the representation, do I need to prove injectivity and surjectivity separately?
No, and that is the practical value of the result. For a square representation, trivial null space and full column space are equivalent, so a single rank computation settles both. Only when the dimensions differ do injectivity and surjectivity have to be considered separately, and in that case invertibility is already ruled out.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section MR, Subsection IVLT. Licensed under the GNU Free Documentation License v1.2.
- Higham, N. J. Accuracy and Stability of Numerical Algorithms, 2nd edition. Society for Industrial and Applied Mathematics, 2002.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
- ISO 15076-1:2010, Image technology colour management — Architecture, profile format and data structure. International Organization for Standardization.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
AI Suggested Questions
- Invert the transformation that maps a quadratic to its value, first derivative and second derivative at a point, and interpret the resulting formula.
- Show what happens to the representation and its inverse when two interpolation nodes are moved close together, with condition numbers at each step.
- Why is forming an explicit matrix inverse less accurate than factorising and solving, with a numerical demonstration?
- Construct a matrix that is invertible over the rationals but singular modulo 7, and explain the consequence for a coding application.
- Given a transformation on the space of symmetric matrices, decide invertibility from a representation and produce a closed-form inverse.
- Explain how adding the invertible-transformation statement completes the list of non-singular matrix equivalences.
Related Calculators
Represent an invertible transformation on chosen bases, invert the matrix, and return a closed-form formula for .
Matrix Inverse CalculatorInvert a square matrix by augmented row reduction with each step shown, in exact rational or floating-point arithmetic.
Condition Number CalculatorEstimate the condition number of a representation and report how far measurement error is amplified when it is inverted.
