Engineering/Mathematics/Matrices
Nonsingular Matrices Are Invertible
For a square matrix, having a trivial null space and having an inverse are the same condition. Two supporting results deliver the equivalence: a product involving a singular factor is singular, and for square matrices a one-sided inverse is automatically two-sided.
- Core level
- Stream: matrix-algebra
- Reading time 13 min
- Ref KVS-ENG-MATH-0045
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Null spaces, nonsingularity and the matrix inverse
- Central result
- nonsingular invertible
- Scope
- Square matrices only
- Consequence
- alone implies
- Payoff
- Unique solution for every
Overview
Two apparently unrelated properties of a square matrix have been circling one another. Nonsingularity is a statement about a homogeneous system: has only the trivial solution, equivalently . Invertibility is a statement about matrix algebra: there is a matrix with and . The result established here is that, for square matrices, these are the same property. Neither can hold without the other.
The equivalence is worth more than its economy suggests, because the two descriptions are tested in completely different ways. Nonsingularity is checked by row reduction, which is an computation on the matrix alone. Invertibility is exploited algebraically, by rearranging equations. Knowing the two coincide means a cheap structural test licenses an expensive algebraic privilege, and conversely that any failure of one is a failure of the other.
Two supporting results carry the argument. The first says that a product of square matrices in which at least one factor is singular is itself singular — singularity is contagious under multiplication. The second, and more surprising, says that for square matrices a one-sided inverse suffices: if then follows automatically. That is emphatically not a general algebraic fact; it depends on the finite, equal dimensions involved, and it fails for infinite-dimensional operators.
The immediate practical dividend is a formula. When is nonsingular the system has exactly one solution for every choice of , and that solution is . Existence, uniqueness and an explicit expression arrive together, which is why nonsingularity of a coefficient matrix is the first thing an engineer checks when a model is required to have a well-defined answer for every input.
Definition
Product With a Singular Matrix is Singular
PWSMSLet and be square matrices of size , at least one of which is singular. Then the product is singular.
The proof splits into the case where is singular and the case where is nonsingular and is singular. That asymmetric split is deliberate: the second case is easier to argue with the stronger hypothesis, and the two cases together cover every configuration permitted by the hypothesis.
One-Sided Inverse is Sufficient
OSISLet and be square matrices of size with . Then as well, so and are inverses of each other.
Squareness is essential. For rectangular matrices a one-sided inverse can exist with no matching inverse on the other side, and the analogous statement fails outright for operators on infinite-dimensional spaces.
NonSingularity is Invertibility
NSIA square matrix is nonsingular if and only if is invertible. Having only the trivial solution to and possessing a two-sided inverse are the same condition.
Solution with NonSingular Coefficient Matrix
SNSCMIf is nonsingular, the system has the unique solution , for every vector of constants .
Existence follows by substitution: . Uniqueness is a separate consequence of nonsingularity, and both hold for every simultaneously.
Concepts
Singularity propagates through a product
If is singular there is a non-zero with , and then , so the same certifies as singular. If instead is nonsingular and is singular, take a non-zero with and let be the unique solution of . That cannot be zero, since , and . Either way a non-zero null vector for is exhibited.
Why one side is enough for square matrices
Suppose . The identity matrix is nonsingular, so if were singular the previous result would force to be singular — a contradiction. Hence is nonsingular, and the augmented reduction procedure supplies a matrix with . Then . Every step is associativity or the identity property; the substance is that a right inverse for was available, and that availability came from being nonsingular.
The equivalence in both directions
If is invertible and , then , so the null space is trivial and is nonsingular. Conversely, if is nonsingular then reduction of produces with , and the one-sided result upgrades this to a genuine two-sided inverse. The two implications use entirely different machinery, which is characteristic of the equivalence theorems in this subject.
What the procedure proves and what it does not
The reduction procedure applied to a singular matrix fails to produce an inverse, but failing to find something is not the same as showing it does not exist. The equivalence supplies the missing half: a singular matrix has no inverse at all, by any method. That distinction is not pedantry — it is the difference between an algorithm reporting no result and a proof of impossibility, and only the latter licenses a conclusion about the underlying model.
The growing list of equivalent conditions
Invertibility joins a list of statements about a square matrix of size that are all equivalent: is nonsingular; row-reduces to ; ; the system has a unique solution for every ; the columns of form a linearly independent set; and is invertible. Each entry is a different diagnostic instrument aimed at the same underlying property, and the list keeps growing as further structures are introduced.
Existence, uniqueness and a formula at once
When is nonsingular, satisfies the system by direct substitution, and nonsingularity rules out any second solution. The three questions an engineer asks about a linear model — is there an answer, is it the only one, and what is it — are therefore settled together and for every right-hand side simultaneously. This is why nonsingularity of a coefficient matrix functions as a well-posedness certificate for the model that produced it.
Logical route from nonsingularity to a solution formula
Equations
Singularity propagates through a product
EQ-NSMI-01The same non-zero vector that certifies as singular certifies as singular.
One-sided inverse is sufficient
EQ-NSMI-02Given and a right inverse of the nonsingular matrix , regrouping produces the missing product.
Invertibility forces a trivial null space
EQ-NSMI-03Any solution of the homogeneous system is forced to be the zero vector, so an invertible matrix is nonsingular.
Nonsingularity is invertibility
EQ-NSMI-04The central equivalence, valid for square matrices of any size over .
Unique solution with a nonsingular coefficient matrix
EQ-NSMI-05Substitution confirms that solves the system; nonsingularity confirms that nothing else does.
Equivalent conditions for a square matrix
EQ-NSMI-06Five interchangeable diagnostics for the same property. The symbol denotes row equivalence.
A nonsingular and a singular matrix compared
EQ-NSMI-07The pair used below. A single entry separates a matrix with a trivial null space from one whose null space is a line.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Square matrix under test | The matrix whose nonsingularity and invertibility are in question | n x n complex matrix | |
| Candidate inverse | Matrix produced by the augmented reduction, satisfying | n x n complex matrix | |
| Right inverse of | Auxiliary matrix with , used to complete the one-sided argument | n x n complex matrix | |
| Null vector | Non-zero solution of a homogeneous system, the certificate of singularity | C^n, nonzero | |
| Vector of constants | Right-hand side of the system | C^n | |
| Null space of | Set of all solutions of | subspace of C^n | |
| Identity matrix | Nonsingular reference matrix and target of both defining products | n x n matrix | |
| Singular example matrix | Square matrix with a non-trivial null space, used as a contrast case | n x n complex matrix | |
| Size | Common row and column count of all matrices involved | positive integer |
Worked Numerical Example
Problem statement
Two candidate designs for a three-node resistive sensing network differ in a single conductance. Determine which coefficient matrix is nonsingular, invert it, use the inverse across two excitation cases, and interpret the failure of the other design.
Row-reduce the first candidate
Apply and to , then continue to reduced form. The result is the identity matrix, so and is nonsingular.
Invoke the equivalence
Nonsingularity now guarantees invertibility — not merely that the reduction procedure will terminate, but that an inverse exists as a mathematical object. Reducing produces it.
Confirm with one product
Row of against the three columns of gives , and ; the remaining rows follow the same pattern. Because the matrices are square, the one-sided result guarantees the reverse product without a second computation.
Excitation case one
For the entries of are , and .
Excitation case two
For the entries are , and . Substituting back into the original equations reproduces , confirming both results.
Row-reduce the second candidate
Changing the entry from to gives . Reduction now stalls with a zero row: the third row is a combination of the first two, so has only two pivot columns.
Exhibit the null vector
Setting the free variable gives and . Direct substitution confirms : the rows evaluate to , and , all zero.
Conclude that no inverse exists
Since , the matrix is singular, and the equivalence rules out an inverse by any method whatsoever. It follows further that is singular for every square , so no combination of with another network can restore a well-posed model.
The first design yields a unique node-voltage vector for every excitation, obtained from one stored inverse at the cost of a matrix-vector product per case. The second design is singular: the vector describes a non-zero pattern of node quantities that produces no measurable response, so the network cannot distinguish states differing by any multiple of . That is an observability defect in the design, not a numerical difficulty, and it must be fixed by changing the topology or the element values.
Applications & Industry Use
Observability of a sensing array
A measurement model with square is invertible exactly when distinct states produce distinct readings. A non-trivial null space is a set of state changes the instrument cannot see, so testing nonsingularity of the design matrix is the formal check that a sensor layout resolves everything it is meant to resolve.
Well-posedness of nodal analysis
Modified nodal analysis produces a square system whose nonsingularity guarantees a unique operating point. Singularity signals a genuine modelling defect — a floating subcircuit with no reference, a loop of ideal voltage sources — which simulators detect and report as a topology error rather than a convergence failure.
Adequate restraint of a model
An assembled stiffness matrix is singular when the structure retains a rigid-body mechanism, and the null space is spanned by the corresponding motions. Because singularity is proved rather than merely detected, an analysis package can report the specific unrestrained mode instead of simply refusing to solve.
Feasibility of state feedback and estimation
Pole placement and observer design require the controllability or observability matrix to be nonsingular. The equivalence means the same computation that answers the rank question also certifies that the required inverse exists, so the design step and the feasibility test are one calculation.
Degenerate configurations in mesh generation
Barycentric coordinates within a simplex are obtained by inverting a square matrix built from its vertices. Singularity means the vertices are affinely dependent — a degenerate, zero-volume element — so the invertibility test is simultaneously the mesh quality test.
Independence of a reaction set
A square stoichiometric matrix is singular exactly when the chosen reactions are linearly dependent, in which case the extent of reaction is not determined by the species balances alone. Detecting the null vector identifies the redundant combination and tells the modeller which reaction to remove.
Design Considerations
Nonsingularity is a property of the model, not of the arithmetic
A singular coefficient matrix nearly always encodes a real defect in the underlying model: an unrestrained degree of freedom, an unobservable state, a redundant equation. Treat singularity as a diagnostic to be interpreted rather than a numerical obstacle to be regularised away, and report the null vector, which names the defect.
In floating point the equivalence becomes a matter of degree
Exact arithmetic gives a clean dichotomy; floating point does not. A nearly singular matrix is invertible in principle and useless in practice. Report the condition number or the smallest singular value alongside any invertibility claim, and set the threshold from the accuracy of the input data rather than from machine epsilon.
One-sided verification is enough, but only for square matrices
For square and , confirming establishes that . The saving is real for large matrices. It disappears entirely for rectangular matrices, where a left inverse and a right inverse are genuinely different objects and may not both exist.
Do not attempt to repair a singular matrix by multiplication
Since a product with a singular factor is singular, no preconditioner, scaling or auxiliary matrix can turn a singular system into a nonsingular one. The remedies are to change the model, add constraints, or move to a least-squares or pseudoinverse formulation that accepts rank deficiency explicitly.
Use the equivalence to choose the cheapest test
All the listed conditions are interchangeable, so pick the one that is cheapest in context. Row reduction is natural when the matrix is already being eliminated; a Cholesky attempt is decisive and fast for a symmetric candidate; a singular value decomposition is the most informative when the answer is marginal.
Prefer a solve to an inverse even after the equivalence is established
Knowing that exists does not make forming it the right computation. The formula is a statement about the solution, not an instruction for obtaining it; a factorisation with triangular solves is faster and more accurate for the same result.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Standardises the notation for the null space, the identity matrix and the inverse used in stating the equivalence, including the script letters reserved for distinguished subspaces. |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Encodes the practical form of the equivalence: xGETRF reports a zero pivot through its info parameter, and xGECON supplies the reciprocal condition estimate that replaces an exact singularity test. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Explains why exact singularity is essentially never observed numerically: rounding perturbs a zero pivot into a tiny non-zero value, so the sharp dichotomy of the theorem becomes a threshold decision. |
IEC 61508 | Functional safety of electrical, electronic and programmable electronic safety-related systems | Motivates treating an ill-conditioned or singular model matrix as a detected fault requiring a defined safe response, rather than allowing a numerically returned but meaningless solution to propagate. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Represents the chains of equivalences on this page as structured markup, so the biconditional symbols are exposed as relations rather than as decorative glyphs. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Small symbolic or structural models where the answer is a definitive yes or no about singularity. | Delivers the sharp dichotomy the theorem describes, but is impractical beyond modest sizes and cannot express near-singularity, which is often the more useful engineering information. |
| IEEE 754 binary64 with condition estimation | The default for engineering coefficient matrices, where a graded answer is more informative than a binary one. | Fast and well supported, but requires a tolerance policy; the invertibility verdict then depends on a threshold that must be documented and justified. |
| Singular value decomposition | The matrix is marginal, or the null space itself must be reported to diagnose the modelling defect. | The most numerically reliable rank and null-space determination available, at several times the cost of an LU factorisation. |
| Cholesky factorisation attempt | The candidate matrix is symmetric and expected to be positive definite, as with stiffness and covariance matrices. | Half the cost of a general factorisation and it fails cleanly when definiteness is lost, but it certifies more than nonsingularity, so a failure does not by itself prove singularity. |
| Modular arithmetic over a prime field | Certifying nonsingularity of a large exact integer matrix without rational blow-up. | Very fast and exact, but nonsingularity modulo an unlucky prime can differ from nonsingularity over the rationals, so several primes are needed for confidence. |
| Sparse factorisation with fill-reducing ordering | Large network, circuit or finite element matrices where the inverse could never be stored. | Answers the invertibility question and solves systems at a fraction of the dense cost, but the ordering computation is itself substantial and the factors, unlike the matrix, are not sparse for free. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
How the test is actually performed
Production code does not row-reduce to the identity. It computes an LU factorisation with partial pivoting at about operations and inspects the pivots, then estimates the reciprocal condition number at additional cost. Together these deliver the invertibility verdict and a quantitative measure of how safe it is.
Verifying a one-sided product
The theorem permits checking alone, at a cost of operations for the product. In floating point the check compares against a tolerance of order ; a residual far above that indicates an implementation error, while one near it merely reflects rounding.
Extracting the null vector as a diagnostic
When a matrix is found singular, the informative output is not the verdict but the null vector. It is obtained from the reduced form by setting one free variable to unity, or more robustly as the right singular vector belonging to the smallest singular value. In a structural or circuit model that vector names the specific defect.
Hand procedure
For a matrix small enough to reduce by hand, drive it to reduced row-echelon form and compare with ; there is no need to carry an augmented block until invertibility is established. If a zero row appears, stop and read the null space directly from the reduced form rather than restarting with an inversion attempt.
Library conventions on failure
NumPy raises LinAlgError on an exactly singular input to inv, but returns a result with no complaint for a matrix that is merely severely ill-conditioned. MATLAB warns via the reciprocal condition estimate. Neither behaviour should be relied on as a model-validation gate; check the condition number explicitly.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Applying the equivalence to a rectangular matrix | high | Extending nonsingularity and invertibility to non-square matrices, where neither term is defined as stated. | Check the shape first. For rectangular matrices use rank, one-sided inverses or the pseudoinverse, and say which is meant. |
| Confusing a failed algorithm with a proof of non-existence | medium | Concluding from a stalled reduction that no inverse exists, without invoking the equivalence. | Cite the theorem. Nonsingularity is what rules out an inverse, and the failure of one procedure would otherwise leave the question open. |
| Verifying only one product on rectangular operands | high | Carrying the square-matrix shortcut into a setting where a one-sided inverse does not imply the other side. | The one-sided result requires both matrices to be square of the same size. Outside that hypothesis, compute both products or work with the pseudoinverse. |
| Treating near-singularity as nonsingularity | high | Relying on the exact dichotomy when the matrix has a condition number near the reciprocal of machine epsilon. | Report the condition number with every invertibility claim, and set the acceptance threshold from the uncertainty in the input data. |
| Trying to fix a singular system by preconditioning | medium | Expecting a scaling or auxiliary matrix to restore invertibility, contrary to the propagation of singularity through products. | Change the model, add constraints or adopt a least-squares formulation. No multiplication can remove a null vector. |
| Assuming both factors are singular when a product is | low | Reading the implication backwards; a singular product requires at least one singular factor, not both. | State the direction explicitly. The contrapositive is the useful form: if the product is nonsingular then both factors are nonsingular. |
| Solving by explicit inversion once invertibility is known | medium | Reading the formula as an algorithm rather than as a statement about the solution. | Use a factorisation and triangular solves. The formula certifies existence and uniqueness; it is not a recommended computation. |
| Ignoring the null vector when singularity is detected | medium | Reporting only that the matrix is singular, discarding the vector that identifies the mechanism or unobservable mode. | Always extract and report a null space basis; it converts an abstract failure into an actionable design finding. |
FAQs
Why is squareness essential to the one-sided inverse result?
The argument needs a right inverse for , and that is supplied by the reduction procedure only for square nonsingular matrices. For rectangular matrices the two sides are genuinely different: a matrix with full column rank has a left inverse and typically no right inverse, and the sizes of the two identity matrices differ.
Does the equivalence hold over fields other than the complex numbers?
Yes. The arguments use only field arithmetic, so nonsingularity and invertibility coincide over the rationals, the reals, the complex numbers and any finite field. Over a ring such as the integers the statement changes: an integer matrix is invertible over the integers only when its determinant is a unit.
If is singular, must both and be singular?
No — only at least one of them. The theorem says a singular factor forces a singular product; the contrapositive says a nonsingular product forces both factors to be nonsingular. Reading the implication in the wrong direction is a common slip.
How does this change how I check whether a matrix has an inverse?
It lets you test the cheaper condition. Row-reduce alone and compare with , or examine the pivots of an LU factorisation, without ever forming an augmented array. Only after invertibility is confirmed does it make sense to compute the inverse, and even then only if the inverse itself is needed.
What does the null vector of a singular coefficient matrix mean physically?
It is a non-zero pattern of the unknowns that produces no response at all. In a structural model it is a rigid-body or mechanism motion; in a measurement model it is a state change the instrument cannot detect; in a reaction network it is a redundant combination of reactions. It is the most useful single output of a failed invertibility test.
Is the equivalence still meaningful in floating-point arithmetic?
It remains true of the exact matrix, but the exact matrix is rarely what the computer holds. Numerically, invertibility is replaced by a graded question: how close is this matrix to the nearest singular one, as measured by the condition number or the smallest singular value. Design the tolerance from the data, not from the arithmetic.
Why does the proof of the product result split into those particular two cases?
Because the second case is easier with a stronger hypothesis. Assuming nonsingular and singular gives access to the unique solution of , which the argument needs. The first case covers every situation in which is singular regardless of , so together they exhaust the hypothesis.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section MINSM, Subsection NSMI. Licensed under the GNU Free Documentation License v1.2.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Horn, R. A. and Johnson, C. R. Matrix Analysis, 2nd edition. Cambridge University Press, 2012.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
- Higham, N. J. Accuracy and Stability of Numerical Algorithms, 2nd edition. Society for Industrial and Applied Mathematics, 2002.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
AI Suggested Questions
- Give a rectangular matrix with a left inverse but no right inverse, and explain why the one-sided result cannot apply.
- Show how the null vector of a singular stiffness matrix identifies the specific rigid-body mechanism in a planar frame.
- Compare the cost of testing nonsingularity by LU factorisation, by determinant evaluation and by singular value decomposition for .
- Explain why a one-sided inverse does not imply a two-sided inverse for operators on an infinite-dimensional space, with a shift-operator example.
- How should a safety-critical system respond when a model matrix is found to be numerically singular at run time?
- Trace how the equivalence list for nonsingular matrices grows as column spaces, determinants and eigenvalues are introduced.
Related Calculators
Row-reduce a square matrix, report whether it reaches the identity, and return a null space basis when it does not.
Condition Number CalculatorQuantify how far a matrix sits from the nearest singular one and estimate the digits lost in any solve.
Linear System SolverSolve for several right-hand sides, reporting existence and uniqueness for each.
