Engineering/Mathematics/Preliminaries
Equivalences of Nonsingular Matrices
Thirteen apparently unrelated conditions on a square matrix — a trivial null space, a reduction to the identity, independent columns, rank , a non-zero determinant, no zero eigenvalue — turn out to be one condition wearing thirteen costumes. Knowing they are interchangeable means any one of them can be verified and all the others claimed.
- Core level
- Stream: matrix-algebra
- Reading time 17 min
- Ref KVS-ENG-MATH-0124
- Taxonomy
- Engineering / Mathematics
- Applies to
- Square matrices only, size
- Statements
- 13 mutually equivalent conditions
- Theorems packaged
- separate if-and-only-if results
- Cheapest exact test
- Row-reduce and check the result is — about operations
- Negation
- A singular matrix fails all thirteen together
Overview
A square matrix is nonsingular when the homogeneous system has only the zero solution. That is a narrow, almost technical-looking definition, and taken alone it would be unremarkable. What makes it the organising idea of matrix algebra is that it turns out to be equivalent to a long list of conditions expressed in completely different vocabularies: a statement about row reduction, a statement about solution sets, a statement about linear independence, a statement about spanning, two statements about integer-valued invariants, a statement about a single scalar, a statement about the spectrum, and a statement about an associated function.
The list is assembled incrementally. Each time a new structure is introduced — matrix inverses, column spaces, bases, dimension, determinants, eigenvalues, linear transformations — a bridging theorem is proved connecting that structure to nonsingularity, and the list gains one entry. By the end there are thirteen statements. Because a theorem of this form declares every pair equivalent, thirteen statements package separate if-and-only-if theorems, and the whole structure is established with far fewer than 78 proofs by arranging the implications in a chain that closes back on itself.
The engineering value is substitution. A question posed in one vocabulary can be answered in another, and the answering vocabulary can be chosen for cost, for numerical robustness, or for whatever information happens to be available. If a factorisation has already been computed, nonsingularity is free. If the columns are known on physical grounds to be independent — independent load paths, independent measurement directions — then a unique solution for every right-hand side follows without any arithmetic. If a determinant is available symbolically, the parameter values at which a design becomes singular can be solved for directly.
Equally important is what the list says about failure. Because the conditions are equivalent, their negations are equivalent too: a singular matrix does not row-reduce to the identity, has a non-trivial null space, has dependent columns whose span is a proper subspace, has rank below and nullity above zero, has zero determinant, has in its spectrum, and induces a non-invertible transformation. In a physical model these are not seven separate defects but seven readings of one defect — typically a redundant equation, an unconstrained rigid-body motion, or a missing reference datum — and the null space vector usually names it explicitly.
Definition
Nonsingular Matrix
NMA square matrix is nonsingular when the homogeneous system has the zero vector as its only solution. Equivalently, . A square matrix that is not nonsingular is singular, meaning some non-zero vector is annihilated by .
The definition is stated for square matrices only. A rectangular matrix is neither singular nor nonsingular; the terms are undefined for it, even though its null space may well be trivial.
Null Space of a Matrix
NSMFor an matrix , the null space is the set of all solutions of the homogeneous system. It is always a subspace of , and it always contains ; the substance of nonsingularity is that it contains nothing else.
Matrix Inverse
MIA square matrix of size is invertible when there exists a square matrix of size with . Such a is unique when it exists and is written . For square matrices a one-sided inverse is automatically two-sided: alone forces .
The one-sided result is specific to square matrices. A rectangular matrix can possess a right inverse and no left inverse, or the reverse, and never both.
Multiple Equivalences
MEA theorem whose conclusion is a list of statements declared mutually equivalent, so that any two of them may be joined by if and only if. A list of statements therefore asserts distinct theorems. The economical proof strategy is a cycle , after which any desired equivalence is obtained by travelling round the circle.
In practice this list is built the other way: each new statement is attached to statement one by a dedicated bridging theorem, which keeps every addition independently checkable.
Concepts
The thirteen equivalent statements
Suppose is a square matrix of size . The following thirteen statements are equivalent — each one holds precisely when all the others do.
- is nonsingular.
- row-reduces to the identity matrix, .
- The null space of contains only the zero vector, .
- The system has a unique solution for every choice of .
- The columns of form a linearly independent set.
- is invertible.
- The column space of is all of , that is .
- The columns of are a basis for .
- The rank of is , .
- The nullity of is zero, .
- The determinant of is non-zero, .
- is not an eigenvalue of .
- The linear transformation defined by is invertible.
Two details in the wording carry weight. Statement four says every : a singular matrix may still give a unique solution for no at all, but never for every one, and for a particular a singular system has either no solution or infinitely many. Statement seven says the column space is the whole of , not merely large; combined with statement five this is what upgrades the columns from independent to a basis in statement eight.
Four families of statement, and why the traffic between them matters
The thirteen statements fall into four families, and recognising the family a statement belongs to is what makes the list usable rather than merely memorable.
- Solution-set statements — 1, 3, 4. These describe what happens when the matrix is used to solve something. They are the closest to the original engineering question and the reason the concept was isolated in the first place.
- Computational statements — 2, 6. These describe the outcome of an algorithm: elimination terminates at the identity, and the inverse exists. Statement two is the practical test; statement six is the practical payoff.
- Subspace and basis statements — 5, 7, 8, 9, 10. These describe the columns as a set of vectors in : independent, spanning, a basis, and the two integer invariants that record those facts. They connect nonsingularity to the whole apparatus of dimension.
- Scalar and operator statements — 11, 12, 13. These describe the matrix as an object acting on itself and on the space: one number certifies it, the spectrum omits zero, and the induced map is a bijection.
Movement between families is where the leverage lies. A structural argument — these load paths are geometrically independent, these measurement directions are not coplanar — establishes statement five with no arithmetic, and statement four follows immediately: the system is uniquely solvable for every load case. Conversely a numerical elimination establishes statement two, and statement eight follows: the columns may be used as a coordinate system.
How the list is assembled: one bridging theorem at a time
The list grows one statement at a time, and each addition is a separate theorem connecting a newly available structure back to statement one. Reading the sequence is a compressed tour of the whole subject.
- Statements 2, 3, 4 arrive first, from three companion results: nonsingular matrices row reduce to the identity; nonsingular matrices have trivial null spaces; and nonsingular matrices give unique solutions for every vector of constants. Requires: only row reduction and the pivot count.
- Statement 5 arrives with linear independence. A relation of linear dependence among the columns is exactly a non-zero solution of , so independence of the columns and a trivial null space are the same statement in different words. Requires: the interpretation of a matrix-vector product as a linear combination of columns.
- Statement 6 arrives with matrix inverses. One direction is a short computation: if exists and , then . The other direction is constructive — augment with the identity, reduce, and read the inverse off — and needs the fact that a one-sided inverse of a square matrix is two-sided. Requires: matrix multiplication and its associativity.
- Statement 7 arrives with column spaces. If is nonsingular then is solvable for every , and the set of solvable right-hand sides is the column space. Requires: the equivalence of consistency and membership of the column space.
- Statement 8 arrives with bases: independent (statement 5) plus spanning (statement 7) is the definition of a basis. Requires: nothing new beyond the definition.
- Statements 9 and 10 arrive with dimension. The rank is the dimension of the column space, which is exactly when the column space is everything; the nullity is then by rank plus nullity. Requires: rank plus nullity, and the fact that a subspace of of dimension is .
- Statement 11 arrives with determinants: a square matrix is singular if and only if its determinant is zero, and negating both sides gives the equivalence in the form needed here. Requires: the behaviour of the determinant under row operations.
- Statement 12 arrives with eigenvalues. A matrix is singular exactly when some non-zero satisfies , which is precisely the statement that is an eigenvalue. Negate to obtain statement 12. Requires: the definition of an eigenvalue and nothing more — notably not the characteristic polynomial.
- Statement 13 arrives with linear transformations, once the dictionary between a matrix and its induced map is complete: the kernel corresponds to the null space and the range to the column space, so injectivity and surjectivity of correspond to statements 3 and 7. Requires: rank plus nullity for transformations and the correspondence between invertibility and bijectivity.
Every one of these bridging theorems reaches back only to material that does not itself depend on the list. That discipline is what keeps the structure from being circular, and it is worth checking whenever a fourteenth condition is proposed.
The contrapositive list: what a singular matrix looks like
Because the thirteen statements are equivalent, so are their negations, and the singular list is just as useful. For a square matrix of size , the following also stand or fall together.
- is singular; some non-zero satisfies .
- The reduced row-echelon form of has at least one zero row, so it is not .
- ; there are free variables.
- For each , the system has either no solution or infinitely many — never exactly one.
- The columns are dependent: at least one is a linear combination of the others.
- No matrix satisfies , on either side.
- is a proper subspace of , of dimension .
- and .
- , equivalently .
- is an eigenvalue, and the null space is its eigenspace.
- is neither injective nor surjective.
The fourth entry deserves emphasis because it is routinely misread. Singularity does not mean “no solution”. It means the solution count is never one: for right-hand sides inside the column space there are infinitely many solutions, differing by any element of the null space, and for right-hand sides outside it there are none. A design that appears to work because one particular load case produced an answer may still rest on a singular matrix.
Squareness is the hypothesis that makes the list cohere
Squareness is not a convenience in the hypothesis; it is what makes the list cohere. Consider each family against an matrix with .
- A trivial null space is still meaningful and still equivalent to independent columns, but it now forces and says nothing about solvability. A tall matrix with independent columns has no solution for most right-hand sides.
- A full column space is still meaningful and still equivalent to consistency for every , but it forces and permits infinitely many solutions. A wide matrix that spans has a null space of dimension at least.
- The two conditions above coincide only when . That coincidence is the entire content of the theorem: for a square matrix, injectivity and surjectivity of the associated map imply one another, so a single check settles both.
- Determinant, eigenvalue and invertibility statements are not merely false for rectangular matrices, they are undefined. requires equal row and column counts; cannot even be typed unless the input and output live in the same space.
The generalisations that do survive are the rank statements, and they survive in weakened form: characterises independent columns for any shape, and characterises a full column space. Full rank in the sense of gives one of the two properties, never both unless the matrix is square.
Choosing which condition to actually compute
Given thirteen interchangeable conditions, the practical question is which one to compute. Ranked by cost and by robustness they are not at all interchangeable.
- Row reduction to — about operations. The default for exact arithmetic. It answers the question and, if the reduction is performed on , delivers the inverse in the same pass. In floating point the terminal test becomes a tolerance decision on the smallest pivot.
- LU factorisation — about operations. Cheaper than full reduction and reusable across right-hand sides. Nonsingularity appears as the absence of a zero (or unacceptably small) pivot, and the factorisation is normally computed anyway to solve the system.
- Determinant — free once a factorisation exists, being the product of the pivots with a sign for the row interchanges. Excellent as an exact or symbolic certificate; a poor numerical test, because makes the magnitude of a determinant meaningless without a scale.
- Reciprocal condition estimate — about on top of a factorisation. Not one of the thirteen statements, and strictly more informative than all of them in floating point: it measures how far the matrix is from singular rather than whether it happens to be singular exactly.
- Smallest singular value — about to operations. The most defensible numerical answer, since is the exact distance in the spectral norm to the nearest singular matrix. Reserve for cases where the decision matters and the cost is affordable.
- Eigenvalues — iterative, and upwards. Never compute a spectrum merely to check for a zero eigenvalue. Statement 12 is for reasoning, not for testing.
The ordering to remember is that the cheap tests are the structural ones near the top of the list and the expensive tests are the spectral ones near the bottom, while the most useful numerical question — how close to singular — is not on the list at all.
Selecting a nonsingularity test
Equations
The defining condition
EQ-NME-01Statement three, and the definition itself. Every other statement in the list is proved equivalent to this one.
Reduction to the identity
EQ-NME-02Statements two, nine and ten. A square matrix whose reduced form has pivots has no room for a zero row, so the reduced form is forced to be the identity.
Unique solution for every right-hand side
EQ-NME-03Statements four and six together. The universal quantifier is essential: a singular matrix never gives a unique solution for any right-hand side, but the failure is invisible if only one is ever tried.
The columns as a basis
EQ-NME-04Statements five, seven and eight. For exactly vectors in , independence and spanning imply one another, so verifying either one certifies a basis.
Rank plus nullity forces the equivalence
EQ-NME-05The identity that makes statements nine and ten interchangeable, and the reason a square matrix cannot have both a non-trivial null space and a full column space.
Determinant and the zero eigenvalue
EQ-NME-06Statements eleven and twelve, and the reason they are the same statement. The constant term of the characteristic polynomial is the determinant, so a non-zero determinant is exactly the assertion that is not a root.
Equivalences packaged by the theorem
EQ-NME-07The number of distinct if-and-only-if theorems asserted. A cycle of thirteen implications establishes all of them, which is the economy that makes a list of this length worth stating as a single result.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Square matrix | The matrix whose nonsingularity is in question | n x n matrix over C | |
| Size | Common row and column count; also the dimension of the ambient space | positive integer | |
| Identity matrix | Square matrix with ones on the diagonal and zeros elsewhere; the target of the reduction test | n x n matrix | |
| Null space | All solutions of ; trivial exactly when is nonsingular | subspace of C^n | |
| Column space | Span of the columns; equals exactly when is nonsingular | subspace of C^n | |
| Matrix inverse | Unique matrix with ; exists exactly when is nonsingular | n x n matrix | |
| Determinant | Scalar certificate of nonsingularity, non-zero exactly when is nonsingular | complex number | |
| Eigenvalue | Scalar with for some non-zero ; nonsingularity excludes | complex number | |
| Rank | Number of pivot columns of the reduced form; equals exactly when is nonsingular | 0 to n | |
| Induced transformation | The map on ; invertible exactly when is | linear map C^n to C^n |
Worked Numerical Example
Problem statement
A four-node resistive network is analysed by nodal admittance. Compare the floating network, whose conductance matrix is singular, with the same network after one node is tied to earth. Verify several of the thirteen conditions on each and confirm that they agree.
Assemble the floating conductance matrix
Nodes 1 to 4 are joined by unit conductances between the pairs , , and . Nodal analysis gives , where each diagonal entry is the total conductance at a node and each off-diagonal entry is minus the conductance joining two nodes.
Statement 3 fails immediately for the floating network
Every row of sums to zero, because every conductance appears once positively on the diagonal and once negatively off it. Therefore the all-ones vector is annihilated. This is not an arithmetic accident: raising every node potential by the same amount changes no branch voltage and therefore no current. The null space is non-trivial, so is singular.
Confirm the remaining twelve statements fail together
Row reduction gives three pivots, not four, so the reduced form is not (statement 2 fails), the rank is and the nullity is (statements 9 and 10 fail), the columns are dependent and span only a three-dimensional subspace (statements 5, 7, 8 fail), the determinant vanishes (statement 11 fails), and the characteristic polynomial has as a root (statement 12 fails).
Read the spectrum of the singular matrix
The characteristic polynomial factors completely over the integers. The presence of the factor is statement 12 failing, and its eigenspace is precisely the null space found in step two. The three non-zero eigenvalues describe how quickly the three genuine degrees of freedom relax; the zero eigenvalue describes the direction in which nothing happens at all.
Ground one node and re-form the matrix
Tie node 4 to earth through a unit conductance. Only the fourth diagonal entry changes, from to . Physically the reference ambiguity has been removed; algebraically the rows no longer sum to zero, so the all-ones vector is no longer annihilated.
Statements 2, 3, 9 and 10 now hold
Gauss-Jordan elimination on terminates at the identity, so there are four pivot columns, the rank is , the nullity is and the null space is trivial. By the equivalences, the columns are independent, they span , and they are a basis — none of which required a separate calculation.
Statements 6 and 4: the inverse and the unique solution
Reducing produces the inverse in the same pass. Injecting one ampere at node 1 and nothing elsewhere gives a unique node-voltage vector, obtained as the first column of . Substituting back into reproduces the injected current vector exactly, which is the check worth doing.
Statements 11 and 12: the determinant and the spectrum
The determinant is , non-zero as required. Its role in statement 12 is direct: the constant term of the characteristic polynomial equals the determinant, so and is not an eigenvalue. Note that no eigenvalue was computed to establish this — a single determinant settles the whole spectral statement.
The floating network is singular for a reason that is physical rather than numerical: node potentials are defined only up to a common offset, and that offset is exactly the null space direction . No amount of extra precision or regularisation fixes it, and a solver that appears to succeed on such a matrix has silently chosen one member of an infinite family. Grounding one node changes a single diagonal entry, removes the null space, and flips all thirteen conditions simultaneously — the reduced form becomes the identity, the rank rises to four, the determinant becomes , the zero eigenvalue disappears, and every injected-current pattern acquires exactly one node-voltage solution.
Applications & Industry Use
Grounding a network to remove the singularity
A nodal admittance matrix built from conductances alone is always singular, because its rows sum to zero and the potential reference is arbitrary. Fixing a datum node — deleting its row and column, or adding a conductance to earth — removes the null space and makes every injected-current pattern uniquely solvable. Circuit simulators report a singular matrix precisely when this datum is missing or a subnetwork is left floating.
Restraints and rigid-body modes
An unrestrained global stiffness matrix is singular, with a null space spanned by the rigid-body motions — three in plane, six in space. Applying enough supports to eliminate those motions is exactly the act of making the matrix nonsingular, and a solver failure after meshing almost always means a mechanism has been left in the model rather than that the numerics have gone wrong.
Controllability as a nonsingularity statement
For a state-space model of order , the controllability matrix is square and the system is controllable exactly when that matrix is nonsingular. The equivalences let the designer choose the test: full rank from a factorisation, independent columns from a structural argument about the input channels, or a non-zero determinant for a symbolic study of how controllability depends on a design parameter.
Valid transformations and degenerate geometry
A modelling or view transformation must be invertible for the pipeline to run backwards — picking, shadow mapping, normal transformation. Nonsingularity of the linear part is the exact condition, and the sign of its determinant additionally reports whether the transformation preserves orientation. A zero determinant is a collapsed axis: a scale factor set to zero, or three basis directions that have become coplanar.
Invertible key and generator matrices
Classical matrix ciphers and many code constructions require an invertible matrix over a finite ring or field. Over a field the determinant test applies unchanged; over the integers modulo a composite it must be strengthened, since invertibility requires the determinant to be a unit rather than merely non-zero. Maximum distance separable codes go further and demand that every square submatrix be nonsingular.
Datum defect in an adjustment network
A least-squares adjustment of observed distances and angles produces a normal-equation matrix that is singular whenever the observations are insensitive to some global transformation of the network. The null space names the defect — translation, rotation or scale — and removing it requires either fixing control points or imposing minimal constraints, both of which restore nonsingularity by construction.
Design Considerations
Match the test to the arithmetic
In exact arithmetic all thirteen statements are genuinely interchangeable and the cheapest is correct. In floating point they diverge: reduction to the identity becomes a judgement about the smallest pivot, and a determinant of tells you nothing until you know the scale of the matrix. Decide which arithmetic you are in before choosing a condition to check.
Nonsingular does not mean numerically safe
A matrix can satisfy every one of the thirteen conditions exactly and still be useless in practice. What governs the accuracy of a computed solution is the condition number , not the mere existence of an inverse. Expect to lose roughly as many significant decimal digits as the base-ten logarithm of , and report a condition estimate alongside any nonsingularity claim in production work.
Never scale a determinant to a threshold
Because , multiplying a matrix by divides the determinant of a matrix by without changing its conditioning at all. Any test of the form “singular if ” is therefore a unit-dependent artefact. Use a reciprocal condition estimate or the smallest singular value.
Do not form the inverse to solve a system
Statement six guarantees exists; it does not recommend computing it. Solving by factorisation and substitution costs about a third of the work of inverting, and is more accurate. Explicit inverses are justified when the matrix itself is the deliverable — a covariance, a compliance matrix, an analytic sensitivity — not as a step towards a solution vector.
Prefer to remove a singularity in the model, not the algebra
When a matrix comes out singular, the null space almost always has a physical name: an unconstrained rigid-body mode, an undefined potential datum, a redundant equation, an unobservable state. Adding a restraint, a reference node or an independent measurement fixes the cause. Adding a small multiple of the identity to force nonsingularity fixes only the symptom, and silently biases every subsequent result.
Structural nonsingularity is not numerical nonsingularity
Sparse direct solvers first perform a symbolic analysis that assumes every stored entry is non-zero, giving a structural rank. A matrix can be structurally full rank and numerically singular because of exact cancellation among the stored values. Treat a successful symbolic phase as a necessary condition only, and check the pivots produced by the numerical phase.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Prescribes the notation used throughout this list: upright as an operator, for the identity, for the inverse, and the distinction between the matrix and its determinant. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Explains why the exact equivalences degrade in computation. Rounding turns an exactly zero pivot into a small non-zero one, so the reduction test and the determinant test become threshold decisions whose outcome depends on the rounding mode and the operation order. |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Defines the industrial answer to this question. xGETRF reports the index of the first exactly zero pivot, and xGECON returns a reciprocal condition estimate, which is the quantity practitioners use in place of a yes-or-no nonsingularity test. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes each of the thirteen statements as structured mathematics rather than an image, so the list remains machine-readable and individual conditions can be extracted and compared programmatically. |
W3C WCAG 2.1 AA | Web Content Accessibility Guidelines | Requires that a numbered list of equivalent conditions is exposed as a real ordered list with semantic mathematics, so that assistive technology can enumerate the statements and read each matrix aloud rather than announcing an image. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational or integer arithmetic | Small to moderate matrices with exact entries where the answer must be definitive: symbolic studies, certification evidence, textbook verification. | All thirteen statements hold exactly and any of them may be used. Intermediate fractions can grow rapidly under naive elimination; a fraction-free algorithm keeps the determinant path integral throughout. |
| IEEE 754 binary64 with a condition estimate | The default for engineering computation, where the entries already carry measurement or modelling uncertainty. | Fast and well supported, but the exact question is replaced by a quantitative one. Report the reciprocal condition number rather than a boolean, and treat any matrix with as effectively singular in double precision. |
| IEEE 754 binary32 | Embedded targets, real-time control loops and GPU kernels where memory bandwidth dominates. | Halves storage and traffic but leaves about seven significant decimal digits, so a matrix with condition number above roughly already loses most of its accuracy. Consider iterative refinement in higher precision if the decision matters. |
| Fixed-point arithmetic | Hardware without a floating-point unit, or safety-critical code requiring deterministic, bit-exact behaviour. | Range must be analysed in advance for every intermediate quantity. Determinants overflow catastrophically as grows, so nonsingularity should be tested by monitoring pivot magnitudes during elimination rather than by any single scalar. |
| Finite field, | Coding theory, cryptography, and modular certification of nonsingularity over the rationals. | Exact, fast and free of growth in operand size, and all thirteen statements transfer without change except that eigenvalues may require an extension field. A poorly chosen prime can make a rationally nonsingular matrix appear singular. |
| Integers modulo a composite, | Classical matrix ciphers and lattice constructions where the modulus is not prime. | The equivalences require restatement: invertibility needs to be a unit, that is , which is strictly stronger than . Assuming the field version here is a genuine correctness bug. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of each condition
Reduction to the identity costs about operations; an LU factorisation about ; the determinant is then the product of the pivots, essentially free, or if computed by cofactor expansion. Forming the explicit inverse costs about . A reciprocal condition estimate adds to an existing factorisation. Computing the full spectrum to check for a zero eigenvalue costs or more and is never the right choice.
The hand procedure and what it yields
Augment with the identity to form and reduce. If the left block reaches , the matrix is nonsingular and the right block is ; if a zero row appears in the left block, the matrix is singular and the reduction can be stopped at once. A single pass therefore settles statements 1, 2, 3, 6, 9 and 10 together.
How libraries actually report the answer
numpy.linalg.inv and numpy.linalg.solve raise LinAlgError only on an exactly zero pivot, which almost never occurs on rounded data; a nearly singular matrix returns a large, wrong answer silently. MATLAB emits a near-singularity warning based on rcond. LAPACK's xGETRF returns the index of the offending pivot. Treat the absence of an exception as no evidence at all and check the condition estimate explicitly.Verification after the fact
For an inverse, form and measure relative to the unit round-off and the condition number; a residual far above indicates a bug rather than rounding. For a solution vector, compute the residual against the original matrix. For an exact-arithmetic claim of nonsingularity, an independent determinant computed by a different algorithm is a cheap cross-check.
Certifying nonsingularity modulo a prime
For a large integer matrix, reducing modulo a randomly chosen prime and eliminating in fixed-width arithmetic is far cheaper than exact rational elimination. A non-zero determinant modulo proves the rational matrix is nonsingular outright; a zero result is inconclusive, since may divide the true determinant, so repeat with further primes. This converts an expensive exact computation into a fast one-sided certificate.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Applying the list to a rectangular matrix | high | Calling an matrix with singular or nonsingular, usually after an unnoticed shape change or a least-squares problem being treated as a square system. | Assert squareness before invoking any statement. For rectangular matrices ask about relative to and , which separates independent columns from a full column space. |
| Using a small determinant as a singularity test | high | Thresholding in floating point, ignoring that the determinant scales as the -th power of any rescaling of the matrix. | Use a reciprocal condition estimate or the smallest singular value. Keep the determinant for exact, symbolic and low-dimensional work where it is a genuine certificate. |
| Equating nonsingular with numerically well behaved | high | Reading statement six as a guarantee of a usable answer, when invertibility says nothing about how far the matrix is from the singular set. | Report a condition number with every solve. Budget a loss of about as many significant digits as the base-ten logarithm of , and compare that against the precision of the input data. |
| Concluding nonsingularity from one right-hand side | medium | Observing that produced an answer for one particular and inferring statement four, which quantifies over all . | Test the homogeneous system instead. having only the zero solution is a single computation that settles the universal statement. |
| Assuming a non-zero determinant gives invertibility over a ring | medium | Carrying the field version of statement eleven into arithmetic modulo a composite, or into the integers, where invertibility requires the determinant to be a unit. | Over require ; over require for an integer inverse. Only over a field is sufficient. |
| Forming the explicit inverse to solve a system | medium | Translating from the page into code literally. | Factorise once and substitute. It is roughly three times cheaper and measurably more accurate, and it reuses cleanly across multiple right-hand sides. |
| Regularising away a structural singularity | medium | Adding or a small diagonal perturbation to make a solver succeed on a matrix that is singular for a physical reason. | Compute a null space basis and identify what it represents. A rigid-body mode, a floating reference or an unobservable direction should be fixed in the model, not masked in the algebra. |
| Trusting a structural rank from a symbolic analysis | low | Relying on a sparse solver's symbolic phase, which assumes every stored entry is non-zero, to certify nonsingularity. | Treat structural full rank as necessary but not sufficient. Inspect the pivot magnitudes produced by the numerical factorisation before accepting the result. |
FAQs
Why state thirteen conditions instead of just defining an invertible matrix?
Because the conditions arise naturally in different contexts and are not obviously related. An engineer asking whether a load case has a unique solution, a numerical analyst asking whether elimination terminates at the identity, and a geometer asking whether a set of directions spans are asking the same question in three vocabularies. The theorem is what licenses the translation, and it is the translation, not any single statement, that carries the value.
How many separate theorems does this single result contain?
Seventy-eight. A list of mutually equivalent statements asserts if-and-only-if theorems, and . The whole set is established by a cycle of implications rather than by proving each pair, which is why a result of this size is practical to prove at all.
Is a one-sided inverse enough for a square matrix?
Yes. If and are square of the same size and , then follows automatically, so is the genuine two-sided inverse. This is emphatically false for rectangular matrices: a wide matrix can have a right inverse and no left inverse. The square case is another instance of injectivity and surjectivity implying one another.
Which of the conditions should I actually compute?
In exact arithmetic, row-reduce and check for — it costs about operations and yields the inverse for free if you augment with the identity. In floating point, use the LU factorisation you are computing anyway and inspect its pivots, then report a reciprocal condition estimate. Never compute a determinant or a spectrum solely to answer this question.
Does the list survive over the real numbers rather than the complex numbers?
Yes, all thirteen statements remain equivalent over , and indeed over any field. Statement twelve is safe because it is a negative statement: asserting that is not an eigenvalue requires no guarantee that any eigenvalue exists. What fails over is the separate guarantee that a square matrix has an eigenvalue at all, which this list never uses.
My matrix is singular. What should I do?
Compute a basis for the null space and interpret it. In a structural model it will be a rigid-body motion; in a network it will be an undetermined reference level; in an estimation problem it will be an unidentifiable parameter combination. Fix the underlying model by adding the missing restraint, datum or observation. Only if the deficiency is genuinely intrinsic should you move to a pseudoinverse or a regularised solution, and then state which one you used.
Can I add a fourteenth condition of my own?
Yes, provided you prove it equivalent to one existing statement using results that do not themselves depend on the list. Common additions include a non-zero product of eigenvalues, non-zero singular values throughout, a trivial left null space, and being nonsingular. Each is a short proof, and each must be checked for circularity before it is admitted.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Sections NSM, LI, MINSM, CRS, B, D, DM, PEE and MR — the nine successive rounds of the nonsingular matrix equivalences. Licensed under the GNU Free Documentation License v1.2.
- Horn, R. A. and Johnson, C. R. Matrix Analysis, 2nd edition. Cambridge University Press, 2012.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013. Condition estimation and the numerical meaning of near-singularity.
- Higham, N. J. Accuracy and Stability of Numerical Algorithms, 2nd edition. Society for Industrial and Applied Mathematics, 2002.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
AI Suggested Questions
- Give me a 5x5 integer matrix that is nonsingular but has condition number above 10^10, and show how each of the thirteen conditions behaves in double precision.
- Walk through the cycle of implications that proves all thirteen statements equivalent using only thirteen proofs rather than seventy-eight.
- Which statements in this list fail, and which need restatement, when the entries are drawn from the integers modulo 26 rather than a field?
- Show me the null space of an unrestrained two-dimensional truss stiffness matrix and identify each basis vector as a specific rigid-body motion.
- Compare the operation count and the numerical reliability of testing nonsingularity by RREF, by LU pivots, by determinant and by smallest singular value for n = 1000.
- Propose three additional conditions equivalent to nonsingularity involving the adjoint, the singular values and the left null space, and prove each without using the list itself.
Related Calculators
Test a square matrix against every condition in the list and report which hold, with the supporting rank, determinant and null space.
Matrix Inverse CalculatorInvert a square matrix by augmented reduction, showing each row operation and flagging singularity the moment a zero row appears.
Determinant CalculatorCompute a determinant exactly by fraction-free elimination or numerically from an LU factorisation, with the pivot sequence shown.
Condition Number CalculatorEstimate and the smallest singular value to quantify how close a nonsingular matrix is to being singular.
