← LibraryEquivalences of Nonsingular Matrices | KEVOS® MathematicsProject Delivery · Project ManagementLesson 61/189← PrevNext →
ArticlePublished 8 Aug 202633 min readBy Kevin Jogin
Skip to content

Engineering/Mathematics/Preliminaries

Equivalences of Nonsingular Matrices

Thirteen apparently unrelated conditions on a square matrix — a trivial null space, a reduction to the identity, independent columns, rank n, a non-zero determinant, no zero eigenvalue — turn out to be one condition wearing thirteen costumes. Knowing they are interchangeable means any one of them can be verified and all the others claimed.

  • Core level
  • Stream: matrix-algebra
  • Reading time 17 min
  • Ref KVS-ENG-MATH-0124
Taxonomy
Engineering / Mathematics
Applies to
Square matrices only, size n×n
Statements
13 mutually equivalent conditions
Theorems packaged
(132)=78 separate if-and-only-if results
Cheapest exact test
Row-reduce and check the result is In — about n3 operations
Negation
A singular matrix fails all thirteen together

Overview

A square matrix is nonsingular when the homogeneous system Ax=0 has only the zero solution. That is a narrow, almost technical-looking definition, and taken alone it would be unremarkable. What makes it the organising idea of matrix algebra is that it turns out to be equivalent to a long list of conditions expressed in completely different vocabularies: a statement about row reduction, a statement about solution sets, a statement about linear independence, a statement about spanning, two statements about integer-valued invariants, a statement about a single scalar, a statement about the spectrum, and a statement about an associated function.

The list is assembled incrementally. Each time a new structure is introduced — matrix inverses, column spaces, bases, dimension, determinants, eigenvalues, linear transformations — a bridging theorem is proved connecting that structure to nonsingularity, and the list gains one entry. By the end there are thirteen statements. Because a theorem of this form declares every pair equivalent, thirteen statements package (132)=78 separate if-and-only-if theorems, and the whole structure is established with far fewer than 78 proofs by arranging the implications in a chain that closes back on itself.

The engineering value is substitution. A question posed in one vocabulary can be answered in another, and the answering vocabulary can be chosen for cost, for numerical robustness, or for whatever information happens to be available. If a factorisation has already been computed, nonsingularity is free. If the columns are known on physical grounds to be independent — independent load paths, independent measurement directions — then a unique solution for every right-hand side follows without any arithmetic. If a determinant is available symbolically, the parameter values at which a design becomes singular can be solved for directly.

Equally important is what the list says about failure. Because the conditions are equivalent, their negations are equivalent too: a singular matrix does not row-reduce to the identity, has a non-trivial null space, has dependent columns whose span is a proper subspace, has rank below n and nullity above zero, has zero determinant, has 0 in its spectrum, and induces a non-invertible transformation. In a physical model these are not seven separate defects but seven readings of one defect — typically a redundant equation, an unconstrained rigid-body motion, or a missing reference datum — and the null space vector usually names it explicitly.

Definition

Nonsingular Matrix

NM

A square matrix A is nonsingular when the homogeneous system Ax=0 has the zero vector as its only solution. Equivalently, N(A)={0}. A square matrix that is not nonsingular is singular, meaning some non-zero vector is annihilated by A.

The definition is stated for square matrices only. A rectangular matrix is neither singular nor nonsingular; the terms are undefined for it, even though its null space may well be trivial.

Null Space of a Matrix

NSM

For an m×n matrix A, the null space N(A)={xnAx=0} is the set of all solutions of the homogeneous system. It is always a subspace of n, and it always contains 0; the substance of nonsingularity is that it contains nothing else.

Matrix Inverse

MI

A square matrix A of size n is invertible when there exists a square matrix B of size n with AB=BA=In. Such a B is unique when it exists and is written A1. For square matrices a one-sided inverse is automatically two-sided: AB=In alone forces BA=In.

The one-sided result is specific to square matrices. A rectangular matrix can possess a right inverse and no left inverse, or the reverse, and never both.

Multiple Equivalences

ME

A theorem whose conclusion is a list of statements declared mutually equivalent, so that any two of them may be joined by if and only if. A list of k statements therefore asserts (k2) distinct theorems. The economical proof strategy is a cycle P1P2PkP1, after which any desired equivalence is obtained by travelling round the circle.

In practice this list is built the other way: each new statement is attached to statement one by a dedicated bridging theorem, which keeps every addition independently checkable.

Concepts

The thirteen equivalent statements

Suppose A is a square matrix of size n. The following thirteen statements are equivalent — each one holds precisely when all the others do.

  1. A is nonsingular.
  2. A row-reduces to the identity matrix, RREF(A)=In.
  3. The null space of A contains only the zero vector, N(A)={0}.
  4. The system Ax=b has a unique solution for every choice of b.
  5. The columns of A form a linearly independent set.
  6. A is invertible.
  7. The column space of A is all of n, that is C(A)=n.
  8. The columns of A are a basis for n.
  9. The rank of A is n, rank(A)=n.
  10. The nullity of A is zero, nullity(A)=0.
  11. The determinant of A is non-zero, det(A)0.
  12. λ=0 is not an eigenvalue of A.
  13. The linear transformation T:nn defined by T(x)=Ax is invertible.

Two details in the wording carry weight. Statement four says every b: a singular matrix may still give a unique solution for no b at all, but never for every one, and for a particular b a singular system has either no solution or infinitely many. Statement seven says the column space is the whole of n, not merely large; combined with statement five this is what upgrades the columns from independent to a basis in statement eight.

Four families of statement, and why the traffic between them matters

The thirteen statements fall into four families, and recognising the family a statement belongs to is what makes the list usable rather than merely memorable.

  • Solution-set statements — 1, 3, 4. These describe what happens when the matrix is used to solve something. They are the closest to the original engineering question and the reason the concept was isolated in the first place.
  • Computational statements — 2, 6. These describe the outcome of an algorithm: elimination terminates at the identity, and the inverse exists. Statement two is the practical test; statement six is the practical payoff.
  • Subspace and basis statements — 5, 7, 8, 9, 10. These describe the columns as a set of vectors in n: independent, spanning, a basis, and the two integer invariants that record those facts. They connect nonsingularity to the whole apparatus of dimension.
  • Scalar and operator statements — 11, 12, 13. These describe the matrix as an object acting on itself and on the space: one number certifies it, the spectrum omits zero, and the induced map is a bijection.

Movement between families is where the leverage lies. A structural argument — these load paths are geometrically independent, these measurement directions are not coplanar — establishes statement five with no arithmetic, and statement four follows immediately: the system is uniquely solvable for every load case. Conversely a numerical elimination establishes statement two, and statement eight follows: the columns may be used as a coordinate system.

How the list is assembled: one bridging theorem at a time

The list grows one statement at a time, and each addition is a separate theorem connecting a newly available structure back to statement one. Reading the sequence is a compressed tour of the whole subject.

  • Statements 2, 3, 4 arrive first, from three companion results: nonsingular matrices row reduce to the identity; nonsingular matrices have trivial null spaces; and nonsingular matrices give unique solutions for every vector of constants. Requires: only row reduction and the pivot count.
  • Statement 5 arrives with linear independence. A relation of linear dependence among the columns is exactly a non-zero solution of Ax=0, so independence of the columns and a trivial null space are the same statement in different words. Requires: the interpretation of a matrix-vector product as a linear combination of columns.
  • Statement 6 arrives with matrix inverses. One direction is a short computation: if A1 exists and Ax=0, then x=A1Ax=A10=0. The other direction is constructive — augment with the identity, reduce, and read the inverse off — and needs the fact that a one-sided inverse of a square matrix is two-sided. Requires: matrix multiplication and its associativity.
  • Statement 7 arrives with column spaces. If A is nonsingular then Ax=b is solvable for every b, and the set of solvable right-hand sides is the column space. Requires: the equivalence of consistency and membership of the column space.
  • Statement 8 arrives with bases: independent (statement 5) plus spanning (statement 7) is the definition of a basis. Requires: nothing new beyond the definition.
  • Statements 9 and 10 arrive with dimension. The rank is the dimension of the column space, which is n exactly when the column space is everything; the nullity is then nn=0 by rank plus nullity. Requires: rank plus nullity, and the fact that a subspace of n of dimension n is n.
  • Statement 11 arrives with determinants: a square matrix is singular if and only if its determinant is zero, and negating both sides gives the equivalence in the form needed here. Requires: the behaviour of the determinant under row operations.
  • Statement 12 arrives with eigenvalues. A matrix is singular exactly when some non-zero x satisfies Ax=0=0x, which is precisely the statement that 0 is an eigenvalue. Negate to obtain statement 12. Requires: the definition of an eigenvalue and nothing more — notably not the characteristic polynomial.
  • Statement 13 arrives with linear transformations, once the dictionary between a matrix and its induced map is complete: the kernel corresponds to the null space and the range to the column space, so injectivity and surjectivity of T correspond to statements 3 and 7. Requires: rank plus nullity for transformations and the correspondence between invertibility and bijectivity.

Every one of these bridging theorems reaches back only to material that does not itself depend on the list. That discipline is what keeps the structure from being circular, and it is worth checking whenever a fourteenth condition is proposed.

The contrapositive list: what a singular matrix looks like

Because the thirteen statements are equivalent, so are their negations, and the singular list is just as useful. For a square matrix A of size n, the following also stand or fall together.

  • A is singular; some non-zero x satisfies Ax=0.
  • The reduced row-echelon form of A has at least one zero row, so it is not In.
  • dim(N(A))1; there are free variables.
  • For each b, the system Ax=b has either no solution or infinitely many — never exactly one.
  • The columns are dependent: at least one is a linear combination of the others.
  • No matrix B satisfies AB=In, on either side.
  • C(A) is a proper subspace of n, of dimension r<n.
  • rank(A)<n and nullity(A)>0.
  • det(A)=0, equivalently pA(0)=0.
  • λ=0 is an eigenvalue, and the null space is its eigenspace.
  • T(x)=Ax is neither injective nor surjective.

The fourth entry deserves emphasis because it is routinely misread. Singularity does not mean “no solution”. It means the solution count is never one: for right-hand sides inside the column space there are infinitely many solutions, differing by any element of the null space, and for right-hand sides outside it there are none. A design that appears to work because one particular load case produced an answer may still rest on a singular matrix.

Squareness is the hypothesis that makes the list cohere

Squareness is not a convenience in the hypothesis; it is what makes the list cohere. Consider each family against an m×n matrix with mn.

  • A trivial null space is still meaningful and still equivalent to independent columns, but it now forces mn and says nothing about solvability. A tall matrix with independent columns has no solution for most right-hand sides.
  • A full column space is still meaningful and still equivalent to consistency for every b, but it forces mn and permits infinitely many solutions. A wide matrix that spans has a null space of dimension nm at least.
  • The two conditions above coincide only when m=n. That coincidence is the entire content of the theorem: for a square matrix, injectivity and surjectivity of the associated map imply one another, so a single check settles both.
  • Determinant, eigenvalue and invertibility statements are not merely false for rectangular matrices, they are undefined. det requires equal row and column counts; Ax=λx cannot even be typed unless the input and output live in the same space.

The generalisations that do survive are the rank statements, and they survive in weakened form: rank(A)=n characterises independent columns for any shape, and rank(A)=m characterises a full column space. Full rank in the sense of rank(A)=min(m,n) gives one of the two properties, never both unless the matrix is square.

Choosing which condition to actually compute

Given thirteen interchangeable conditions, the practical question is which one to compute. Ranked by cost and by robustness they are not at all interchangeable.

  • Row reduction to In — about n3 operations. The default for exact arithmetic. It answers the question and, if the reduction is performed on [AIn], delivers the inverse in the same pass. In floating point the terminal test becomes a tolerance decision on the smallest pivot.
  • LU factorisation — about 23n3 operations. Cheaper than full reduction and reusable across right-hand sides. Nonsingularity appears as the absence of a zero (or unacceptably small) pivot, and the factorisation is normally computed anyway to solve the system.
  • Determinant — free once a factorisation exists, being the product of the pivots with a sign for the row interchanges. Excellent as an exact or symbolic certificate; a poor numerical test, because det(cA)=cndet(A) makes the magnitude of a determinant meaningless without a scale.
  • Reciprocal condition estimate — about O(n2) on top of a factorisation. Not one of the thirteen statements, and strictly more informative than all of them in floating point: it measures how far the matrix is from singular rather than whether it happens to be singular exactly.
  • Smallest singular value — about 10n3 to 20n3 operations. The most defensible numerical answer, since σmin is the exact distance in the spectral norm to the nearest singular matrix. Reserve for cases where the decision matters and the cost is affordable.
  • Eigenvalues — iterative, 10n3 and upwards. Never compute a spectrum merely to check for a zero eigenvalue. Statement 12 is for reasoning, not for testing.

The ordering to remember is that the cheap tests are the structural ones near the top of the list and the expensive tests are the spectral ones near the bottom, while the most useful numerical question — how close to singular — is not on the list at all.

Selecting a nonsingularity test

Confirm the matrix is squareIf A is not n×n, none of the thirteen statements applies. Ask instead about rank(A) relative to m and n, which is the shape-agnostic replacement.
Is a structural argument available?If the columns are known on physical or geometric grounds to be independent — distinct load paths, non-coplanar measurement axes, a grounded reference node — statement five is established with no arithmetic and the remaining twelve follow.
Is the arithmetic exact?With rational or integer entries, row-reduce and compare with In, or compute the determinant by fraction-free elimination. Both give a definitive yes or no with no tolerance to choose.
Is a factorisation already being computed?If the system is being solved anyway, the LU factorisation already answers the question: a zero or negligible pivot is exactly a singular matrix. Do not perform a second, separate test.
Does the decision matter numerically?In floating point, replace the exact question with a quantitative one. Compute a reciprocal condition estimate for a cheap answer, or the smallest singular value for the distance to the nearest singular matrix.
If singular, read the null spaceA basis for N(A) names the defect: a rigid-body motion, an undetermined reference level, a redundant equation or an unobservable state direction. Fixing the model is usually cheaper than regularising the algebra.

Equations

The defining condition

EQ-NME-01
N(A)={xnAx=0}={0}

Statement three, and the definition itself. Every other statement in the list is proved equivalent to this one.

Reduction to the identity

EQ-NME-02
RREF(A)=Inrank(A)=nnullity(A)=0

Statements two, nine and ten. A square matrix whose reduced form has n pivots has no room for a zero row, so the reduced form is forced to be the identity.

Unique solution for every right-hand side

EQ-NME-03
bn,Ax=bx=A1b

Statements four and six together. The universal quantifier is essential: a singular matrix never gives a unique solution for any right-hand side, but the failure is invisible if only one b is ever tried.

The columns as a basis

EQ-NME-04
C(A)=n,dim(C(A))=n,{A1,A2,,An}independent

Statements five, seven and eight. For exactly n vectors in n, independence and spanning imply one another, so verifying either one certifies a basis.

Rank plus nullity forces the equivalence

EQ-NME-05
rank(A)+nullity(A)=n

The identity that makes statements nine and ten interchangeable, and the reason a square matrix cannot have both a non-trivial null space and a full column space.

Determinant and the zero eigenvalue

EQ-NME-06
pA(0)=det(A0In)=det(A)0

Statements eleven and twelve, and the reason they are the same statement. The constant term of the characteristic polynomial is the determinant, so a non-zero determinant is exactly the assertion that 0 is not a root.

Equivalences packaged by the theorem

EQ-NME-07
(132)=13122=78

The number of distinct if-and-only-if theorems asserted. A cycle of thirteen implications establishes all of them, which is the economy that makes a list of this length worth stating as a single result.

Variable Definitions

Symbols used on this page
SymbolNameMeaningDomain / type
ASquare matrixThe n×n matrix whose nonsingularity is in questionn x n matrix over C
nSizeCommon row and column count; also the dimension of the ambient space npositive integer
InIdentity matrixSquare matrix with ones on the diagonal and zeros elsewhere; the target of the reduction testn x n matrix
N(A)Null spaceAll solutions of Ax=0; trivial exactly when A is nonsingularsubspace of C^n
C(A)Column spaceSpan of the columns; equals n exactly when A is nonsingularsubspace of C^n
A1Matrix inverseUnique matrix with AA1=A1A=In; exists exactly when A is nonsingularn x n matrix
det(A)DeterminantScalar certificate of nonsingularity, non-zero exactly when A is nonsingularcomplex number
λEigenvalueScalar with Ax=λx for some non-zero x; nonsingularity excludes λ=0complex number
rRankNumber of pivot columns of the reduced form; equals n exactly when A is nonsingular0 to n
TInduced transformationThe map T(x)=Ax on n; invertible exactly when A islinear map C^n to C^n

Worked Numerical Example

Problem statement

A four-node resistive network is analysed by nodal admittance. Compare the floating network, whose conductance matrix is singular, with the same network after one node is tied to earth. Verify several of the thirteen conditions on each and confirm that they agree.

  1. Assemble the floating conductance matrix

    Nodes 1 to 4 are joined by unit conductances between the pairs (1,2), (1,3), (2,3) and (3,4). Nodal analysis gives Lv=i, where each diagonal entry is the total conductance at a node and each off-diagonal entry is minus the conductance joining two nodes.

    L=[2110121011310011]
  2. Statement 3 fails immediately for the floating network

    Every row of L sums to zero, because every conductance appears once positively on the diagonal and once negatively off it. Therefore the all-ones vector is annihilated. This is not an arithmetic accident: raising every node potential by the same amount changes no branch voltage and therefore no current. The null space is non-trivial, so L is singular.

    L[1111]=[0000],v0
  3. Confirm the remaining twelve statements fail together

    Row reduction gives three pivots, not four, so the reduced form is not I4 (statement 2 fails), the rank is 3<4 and the nullity is 1>0 (statements 9 and 10 fail), the columns are dependent and span only a three-dimensional subspace (statements 5, 7, 8 fail), the determinant vanishes (statement 11 fails), and the characteristic polynomial has 0 as a root (statement 12 fails).

    RREF(L)=[1001010100110000],det(L)=0
  4. Read the spectrum of the singular matrix

    The characteristic polynomial factors completely over the integers. The presence of the factor x is statement 12 failing, and its eigenspace is precisely the null space found in step two. The three non-zero eigenvalues describe how quickly the three genuine degrees of freedom relax; the zero eigenvalue describes the direction in which nothing happens at all.

    pL(x)=det(LxI4)=x48x3+19x212x=x(x1)(x3)(x4)
  5. Ground one node and re-form the matrix

    Tie node 4 to earth through a unit conductance. Only the fourth diagonal entry changes, from 1 to 2. Physically the reference ambiguity has been removed; algebraically the rows no longer sum to zero, so the all-ones vector is no longer annihilated.

    A=[2110121011310012]
  6. Statements 2, 3, 9 and 10 now hold

    Gauss-Jordan elimination on A terminates at the identity, so there are four pivot columns, the rank is 4, the nullity is 0 and the null space is trivial. By the equivalences, the columns are independent, they span 4, and they are a basis — none of which required a separate calculation.

    RREF(A)=I4,rank(A)=4,nullity(A)=0
  7. Statements 6 and 4: the inverse and the unique solution

    Reducing [AI4] produces the inverse in the same pass. Injecting one ampere at node 1 and nothing elsewhere gives a unique node-voltage vector, obtained as the first column of A1. Substituting back into Av reproduces the injected current vector exactly, which is the check worth doing.

    A1=13[8763786366633333],v=A1[1000]=[8/37/321]
  8. Statements 11 and 12: the determinant and the spectrum

    The determinant is 3, non-zero as required. Its role in statement 12 is direct: the constant term of the characteristic polynomial equals the determinant, so pA(0)=30 and 0 is not an eigenvalue. Note that no eigenvalue was computed to establish this — a single determinant settles the whole spectral statement.

    det(A)=3,pA(x)=x49x3+26x225x+3,pA(0)=30
Result

The floating network is singular for a reason that is physical rather than numerical: node potentials are defined only up to a common offset, and that offset is exactly the null space direction [1,1,1,1]t. No amount of extra precision or regularisation fixes it, and a solver that appears to succeed on such a matrix has silently chosen one member of an infinite family. Grounding one node changes a single diagonal entry, removes the null space, and flips all thirteen conditions simultaneously — the reduced form becomes the identity, the rank rises to four, the determinant becomes 3, the zero eigenvalue disappears, and every injected-current pattern acquires exactly one node-voltage solution.

Applications &amp; Industry Use

Electrical engineering

Grounding a network to remove the singularity

A nodal admittance matrix built from conductances alone is always singular, because its rows sum to zero and the potential reference is arbitrary. Fixing a datum node — deleting its row and column, or adding a conductance to earth — removes the null space and makes every injected-current pattern uniquely solvable. Circuit simulators report a singular matrix precisely when this datum is missing or a subnetwork is left floating.

Structural engineering

Restraints and rigid-body modes

An unrestrained global stiffness matrix is singular, with a null space spanned by the rigid-body motions — three in plane, six in space. Applying enough supports to eliminate those motions is exactly the act of making the matrix nonsingular, and a solver failure after meshing almost always means a mechanism has been left in the model rather than that the numerics have gone wrong.

Control systems

Controllability as a nonsingularity statement

For a state-space model of order n, the controllability matrix is square and the system is controllable exactly when that matrix is nonsingular. The equivalences let the designer choose the test: full rank from a factorisation, independent columns from a structural argument about the input channels, or a non-zero determinant for a symbolic study of how controllability depends on a design parameter.

Computer graphics and CAD

Valid transformations and degenerate geometry

A modelling or view transformation must be invertible for the pipeline to run backwards — picking, shadow mapping, normal transformation. Nonsingularity of the linear part is the exact condition, and the sign of its determinant additionally reports whether the transformation preserves orientation. A zero determinant is a collapsed axis: a scale factor set to zero, or three basis directions that have become coplanar.

Cryptography and coding theory

Invertible key and generator matrices

Classical matrix ciphers and many code constructions require an invertible matrix over a finite ring or field. Over a field the determinant test applies unchanged; over the integers modulo a composite it must be strengthened, since invertibility requires the determinant to be a unit rather than merely non-zero. Maximum distance separable codes go further and demand that every square submatrix be nonsingular.

Geodesy and surveying

Datum defect in an adjustment network

A least-squares adjustment of observed distances and angles produces a normal-equation matrix that is singular whenever the observations are insensitive to some global transformation of the network. The null space names the defect — translation, rotation or scale — and removing it requires either fixing control points or imposing minimal constraints, both of which restore nonsingularity by construction.

Design Considerations

Match the test to the arithmetic

In exact arithmetic all thirteen statements are genuinely interchangeable and the cheapest is correct. In floating point they diverge: reduction to the identity becomes a judgement about the smallest pivot, and a determinant of 1014 tells you nothing until you know the scale of the matrix. Decide which arithmetic you are in before choosing a condition to check.

Nonsingular does not mean numerically safe

A matrix can satisfy every one of the thirteen conditions exactly and still be useless in practice. What governs the accuracy of a computed solution is the condition number κ(A)=AA1, not the mere existence of an inverse. Expect to lose roughly as many significant decimal digits as the base-ten logarithm of κ(A), and report a condition estimate alongside any nonsingularity claim in production work.

Never scale a determinant to a threshold

Because det(cA)=cndet(A), multiplying a matrix by 101 divides the determinant of a 20×20 matrix by 1020 without changing its conditioning at all. Any test of the form “singular if |det(A)|<ε” is therefore a unit-dependent artefact. Use a reciprocal condition estimate or the smallest singular value.

Do not form the inverse to solve a system

Statement six guarantees A1 exists; it does not recommend computing it. Solving Ax=b by factorisation and substitution costs about a third of the work of inverting, and is more accurate. Explicit inverses are justified when the matrix itself is the deliverable — a covariance, a compliance matrix, an analytic sensitivity — not as a step towards a solution vector.

Prefer to remove a singularity in the model, not the algebra

When a matrix comes out singular, the null space almost always has a physical name: an unconstrained rigid-body mode, an undefined potential datum, a redundant equation, an unobservable state. Adding a restraint, a reference node or an independent measurement fixes the cause. Adding a small multiple of the identity to force nonsingularity fixes only the symptom, and silently biases every subsequent result.

Structural nonsingularity is not numerical nonsingularity

Sparse direct solvers first perform a symbolic analysis that assumes every stored entry is non-zero, giving a structural rank. A matrix can be structurally full rank and numerically singular because of exact cancellation among the stored values. Treat a successful symbolic phase as a necessary condition only, and check the pivots produced by the numerical phase.

Standards &amp; Codes

Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.

Applicable standards, conventions and reference implementations
ReferenceTitleRelevance to this topic
ISO 80000-2Quantities and units — Part 2: MathematicsPrescribes the notation used throughout this list: det upright as an operator, In for the identity, A1 for the inverse, and the distinction between the matrix A and its determinant.
IEEE 754-2019IEEE Standard for Floating-Point ArithmeticExplains why the exact equivalences degrade in computation. Rounding turns an exactly zero pivot into a small non-zero one, so the reduction test and the determinant test become threshold decisions whose outcome depends on the rounding mode and the operation order.
LAPACK / BLAS referenceLinear Algebra PACKage reference implementationDefines the industrial answer to this question. xGETRF reports the index of the first exactly zero pivot, and xGECON returns a reciprocal condition estimate, which is the quantity practitioners use in place of a yes-or-no nonsingularity test.
ISO/IEC 40314Mathematical Markup Language (MathML) Version 3.0Encodes each of the thirteen statements as structured mathematics rather than an image, so the list remains machine-readable and individual conditions can be extracted and compared programmatically.
W3C WCAG 2.1 AAWeb Content Accessibility GuidelinesRequires that a numbered list of equivalent conditions is exposed as a real ordered list with semantic mathematics, so that assistive technology can enumerate the statements and read each matrix aloud rather than announcing an image.

Material Selection

For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.

Representation and precision selection
RepresentationSelect whenTrade-off
Exact rational or integer arithmeticSmall to moderate matrices with exact entries where the answer must be definitive: symbolic studies, certification evidence, textbook verification.All thirteen statements hold exactly and any of them may be used. Intermediate fractions can grow rapidly under naive elimination; a fraction-free algorithm keeps the determinant path integral throughout.
IEEE 754 binary64 with a condition estimateThe default for engineering computation, where the entries already carry measurement or modelling uncertainty.Fast and well supported, but the exact question is replaced by a quantitative one. Report the reciprocal condition number rather than a boolean, and treat any matrix with κ(A)>1012 as effectively singular in double precision.
IEEE 754 binary32Embedded targets, real-time control loops and GPU kernels where memory bandwidth dominates.Halves storage and traffic but leaves about seven significant decimal digits, so a matrix with condition number above roughly 104 already loses most of its accuracy. Consider iterative refinement in higher precision if the decision matters.
Fixed-point arithmeticHardware without a floating-point unit, or safety-critical code requiring deterministic, bit-exact behaviour.Range must be analysed in advance for every intermediate quantity. Determinants overflow catastrophically as n grows, so nonsingularity should be tested by monitoring pivot magnitudes during elimination rather than by any single scalar.
Finite field, 𝔽pCoding theory, cryptography, and modular certification of nonsingularity over the rationals.Exact, fast and free of growth in operand size, and all thirteen statements transfer without change except that eigenvalues may require an extension field. A poorly chosen prime can make a rationally nonsingular matrix appear singular.
Integers modulo a composite, mClassical matrix ciphers and lattice constructions where the modulus is not prime.The equivalences require restatement: invertibility needs det(A) to be a unit, that is gcd(det(A),m)=1, which is strictly stronger than det(A)0. Assuming the field version here is a genuine correctness bug.

Manufacturing Notes

Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.

Cost of each condition

Reduction to the identity costs about n3 operations; an LU factorisation about 23n3; the determinant is then the product of the pivots, essentially free, or O(n!) if computed by cofactor expansion. Forming the explicit inverse costs about 2n3. A reciprocal condition estimate adds O(n2) to an existing factorisation. Computing the full spectrum to check for a zero eigenvalue costs 10n3 or more and is never the right choice.

The hand procedure and what it yields

Augment A with the identity to form [AIn] and reduce. If the left block reaches In, the matrix is nonsingular and the right block is A1; if a zero row appears in the left block, the matrix is singular and the reduction can be stopped at once. A single pass therefore settles statements 1, 2, 3, 6, 9 and 10 together.

How libraries actually report the answer

numpy.linalg.inv and numpy.linalg.solve raise LinAlgError only on an exactly zero pivot, which almost never occurs on rounded data; a nearly singular matrix returns a large, wrong answer silently. MATLAB emits a near-singularity warning based on rcond. LAPACK's xGETRF returns the index of the offending pivot. Treat the absence of an exception as no evidence at all and check the condition estimate explicitly.

Verification after the fact

For an inverse, form AA1 and measure AA1In relative to the unit round-off and the condition number; a residual far above κ(A)ε indicates a bug rather than rounding. For a solution vector, compute the residual bAx against the original matrix. For an exact-arithmetic claim of nonsingularity, an independent determinant computed by a different algorithm is a cheap cross-check.

Certifying nonsingularity modulo a prime

For a large integer matrix, reducing modulo a randomly chosen prime and eliminating in fixed-width arithmetic is far cheaper than exact rational elimination. A non-zero determinant modulo p proves the rational matrix is nonsingular outright; a zero result is inconclusive, since p may divide the true determinant, so repeat with further primes. This converts an expensive exact computation into a fast one-sided certificate.

Failure Modes &amp; Common Mistakes

Failure modes, root causes and prevention
Failure mode / mistakeImpactRoot causePrevention & detection
Applying the list to a rectangular matrixhighCalling an m×n matrix with mn singular or nonsingular, usually after an unnoticed shape change or a least-squares problem being treated as a square system.Assert squareness before invoking any statement. For rectangular matrices ask about rank(A) relative to m and n, which separates independent columns from a full column space.
Using a small determinant as a singularity testhighThresholding |det(A)| in floating point, ignoring that the determinant scales as the n-th power of any rescaling of the matrix.Use a reciprocal condition estimate or the smallest singular value. Keep the determinant for exact, symbolic and low-dimensional work where it is a genuine certificate.
Equating nonsingular with numerically well behavedhighReading statement six as a guarantee of a usable answer, when invertibility says nothing about how far the matrix is from the singular set.Report a condition number with every solve. Budget a loss of about as many significant digits as the base-ten logarithm of κ(A), and compare that against the precision of the input data.
Concluding nonsingularity from one right-hand sidemediumObserving that Ax=b produced an answer for one particular b and inferring statement four, which quantifies over all b.Test the homogeneous system instead. Ax=0 having only the zero solution is a single computation that settles the universal statement.
Assuming a non-zero determinant gives invertibility over a ringmediumCarrying the field version of statement eleven into arithmetic modulo a composite, or into the integers, where invertibility requires the determinant to be a unit.Over m require gcd(det(A),m)=1; over require det(A)=±1 for an integer inverse. Only over a field is det(A)0 sufficient.
Forming the explicit inverse to solve a systemmediumTranslating x=A1b from the page into code literally.Factorise once and substitute. It is roughly three times cheaper and measurably more accurate, and it reuses cleanly across multiple right-hand sides.
Regularising away a structural singularitymediumAdding εIn or a small diagonal perturbation to make a solver succeed on a matrix that is singular for a physical reason.Compute a null space basis and identify what it represents. A rigid-body mode, a floating reference or an unobservable direction should be fixed in the model, not masked in the algebra.
Trusting a structural rank from a symbolic analysislowRelying on a sparse solver's symbolic phase, which assumes every stored entry is non-zero, to certify nonsingularity.Treat structural full rank as necessary but not sufficient. Inspect the pivot magnitudes produced by the numerical factorisation before accepting the result.

FAQs

Why state thirteen conditions instead of just defining an invertible matrix?

Because the conditions arise naturally in different contexts and are not obviously related. An engineer asking whether a load case has a unique solution, a numerical analyst asking whether elimination terminates at the identity, and a geometer asking whether a set of directions spans are asking the same question in three vocabularies. The theorem is what licenses the translation, and it is the translation, not any single statement, that carries the value.

How many separate theorems does this single result contain?

Seventy-eight. A list of k mutually equivalent statements asserts (k2) if-and-only-if theorems, and (132)=78. The whole set is established by a cycle of implications rather than by proving each pair, which is why a result of this size is practical to prove at all.

Is a one-sided inverse enough for a square matrix?

Yes. If A and B are square of the same size and AB=In, then BA=In follows automatically, so B is the genuine two-sided inverse. This is emphatically false for rectangular matrices: a wide matrix can have a right inverse and no left inverse. The square case is another instance of injectivity and surjectivity implying one another.

Which of the conditions should I actually compute?

In exact arithmetic, row-reduce and check for In — it costs about n3 operations and yields the inverse for free if you augment with the identity. In floating point, use the LU factorisation you are computing anyway and inspect its pivots, then report a reciprocal condition estimate. Never compute a determinant or a spectrum solely to answer this question.

Does the list survive over the real numbers rather than the complex numbers?

Yes, all thirteen statements remain equivalent over , and indeed over any field. Statement twelve is safe because it is a negative statement: asserting that 0 is not an eigenvalue requires no guarantee that any eigenvalue exists. What fails over is the separate guarantee that a square matrix has an eigenvalue at all, which this list never uses.

My matrix is singular. What should I do?

Compute a basis for the null space and interpret it. In a structural model it will be a rigid-body motion; in a network it will be an undetermined reference level; in an estimation problem it will be an unidentifiable parameter combination. Fix the underlying model by adding the missing restraint, datum or observation. Only if the deficiency is genuinely intrinsic should you move to a pseudoinverse or a regularised solution, and then state which one you used.

Can I add a fourteenth condition of my own?

Yes, provided you prove it equivalent to one existing statement using results that do not themselves depend on the list. Common additions include a non-zero product of eigenvalues, non-zero singular values throughout, a trivial left null space, and At being nonsingular. Each is a short proof, and each must be checked for circularity before it is admitted.

References

  1. Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Sections NSM, LI, MINSM, CRS, B, D, DM, PEE and MR — the nine successive rounds of the nonsingular matrix equivalences. Licensed under the GNU Free Documentation License v1.2.
  2. Horn, R. A. and Johnson, C. R. Matrix Analysis, 2nd edition. Cambridge University Press, 2012.
  3. Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013. Condition estimation and the numerical meaning of near-singularity.
  4. Higham, N. J. Accuracy and Stability of Numerical Algorithms, 2nd edition. Society for Industrial and Applied Mathematics, 2002.
  5. Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
  6. ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.

AI Suggested Questions

  • Give me a 5x5 integer matrix that is nonsingular but has condition number above 10^10, and show how each of the thirteen conditions behaves in double precision.
  • Walk through the cycle of implications that proves all thirteen statements equivalent using only thirteen proofs rather than seventy-eight.
  • Which statements in this list fail, and which need restatement, when the entries are drawn from the integers modulo 26 rather than a field?
  • Show me the null space of an unrestrained two-dimensional truss stiffness matrix and identify each basis vector as a specific rigid-body motion.
  • Compare the operation count and the numerical reliability of testing nonsingularity by RREF, by LU pivots, by determinant and by smallest singular value for n = 1000.
  • Propose three additional conditions equivalent to nonsingularity involving the adjoint, the singular values and the left null space, and prove each without using the list itself.

Related Calculators

Continue learning

Algebraic and Geometric Multiplicities of Eigenvalues | KEVOS® MathematicsArticle · Project ManagementAmitsur’s Theorem on the Radical of a Polynomial Ring | KEVOS®Article · Project ManagementAmitsur’s Theorem on the Radical of an Algebra of Small Dimension | KEVOS®Article · Project ManagementArchetypes: Reference Catalogue of Worked Systems | KEVOS® MathematicsArticle · Project Management