Engineering/Mathematics/Preliminaries
Nonsingular Matrix Equivalences — Foundations and Proof Network
Thirteen apparently unrelated conditions on a square matrix — a trivial null space, a reduction to the identity, independent columns, rank , a non-zero determinant, no zero eigenvalue — turn out to be one condition wearing thirteen costumes. Knowing they are interchangeable means any one of them can be verified and all the others claimed.
- Core level
- Stream: matrix-algebra
- Reading time 17 min
- Ref KVS-ENG-MATH-0124
- Taxonomy
- Engineering / Mathematics
- Applies to
- Square matrices only, size
- Statements
- 13 mutually equivalent conditions
- Theorems packaged
- separate if-and-only-if results
- Cheapest exact test
- Row-reduce and check the result is — about operations
- Negation
- A singular matrix fails all thirteen together
Overview
A square matrix is nonsingular when the homogeneous system has only the zero solution. That is a narrow, almost technical-looking definition, and taken alone it would be unremarkable. What makes it the organising idea of matrix algebra is that it turns out to be equivalent to a long list of conditions expressed in completely different vocabularies: a statement about row reduction, a statement about solution sets, a statement about linear independence, a statement about spanning, two statements about integer-valued invariants, a statement about a single scalar, a statement about the spectrum, and a statement about an associated function.
The list is assembled incrementally. Each time a new structure is introduced — matrix inverses, column spaces, bases, dimension, determinants, eigenvalues, linear transformations — a bridging theorem is proved connecting that structure to nonsingularity, and the list gains one entry. By the end there are thirteen statements. Because a theorem of this form declares every pair equivalent, thirteen statements package separate if-and-only-if theorems, and the whole structure is established with far fewer than 78 proofs by arranging the implications in a chain that closes back on itself.
The engineering value is substitution. A question posed in one vocabulary can be answered in another, and the answering vocabulary can be chosen for cost, for numerical robustness, or for whatever information happens to be available. If a factorisation has already been computed, nonsingularity is free. If the columns are known on physical grounds to be independent — independent load paths, independent measurement directions — then a unique solution for every right-hand side follows without any arithmetic. If a determinant is available symbolically, the parameter values at which a design becomes singular can be solved for directly.
Equally important is what the list says about failure. Because the conditions are equivalent, their negations are equivalent too: a singular matrix does not row-reduce to the identity, has a non-trivial null space, has dependent columns whose span is a proper subspace, has rank below and nullity above zero, has zero determinant, has in its spectrum, and induces a non-invertible transformation. In a physical model these are not seven separate defects but seven readings of one defect — typically a redundant equation, an unconstrained rigid-body motion, or a missing reference datum — and the null space vector usually names it explicitly.
Definition
Nonsingular Matrix
NMA square matrix is nonsingular when the homogeneous system has the zero vector as its only solution. Equivalently, . A square matrix that is not nonsingular is singular, meaning some non-zero vector is annihilated by .
The definition is stated for square matrices only. A rectangular matrix is neither singular nor nonsingular; the terms are undefined for it, even though its null space may well be trivial.
Null Space of a Matrix
NSMFor an matrix , the null space is the set of all solutions of the homogeneous system. It is always a subspace of , and it always contains ; the substance of nonsingularity is that it contains nothing else.
Matrix Inverse
MIA square matrix of size is invertible when there exists a square matrix of size with . Such a is unique when it exists and is written . For square matrices a one-sided inverse is automatically two-sided: alone forces .
The one-sided result is specific to square matrices. A rectangular matrix can possess a right inverse and no left inverse, or the reverse, and never both.
Multiple Equivalences
MEA theorem whose conclusion is a list of statements declared mutually equivalent, so that any two of them may be joined by if and only if. A list of statements therefore asserts distinct theorems. The economical proof strategy is a cycle , after which any desired equivalence is obtained by travelling round the circle.
In practice this list is built the other way: each new statement is attached to statement one by a dedicated bridging theorem, which keeps every addition independently checkable.
Concepts
The thirteen equivalent statements
Suppose is a square matrix of size . The following thirteen statements are equivalent — each one holds precisely when all the others do.
- is nonsingular.
- row-reduces to the identity matrix, .
- The null space of contains only the zero vector, .
- The system has a unique solution for every choice of .
- The columns of form a linearly independent set.
- is invertible.
- The column space of is all of , that is .
- The columns of are a basis for .
- The rank of is , .
- The nullity of is zero, .
- The determinant of is non-zero, .
- is not an eigenvalue of .
- The linear transformation defined by is invertible.
Two details in the wording carry weight. Statement four says every : a singular matrix may still give a unique solution for no at all, but never for every one, and for a particular a singular system has either no solution or infinitely many. Statement seven says the column space is the whole of , not merely large; combined with statement five this is what upgrades the columns from independent to a basis in statement eight.
Four families of statement, and why the traffic between them matters
The thirteen statements fall into four families, and recognising the family a statement belongs to is what makes the list usable rather than merely memorable.
- Solution-set statements — 1, 3, 4. These describe what happens when the matrix is used to solve something. They are the closest to the original engineering question and the reason the concept was isolated in the first place.
- Computational statements — 2, 6. These describe the outcome of an algorithm: elimination terminates at the identity, and the inverse exists. Statement two is the practical test; statement six is the practical payoff.
- Subspace and basis statements — 5, 7, 8, 9, 10. These describe the columns as a set of vectors in : independent, spanning, a basis, and the two integer invariants that record those facts. They connect nonsingularity to the whole apparatus of dimension.
- Scalar and operator statements — 11, 12, 13. These describe the matrix as an object acting on itself and on the space: one number certifies it, the spectrum omits zero, and the induced map is a bijection.
Movement between families is where the leverage lies. A structural argument — these load paths are geometrically independent, these measurement directions are not coplanar — establishes statement five with no arithmetic, and statement four follows immediately: the system is uniquely solvable for every load case. Conversely a numerical elimination establishes statement two, and statement eight follows: the columns may be used as a coordinate system.
How the list is assembled: one bridging theorem at a time
The list grows one statement at a time, and each addition is a separate theorem connecting a newly available structure back to statement one. Reading the sequence is a compressed tour of the whole subject.
- Statements 2, 3, 4 arrive first, from three companion results: nonsingular matrices row reduce to the identity; nonsingular matrices have trivial null spaces; and nonsingular matrices give unique solutions for every vector of constants. Requires: only row reduction and the pivot count.
- Statement 5 arrives with linear independence. A relation of linear dependence among the columns is exactly a non-zero solution of , so independence of the columns and a trivial null space are the same statement in different words. Requires: the interpretation of a matrix-vector product as a linear combination of columns.
- Statement 6 arrives with matrix inverses. One direction is a short computation: if exists and , then . The other direction is constructive — augment with the identity, reduce, and read the inverse off — and needs the fact that a one-sided inverse of a square matrix is two-sided. Requires: matrix multiplication and its associativity.
- Statement 7 arrives with column spaces. If is nonsingular then is solvable for every , and the set of solvable right-hand sides is the column space. Requires: the equivalence of consistency and membership of the column space.
- Statement 8 arrives with bases: independent (statement 5) plus spanning (statement 7) is the definition of a basis. Requires: nothing new beyond the definition.
- Statements 9 and 10 arrive with dimension. The rank is the dimension of the column space, which is exactly when the column space is everything; the nullity is then by rank plus nullity. Requires: rank plus nullity, and the fact that a subspace of of dimension is .
- Statement 11 arrives with determinants: a square matrix is singular if and only if its determinant is zero, and negating both sides gives the equivalence in the form needed here. Requires: the behaviour of the determinant under row operations.
- Statement 12 arrives with eigenvalues. A matrix is singular exactly when some non-zero satisfies , which is precisely the statement that is an eigenvalue. Negate to obtain statement 12. Requires: the definition of an eigenvalue and nothing more — notably not the characteristic polynomial.
- Statement 13 arrives with linear transformations, once the dictionary between a matrix and its induced map is complete: the kernel corresponds to the null space and the range to the column space, so injectivity and surjectivity of correspond to statements 3 and 7. Requires: rank plus nullity for transformations and the correspondence between invertibility and bijectivity.
Every one of these bridging theorems reaches back only to material that does not itself depend on the list. That discipline is what keeps the structure from being circular, and it is worth checking whenever a fourteenth condition is proposed.
The contrapositive list: what a singular matrix looks like
Because the thirteen statements are equivalent, so are their negations, and the singular list is just as useful. For a square matrix of size , the following also stand or fall together.
- is singular; some non-zero satisfies .
- The reduced row-echelon form of has at least one zero row, so it is not .
- ; there are free variables.
- For each , the system has either no solution or infinitely many — never exactly one.
- The columns are dependent: at least one is a linear combination of the others.
- No matrix satisfies , on either side.
- is a proper subspace of , of dimension .
- and .
- , equivalently .
- is an eigenvalue, and the null space is its eigenspace.
- is neither injective nor surjective.
The fourth entry deserves emphasis because it is routinely misread. Singularity does not mean “no solution”. It means the solution count is never one: for right-hand sides inside the column space there are infinitely many solutions, differing by any element of the null space, and for right-hand sides outside it there are none. A design that appears to work because one particular load case produced an answer may still rest on a singular matrix.
Squareness is the hypothesis that makes the list cohere
Squareness is not a convenience in the hypothesis; it is what makes the list cohere. Consider each family against an matrix with .
- A trivial null space is still meaningful and still equivalent to independent columns, but it now forces and says nothing about solvability. A tall matrix with independent columns has no solution for most right-hand sides.
- A full column space is still meaningful and still equivalent to consistency for every , but it forces and permits infinitely many solutions. A wide matrix that spans has a null space of dimension at least.
- The two conditions above coincide only when . That coincidence is the entire content of the theorem: for a square matrix, injectivity and surjectivity of the associated map imply one another, so a single check settles both.
- Determinant, eigenvalue and invertibility statements are not merely false for rectangular matrices, they are undefined. requires equal row and column counts; cannot even be typed unless the input and output live in the same space.
The generalisations that do survive are the rank statements, and they survive in weakened form: characterises independent columns for any shape, and characterises a full column space. Full rank in the sense of gives one of the two properties, never both unless the matrix is square.
Choosing which condition to actually compute
Given thirteen interchangeable conditions, the practical question is which one to compute. Ranked by cost and by robustness they are not at all interchangeable.
- Row reduction to — about operations. The default for exact arithmetic. It answers the question and, if the reduction is performed on , delivers the inverse in the same pass. In floating point the terminal test becomes a tolerance decision on the smallest pivot.
- LU factorisation — about operations. Cheaper than full reduction and reusable across right-hand sides. Nonsingularity appears as the absence of a zero (or unacceptably small) pivot, and the factorisation is normally computed anyway to solve the system.
- Determinant — free once a factorisation exists, being the product of the pivots with a sign for the row interchanges. Excellent as an exact or symbolic certificate; a poor numerical test, because makes the magnitude of a determinant meaningless without a scale.
- Reciprocal condition estimate — about on top of a factorisation. Not one of the thirteen statements, and strictly more informative than all of them in floating point: it measures how far the matrix is from singular rather than whether it happens to be singular exactly.
- Smallest singular value — about to operations. The most defensible numerical answer, since is the exact distance in the spectral norm to the nearest singular matrix. Reserve for cases where the decision matters and the cost is affordable.
- Eigenvalues — iterative, and upwards. Never compute a spectrum merely to check for a zero eigenvalue. Statement 12 is for reasoning, not for testing.
The ordering to remember is that the cheap tests are the structural ones near the top of the list and the expensive tests are the spectral ones near the bottom, while the most useful numerical question — how close to singular — is not on the list at all.
Selecting a nonsingularity test
Equations
The defining condition
EQ-NME-01Statement three, and the definition itself. Every other statement in the list is proved equivalent to this one.
Reduction to the identity
EQ-NME-02Statements two, nine and ten. A square matrix whose reduced form has pivots has no room for a zero row, so the reduced form is forced to be the identity.
Unique solution for every right-hand side
EQ-NME-03Statements four and six together. The universal quantifier is essential: a singular matrix never gives a unique solution for any right-hand side, but the failure is invisible if only one is ever tried.
The columns as a basis
EQ-NME-04Statements five, seven and eight. For exactly vectors in , independence and spanning imply one another, so verifying either one certifies a basis.
Rank plus nullity forces the equivalence
EQ-NME-05The identity that makes statements nine and ten interchangeable, and the reason a square matrix cannot have both a non-trivial null space and a full column space.
Determinant and the zero eigenvalue
EQ-NME-06Statements eleven and twelve, and the reason they are the same statement. The constant term of the characteristic polynomial is the determinant, so a non-zero determinant is exactly the assertion that is not a root.
Equivalences packaged by the theorem
EQ-NME-07The number of distinct if-and-only-if theorems asserted. A cycle of thirteen implications establishes all of them, which is the economy that makes a list of this length worth stating as a single result.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Square matrix | The matrix whose nonsingularity is in question | n x n matrix over C | |
| Size | Common row and column count; also the dimension of the ambient space | positive integer | |
| Identity matrix | Square matrix with ones on the diagonal and zeros elsewhere; the target of the reduction test | n x n matrix | |
| Null space | All solutions of ; trivial exactly when is nonsingular | subspace of C^n | |
| Column space | Span of the columns; equals exactly when is nonsingular | subspace of C^n | |
| Matrix inverse | Unique matrix with ; exists exactly when is nonsingular | n x n matrix | |
| Determinant | Scalar certificate of nonsingularity, non-zero exactly when is nonsingular | complex number | |
| Eigenvalue | Scalar with for some non-zero ; nonsingularity excludes | complex number | |
| Rank | Number of pivot columns of the reduced form; equals exactly when is nonsingular | 0 to n | |
| Induced transformation | The map on ; invertible exactly when is | linear map C^n to C^n |
Worked Numerical Example
Problem statement
A four-node resistive network is analysed by nodal admittance. Compare the floating network, whose conductance matrix is singular, with the same network after one node is tied to earth. Verify several of the thirteen conditions on each and confirm that they agree.
Assemble the floating conductance matrix
Nodes 1 to 4 are joined by unit conductances between the pairs , , and . Nodal analysis gives , where each diagonal entry is the total conductance at a node and each off-diagonal entry is minus the conductance joining two nodes.
Statement 3 fails immediately for the floating network
Every row of sums to zero, because every conductance appears once positively on the diagonal and once negatively off it. Therefore the all-ones vector is annihilated. This is not an arithmetic accident: raising every node potential by the same amount changes no branch voltage and therefore no current. The null space is non-trivial, so is singular.
Confirm the remaining twelve statements fail together
Row reduction gives three pivots, not four, so the reduced form is not (statement 2 fails), the rank is and the nullity is (statements 9 and 10 fail), the columns are dependent and span only a three-dimensional subspace (statements 5, 7, 8 fail), the determinant vanishes (statement 11 fails), and the characteristic polynomial has as a root (statement 12 fails).
Read the spectrum of the singular matrix
The characteristic polynomial factors completely over the integers. The presence of the factor is statement 12 failing, and its eigenspace is precisely the null space found in step two. The three non-zero eigenvalues describe how quickly the three genuine degrees of freedom relax; the zero eigenvalue describes the direction in which nothing happens at all.
Ground one node and re-form the matrix
Tie node 4 to earth through a unit conductance. Only the fourth diagonal entry changes, from to . Physically the reference ambiguity has been removed; algebraically the rows no longer sum to zero, so the all-ones vector is no longer annihilated.
Statements 2, 3, 9 and 10 now hold
Gauss-Jordan elimination on terminates at the identity, so there are four pivot columns, the rank is , the nullity is and the null space is trivial. By the equivalences, the columns are independent, they span , and they are a basis — none of which required a separate calculation.
Statements 6 and 4: the inverse and the unique solution
Reducing produces the inverse in the same pass. Injecting one ampere at node 1 and nothing elsewhere gives a unique node-voltage vector, obtained as the first column of . Substituting back into reproduces the injected current vector exactly, which is the check worth doing.
Statements 11 and 12: the determinant and the spectrum
The determinant is , non-zero as required. Its role in statement 12 is direct: the constant term of the characteristic polynomial equals the determinant, so and is not an eigenvalue. Note that no eigenvalue was computed to establish this — a single determinant settles the whole spectral statement.
The floating network is singular for a reason that is physical rather than numerical: node potentials are defined only up to a common offset, and that offset is exactly the null space direction . No amount of extra precision or regularisation fixes it, and a solver that appears to succeed on such a matrix has silently chosen one member of an infinite family. Grounding one node changes a single diagonal entry, removes the null space, and flips all thirteen conditions simultaneously — the reduced form becomes the identity, the rank rises to four, the determinant becomes , the zero eigenvalue disappears, and every injected-current pattern acquires exactly one node-voltage solution.
