Engineering/Mathematics/Matrices
The Left Null Space
The left null space collects the vectors satisfying — the weighted combinations of the rows of that cancel exactly. Each such vector records a row operation sequence that manufactures a zero row, and simultaneously states a consistency condition that every solvable right-hand side must obey.
- Advanced level
- Stream: subspaces
- Reading time 12 min
- Ref KVS-ENG-MATH-0051
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Null space, transpose, matrix multiplication
- Definition
- Lives in
- for an matrix
- Dimension
- , where
- Reads as
- Row dependencies and consistency conditions
Overview
Three subsets of a matrix appear early and repeatedly: the null space, the column space and the row space. The fourth completes the set. The left null space is defined as the null space of the transpose, which places it in for an matrix — the same ambient space as the column space, and one size removed from the null space and the row space.
The name is explained by rewriting the defining condition. If then transposing both sides gives : the vector acts on from the left, and its entries serve as the scalars in a linear combination of the rows of that produces a row of zeros. Every element of the left null space is therefore a relation of linear dependence among the rows.
That reading gives the subspace immediate operational content. When a matrix row-reduces to a form with zero rows, each zero row was manufactured by some cumulative sequence of row operations, and the net scalars applied to the original rows constitute a vector in . The left null space is the complete inventory of such recipes. Its dimension is , exactly the number of zero rows that appear.
In application the same vectors do a second job. Because , applying to the system produces regardless of . Each basis vector of the left null space is thus a linear constraint that any consistent right-hand side must satisfy, and violation of one is a direct, computable signal of inconsistency. In estimation and diagnostics these are known as parity relations, and they are the mathematical basis of analytical redundancy.
Definition
Left Null Space
LNSLet be an matrix. The left null space of is , the set of all vectors of size satisfying .
Equivalently, . The two formulations are related by transposition and the reversal rule .
Row-dependence reading
RDRA vector has entries that satisfy , where denotes row of . Non-zero elements of the left null space are therefore in one-to-one correspondence with non-trivial relations of linear dependence among the rows of .
Consistency condition
CCIf and the system has any solution, then . A basis for therefore supplies a complete set of independent scalar tests that a right-hand side must pass for the system to be consistent.
Concepts
Why the vectors act from the left
Start from the defining equation and transpose it. Using the reversal rule for a transposed product and the fact that transposing twice returns the original matrix, the left-hand side becomes and the right-hand side becomes the zero row vector. So : the vector multiplies on the left, whereas an element of the ordinary null space multiplies on the right. The name is a description of where the vector sits in the product, not a claim about any left-handed property of the matrix.
A ledger of row operations
Row operations replace the rows of a matrix with linear combinations of the original rows, and after a full reduction each row of the result is such a combination. When the reduced form has a zero row, the scalars that produced it form a vector satisfying , hence an element of . Running the argument in reverse shows the correspondence is exact: the left null space contains precisely the net effects of all row-operation sequences that annihilate a row. This is why its dimension is , the number of zero rows produced.
Dimension and the rank connection
Applying the rank-nullity relation to , which has columns, gives . Since a matrix and its transpose share a rank, this is . A matrix with full row rank () therefore has a trivial left null space: no combination of rows cancels, no zero rows appear on reduction, and every right-hand side gives a consistent system. A shortfall counts the redundant equations exactly.
Parity relations and analytical redundancy
Model a measurement campaign as , with the sensitivity matrix mapping physical states to channels. Any gives for every possible state, so the scalar is identically zero on healthy data and depends on no unknown. Evaluating it on real readings produces a residual whose departure from zero indicates sensor fault, model error or noise. A basis for is a maximal independent set of such tests, and its size is the degree of analytical redundancy the instrumentation provides.
Relation to the column space
The left null space and the column space are both subspaces of , with dimensions and . That complementarity is not an accident: holds exactly when annihilates every column of , and hence every vector in , under the ordinary bilinear pairing . The left null space is the set of linear functionals vanishing on the column space, which is precisely why its elements serve as consistency tests for .
Computing it
The direct route is to transpose, reduce and read off a null-space basis in the usual way: the free columns of index the basis vectors, and each is obtained by setting one free variable to and the rest to . A second route avoids the transpose altogether. Augmenting with an identity block and reducing the extended array records every row operation in the appended block; the rows of that block sitting alongside the zero rows of the reduced form a basis for directly.
Procedure: find a basis for the left null space
Equations
Definition of the left null space
EQ-LNS-01For an matrix . The result is a subspace of , the same ambient space as the column space.
The left-acting form
EQ-LNS-02Obtained by transposing the defining equation. This is the form that explains the name and exposes the row-dependence reading.
Row dependency
EQ-LNS-03Written with for the -th row of . The entries of a left null space vector are exactly the scalars in a vanishing combination of the rows.
Dimension
EQ-LNS-04Equal to the number of zero rows in the reduced row-echelon form of . It vanishes precisely when has full row rank.
Consistency test
EQ-LNS-05Applying to both sides eliminates entirely. Taken over a basis of , these conditions are also sufficient for consistency.
Parity residual
EQ-LNS-06The scalar residual generated by a left null space vector. It is independent of the unknown state, so any non-zero value is attributable to fault, noise or model error.
Complementary dimensions in
EQ-LNS-07The column space and left null space partition the dimension of the ambient space ; the left null space annihilates the column space under the bilinear pairing.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Matrix | The matrix under analysis | m x n matrix over C | |
| Transpose | The matrix whose ordinary null space is | n x m matrix over C | |
| Left null space | All vectors annihilating from the left | subspace of C^m | |
| Null space | All vectors annihilating from the right; a subspace of | subspace of C^n | |
| Left null vector | A vector of scalars whose weighted combination of the rows of vanishes | vector in C^m | |
| Row of | The -th row of , treated as a vector of length | vector in C^n | |
| Rank | Number of non-zero rows in the reduced form of | 0 to min(m,n) | |
| Row count | Number of rows of ; equivalently the number of measurement channels or equations | positive integer | |
| Parity residual | The scalar , identically zero on data consistent with the model | complex scalar |
Worked Numerical Example
Problem statement
A condition-monitoring rig carries five transducers observing a three-parameter thermal state. Determine how much analytical redundancy the instrumentation provides, derive the parity relations, and confirm that they annihilate the sensitivity model.
Write the sensitivity matrix
Row holds the sensitivity of transducer to the three state parameters. There are channels and states.
Transpose
The left null space of is the ordinary null space of , so form the transpose. Its columns are the original rows of .
Reduce
Bringing to reduced row-echelon form gives leading ones in columns , and . So , columns and are free, and .
Build the basis vectors
Set , : the three pivot equations give , , . Then set , : they give , , .
Verify the first relation against the rows
The first basis vector asserts that row 4 equals the sum of rows 1 and 2. Checking directly: , which is row 4. So , and the vector is genuinely in .
Verify the second relation
The second basis vector asserts . Evaluating gives , confirming the relation and hence the second parity check.
State the parity relations
Writing for the reading of transducer , each basis vector converts into a scalar test on the measurement vector. Both hold identically for any thermal state consistent with the model, so both are pure functions of the data.
The rig has degrees of analytical redundancy: five channels observe only three independent states, so two independent scalar combinations of the readings must vanish for any physically realisable state. Monitoring and detects a fault in any single channel without knowing the thermal state at all, and the pattern of which residuals move localises the fault. A rig with would have a trivial left null space and no self-checking capability whatsoever.
Applications & Industry Use
Sensor fault detection by parity space
Redundant inertial and air-data sensors are related to a smaller set of physical states by a fixed geometry matrix. The left null space of that matrix generates the parity vector whose components are zero in fault-free operation. Threshold logic on these residuals isolates a failed unit without any estimate of the vehicle state, which is the standard basis for analytical redundancy in flight-critical monitoring.
Data reconciliation and gross error detection
Flow, composition and energy balances around a plant impose linear constraints on measured streams. The left null space of the balance matrix supplies the independent balance closures that measured data must satisfy. Systematic non-closure of a specific combination points to a biased instrument or an unrecorded stream, and quantifies how much redundancy the measurement layout provides before any reconciliation is attempted.
State estimation observability and bad data
In power system state estimation the measurement Jacobian relates meter readings to bus states. Elements of its left null space form residual tests that are independent of the true state, and the dimension of that subspace determines how many bad measurements can in principle be identified. A trivial left null space means no measurement can be cross-checked at all.
Redundant equilibrium equations
Assembling nodal equilibrium equations for a structure often yields more equations than independent conditions, because global equilibrium is implied by the local ones. The left null space enumerates those implied combinations exactly and thereby identifies the equilibrium checks that carry no new information but serve as valuable arithmetic verification of an assembled model.
Closure conditions in a measurement network
Levelling loops, interferometric chains and comparison schemes all produce measurements whose sums around a closed path must vanish. Those closure conditions are precisely the left null space of the design matrix. Their number sets the redundancy of the network, and their evaluated values are the misclosures used to assess measurement quality before adjustment.
Conserved moieties in a reaction network
For a stoichiometric matrix with reactions as columns and species as rows, the left null space consists of weightings of species concentrations that remain constant under every reaction. These conservation relations — total phosphate, total enzyme, total cofactor — are read directly from a basis and constrain any dynamic simulation of the network.
Design Considerations
Distinguish carefully from the ordinary null space
For a non-square matrix the two live in different spaces: and , with dimensions and . They answer different questions — the null space describes ambiguity in the unknowns, the left null space describes redundancy in the equations. Confusing them is a dimensional error that will usually surface as a shape mismatch, but not always.
Use the extended reduction to avoid transposing
Materialising and reducing it duplicates work if the reduction of is needed anyway. Augmenting with an identity block and reducing once yields both the reduced form of and, in the appended block alongside the zero rows, a basis for . For any workflow that wants more than one of the four subsets, this is the economical route.
Complex data requires a choice of transpose
Over the complex numbers, two candidate operations exist: the plain transpose and the conjugate transpose . The definition here uses the plain transpose, giving . Numerical libraries and much of the applied literature default to the conjugate transpose, which yields a different subspace unless is real. State which convention is in force before comparing results across sources.
A basis is not unique — choose one that suits the task
Any invertible recombination of a left null space basis is another basis, and different choices give different-looking parity relations. For fault isolation, a basis engineered so that each residual involves few channels gives a clean and interpretable fault signature. For numerical robustness, an orthonormal basis from an SVD is preferable. The subspace is fixed; the presentation is a design decision.
Redundancy in principle is not redundancy in practice
A non-trivial left null space guarantees that exact model data satisfies the parity relations, but says nothing about noise amplification. A residual whose generating vector is nearly orthogonal to the useful signal direction, or whose entries span many orders of magnitude, will be dominated by measurement noise. Assess each candidate residual for signal-to-noise before committing it to a monitoring scheme.
Full row rank means no self-checking
When the left null space is trivial, every right-hand side gives a consistent system, and no combination of measurements can be cross-validated. If the design intent is a self-checking instrumentation layout, the row rank must be deliberately kept below the channel count; verifying is a legitimate design acceptance criterion.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Standardises the transpose and conjugate-transpose notation whose distinction determines which of two candidate subspaces the phrase 'left null space' denotes. |
ISO 5725-1 | Accuracy (trueness and precision) of measurement methods and results | Provides the vocabulary of trueness and precision against which parity residuals derived from the left null space are interpreted as bias or as random scatter. |
IEC 61508 | Functional safety of electrical/electronic/programmable electronic safety-related systems | Diagnostic coverage claims for redundant sensing arrangements rest on analytical redundancy; the dimension of the left null space bounds how many independent cross-checks a layout can support. |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Left null space bases in production are obtained from the trailing left singular vectors returned by xGESVD or from a rank-revealing QR, not from an explicit reduced form. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the row-vector products and matrix layouts on this page semantically, preserving the distinction between and for assistive technology. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Structural or symbolic analysis where the exact dimension and integer parity relations are the deliverable. | Yields unambiguous relations with integer coefficients that read cleanly as conservation laws, but is impractical for large or measured matrices. |
| IEEE 754 binary64 with SVD | Measured sensitivity matrices in monitoring, estimation or reconciliation. | The trailing left singular vectors give a well-conditioned orthonormal basis with a quantified singular-value gap, at higher cost than elimination and with no integer structure. |
| Rank-revealing QR of | A left null space basis is needed repeatedly for a fixed geometry, and the cost of a full SVD is not justified. | Cheaper than SVD and numerically sound, but the rank decision is less robust for matrices with a shallow singular-value gap. |
| Integer arithmetic over | Stoichiometric and incidence matrices, where the entries are small integers and conservation relations should be reported in integer form. | Preserves the physical interpretability of conserved moieties and loop sums; requires care with coefficient growth and with normalising the sign and scale of each basis vector. |
| Fixed-point arithmetic | Parity residuals evaluated online in an embedded monitor with no floating-point unit. | Deterministic timing and small footprint, but the basis coefficients must be pre-scaled offline and the residual thresholds set with quantisation error explicitly budgeted. |
| Sparse storage with a sparse QR | Large network models where the sensitivity or incidence matrix is very sparse. | Retains sparsity in the factors with a good ordering, but the computed basis vectors are typically dense, so the memory saving applies to the factorisation rather than the result. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Two computational routes
The direct route transposes and reduces, costing roughly the same as reducing itself. The extended route augments with and reduces the array once, extracting the basis from the rows of the appended block that sit alongside the zero rows of the reduced . The second route costs more per reduction but delivers the reduced form of and material for the other three subsets at the same time.
Doing it by hand
Transpose first and write the result down explicitly — attempting the reduction mentally on the untransposed matrix is the dominant source of error. Reduce, identify the free columns, and construct one basis vector per free column by setting that variable to and the other free variables to . Then check every vector by combining the original rows of ; this catches both transposition slips and arithmetic slips.
Library behaviour
SymPy's Matrix.nullspace() applied to A.T returns an exact basis. In SciPy, scipy.linalg.null_space(A.T) returns an orthonormal basis computed from the SVD with a documented tolerance; note that A.T is the plain transpose while A.conj().T is the adjoint, and the two differ for complex data. MATLAB's null(A.') behaves analogously.
Verification technique
Compute where holds the candidate basis vectors as columns; the result should be the zero matrix to within tolerance. Independently confirm the count: the number of basis vectors must equal minus the rank obtained from a separate computation. Both checks are cheap relative to the derivation and catch the common transposition error immediately.
Conditioning of the residuals
When a left null space basis is used to generate monitoring residuals, normalise each basis vector to unit norm so that residual magnitudes are comparable across relations and thresholds can be set on a common scale. An orthonormal basis from the SVD does this automatically and additionally minimises the amplification of measurement noise into any single residual.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Computing instead of | high | Omitting the transpose, so the ordinary null space is returned in place of the left null space. | Check the size of the result: elements of have entries, elements of have . Verify explicitly. |
| Silently using the conjugate transpose | high | A library defaulting to the adjoint on complex data, producing a different subspace from the one defined by . | State the convention in the specification and use the explicit plain-transpose operator; for real matrices the two agree, so the bug only surfaces on complex data. |
| Concluding no redundancy from a trivial computed basis | medium | A floating-point rank computation without tolerance reports full row rank on a matrix that is only numerically close to rank-deficient. | Inspect the singular values rather than counting pivots, and report the gap that justifies the chosen rank. |
| Treating any non-zero residual as a fault | medium | Applying the exact condition to noisy measurements with no threshold. | Propagate the measurement covariance through the residual to obtain its distribution under the healthy hypothesis, and set thresholds from that distribution rather than from zero. |
| Assuming a basis is canonical | low | Comparing left null space bases from two sources and concluding the subspaces differ because the vectors differ. | Compare subspaces, not vectors: stack both bases and check that the combined rank equals . |
| Ignoring scaling when interpreting residuals | medium | Using a raw basis whose entries span several orders of magnitude, so one channel dominates the residual and the others are effectively unmonitored. | Normalise the basis vectors, or derive them from an SVD, and inspect each vector's entries for near-zero coefficients before deploying the residual. |
| Confusing the left null space with a left inverse | low | Reading the word 'left' as referring to inversion rather than to the side on which the vector multiplies. | The defining relation is . A left inverse satisfies and is a different object entirely, existing only when has full column rank. |
| Expecting a non-trivial left null space from a full-row-rank matrix | low | Assuming that having more equations than unknowns guarantees redundancy relations. | Redundancy is governed by , not by . A tall matrix with full row rank () has a trivial left null space. |
FAQs
Why is it called the left null space?
Because its vectors annihilate from the left. Transposing the defining equation gives , in which appears on the left of . Ordinary null space vectors appear on the right, in . The name records the position in the product and has nothing to do with left inverses.
How is the left null space different from the ordinary null space?
They describe different things and generally live in different spaces. For an matrix, has dimension and measures ambiguity in the unknowns; has dimension and measures redundancy among the equations. They coincide only in special cases such as certain symmetric matrices.
What does a vector in the left null space actually tell me?
Two things at once. Read against the rows of , its entries are the scalars in a linear combination of rows that cancels — a statement that those equations are not independent. Read against a right-hand side, it gives the scalar test that any consistent must satisfy.
When is the left null space trivial?
Exactly when has full row rank, . Then no combination of rows cancels, no zero rows appear on reduction, and is consistent for every possible — equivalently the column space is all of . This is a common design goal for a well-posed system and a design failure for a self-checking instrument.
Can I find it without transposing the matrix?
Yes. Augment with an identity block and row-reduce the extended array. The appended block records the cumulative row operations, and the rows of that block sitting alongside the zero rows of the reduced form a basis for the left null space directly. This is also the route that delivers all four subsets from one reduction.
Should I use the transpose or the conjugate transpose for complex matrices?
The definition here uses the plain transpose, which is what makes the identity exact. Most numerical libraries default to the conjugate transpose, giving the orthogonal complement of the column space under the Hermitian inner product. For real matrices the two agree; for complex matrices state the convention explicitly.
How does the left null space relate to the column space?
Its elements are precisely the vectors annihilating every column of , and hence everything in , under the pairing . The two subspaces sit in the same with dimensions and summing to , which is why membership of in the column space can be tested entirely through left null space conditions.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section FS, Subsection LNS. Licensed under the GNU Free Documentation License v1.2.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
- Gertler, J. Fault Detection and Diagnosis in Engineering Systems. Marcel Dekker, 1998.
- Narasimhan, S. and Jordache, C. Data Reconciliation and Gross Error Detection. Gulf Publishing, 2000.
- IEC 61508:2010, Functional safety of electrical/electronic/programmable electronic safety-related systems. International Electrotechnical Commission.
AI Suggested Questions
- Given a 6x4 sensitivity matrix, derive a set of parity relations from its left null space and show how a single-channel bias appears in the residuals.
- Explain the difference between the left null space defined with the plain transpose and the one defined with the conjugate transpose, using a complex 3x2 example.
- Why does the left null space of a stoichiometric matrix correspond to conserved quantities, and how do I read a conserved moiety off a basis vector?
- Show how augmenting a matrix with an identity block and reducing once yields a left null space basis without ever forming the transpose.
- How should I choose among the infinitely many bases for a left null space when designing fault-isolation residuals?
- For a matrix with a shallow singular-value gap, how do I decide whether a computed left null space vector is real or an artefact of rounding?
Related Calculators
Compute a basis for with exact or floating-point arithmetic, reporting dimension and verifying .
Parity Relation GeneratorTurn a sensitivity matrix into a normalised set of measurement residuals, with noise propagation and suggested detection thresholds.
Matrix Rank & Nullity CalculatorReport rank, nullity and left-nullity for a matrix with a selectable rank tolerance.
