← LibraryParticular Solutions and Homogeneous Solutions | KEVOS® MathematicsProject Delivery · Project ManagementLesson 116/189← PrevNext →
ArticlePublished 8 Aug 202620 min readBy Kevin Jogin
Skip to content

Engineering/Mathematics/Vectors

Particular Solutions and Homogeneous Solutions

Find one solution of Ax=b and you have found the shape of all of them: every other solution differs from it by an element of N(A). The particular part carries the loading; the homogeneous part carries the freedom.

  • Core level
  • Stream: linear-systems
  • Reading time 13 min
  • Ref KVS-ENG-MATH-0020
Taxonomy
Engineering / Mathematics
Prerequisite
Null space; linear combinations
Statement
y solves the system y=w+z with zN(A)
Corollary
Difference of any two solutions lies in the null space
Consequence
A singular coefficient matrix never gives a unique solution
Generalises to
Pre-images of linear transformations

Overview

Two questions about a linear system look independent: does a solution exist, and how many are there? The particular-plus-homogeneous decomposition shows they are not. Existence is a property of the pair (A,b); multiplicity is a property of A alone. Once a single solution has been found by any means, the entire solution set is that solution translated by the null space of the coefficient matrix.

The statement is short. If w is one solution of Ax=b, then y is a solution if and only if y=w+z for some z with Az=0. Both directions are quick consequences of expressing solutions as linear combinations of the columns: adding a homogeneous solution adds the zero vector to the combination, and subtracting two solutions cancels the constant vector.

This is the linear-algebra form of superposition, and engineers meet it long before they meet the theorem. A statically indeterminate structure carries a particular equilibrium force field plus any self-stress state; a driven oscillator responds with a particular forced response plus any free vibration; a controlled manipulator executes a particular joint motion plus any self-motion. In each case the particular part answers the demand and the homogeneous part is the residual freedom of the system.

The practical corollaries are sharp. A singular coefficient matrix has a non-trivial null space, so a system built on it has either no solutions or infinitely many — never exactly one. Any two solutions differ by a null space element, which gives a cheap consistency check on independently computed answers. And the null space needs to be computed only once, however many right-hand sides are later applied.

Definition

Particular Solution

PS

Any single vector wn satisfying Aw=b. A consistent system has at least one; it has exactly one only when N(A)={0}. No particular solution is privileged — a solver's output, the fixed vector of a vector-form description and a minimum-norm least-squares answer are all equally valid choices.

The term carries no implication of being special or minimal. It means only that one specific solution has been singled out for use as a reference point.

Homogeneous Solution

HS

A vector zn satisfying Az=0; that is, an element of the null space N(A). The set of all such vectors is closed under addition and scalar multiplication, so it is a subspace, and it always contains 0.

Particular Solution Plus Homogeneous Solutions

PSPHS

Let w be one solution of the system with coefficient matrix A and constant vector b. Then a vector y is a solution of that system if and only if y=w+z for some zN(A). Equivalently, the solution set is the translate S=w+N(A).

Concepts

Why the decomposition holds

Read Ax=b as the statement that b is the linear combination of the columns of A with coefficients taken from x. If Aw=b and Az=0, then the combination with coefficients w+z is the sum of the two combinations, which is b+0=b; so w+z is a solution.

Conversely, if y and w are both solutions, the combination with coefficients yw equals bb=0, so yw lies in the null space and y=w+(yw) has the required form. Both directions rest only on distributivity of the column combination over vector addition.

Solution sets are affine, not linear

Unless b=0, the solution set does not contain the origin and is not closed under addition: if Ay1=Ay2=b, then A(y1+y2)=2b. What is closed is the set of differences. A solution set of a consistent inhomogeneous system is therefore a coset — a rigid translate of a subspace — and its dimension as a geometric object is the nullity nr.

This distinction matters when a solution set is passed to code that assumes vector space structure. Averaging two solutions is legitimate (the coefficients sum to one); adding them is not.

Singular means never unique

If the square matrix A is singular, its null space contains a non-zero vector z, and then z can be scaled arbitrarily. So if the system has even one solution w, it has the infinite family w+αz. Hence for a singular coefficient matrix a system is either inconsistent or has infinitely many solutions.

Read the other way, this is the negation of the nonsingular case: a nonsingular matrix yields a unique solution for every right-hand side, and only a nonsingular matrix does. The two statements together classify square systems completely.

The difference test

The corollary that y1y2N(A) for any two solutions is more useful than it looks. It gives an independent check on solvers: compute a solution by two different routes, subtract, and confirm that the difference is annihilated by A. A non-zero residual A(y1y2) signals an arithmetic error rather than an acceptable difference of parametrisation.

It also explains why two correct programs can return visibly different answers to the same under-determined system without either being wrong: they have chosen different points of the same coset.

Reuse across right-hand sides

The null space depends only on A. In a design study where the geometry is fixed and the loading varies, N(A) is computed once and each new load case requires only one particular solution. This is the structural argument behind reusing a factorisation across right-hand sides, and it is why the expensive part of a solve is charged to the matrix rather than to the load.

Conversely, changing A invalidates everything: a modified geometry or a new member changes both the particular solution and the space of freedoms.

The same structure elsewhere

The decomposition is not special to matrices. For any linear map T, the pre-image of a vector v under T is either empty or a translate of the kernel K(T). For a linear differential operator the same statement is the familiar rule that the general solution is a particular integral plus the complementary function.

Recognising the pattern early saves effort later: once a problem is known to be linear, the shape of its solution set is settled before any computation begins.

Describing a solution set from one solution

Obtain one solutionFind any w with Aw=b — by elimination, by a factorisation, or by inspection of the physics.
Confirm it really is a solutionSubstitute into the original system. Everything that follows depends on w being exact, not approximate.
Compute the null spaceSolve the homogeneous system Az=0 and record a basis z1,,znr.
Assemble the solution setWrite S={w+α1z1++αnrznr} over all scalar choices.
Interpret the two partsThe particular part answers the demand; the homogeneous part is the residual design freedom, to be spent on a secondary objective.

Equations

Particular plus homogeneous

EQ-PSHS-01
Aw=b,Az=0A(w+z)=b

Adding any homogeneous solution to a particular solution produces another solution. This is the easy direction of the theorem.

Difference of two solutions

EQ-PSHS-02
Ay1=Ay2=bA(y1y2)=0y1y2N(A)

The converse direction, and a practical cross-check between independently computed solutions.

Solution set as a translate

EQ-PSHS-03
S=w+N(A)={w+zzN(A)}

The complete description. The set is a coset of the null space; its geometric dimension is nr.

Explicit parametrisation

EQ-PSHS-04
S={w+α1z1+α2z2++αnrznrαi}

Written over a basis {z1,,znr} of the null space. Each choice of the αi gives exactly one solution.

Trichotomy for square systems

EQ-PSHS-05
N(A){0}|S|{0,}

A singular coefficient matrix admits no unique solution: the system is either inconsistent or has infinitely many solutions.

Uniqueness criterion

EQ-PSHS-06
|S|=1S and N(A)={0}

Existence and uniqueness are genuinely independent conditions: the first depends on the right-hand side, the second only on the matrix.

Variable Definitions

Symbols used on this page
SymbolNameMeaningDomain / type
ACoefficient matrixThe m×n matrix of the systemm x n matrix
bConstant vectorThe right-hand side; the demand placed on the systemvector in C^m
wParticular solutionOne chosen vector satisfying Aw=bvector in C^n
zHomogeneous solutionA vector satisfying Az=0element of N(A)
yGeneral solutionAn arbitrary member of the solution setvector in C^n
N(A)Null spaceThe set of all homogeneous solutions; a subspacesubspace of C^n
SSolution setAll vectors satisfying the inhomogeneous systemsubset of C^n
nrNullityDimension of the null space; the number of independent freedomsnon-negative integer
αiFree parameterCoefficient selecting a particular homogeneous contributioncomplex scalar

Worked Numerical Example

Problem statement

A four-branch supply network must meet three demand balances. One feasible dispatch is known from operating experience. Show that it and a second dispatch found by elimination differ by an element of the null space, and describe every feasible dispatch.

  1. State the system

    The balances are x1+x2+x3+x4=4, x1+2x2+3x3+4x4=10 and 2x1+3x2+4x3+5x4=14. The third is the sum of the first two, so one equation is redundant — a common artefact of writing down more balances than are independent.

    A=[111112342345],b=[41014]
  2. Check the known dispatch

    Operating experience offers w=(1,1,1,1). Substituting gives 1+1+1+1=4, 1+2+3+4=10 and 2+3+4+5=14. All three balances hold, so w is a genuine particular solution.

  3. Row-reduce the augmented matrix

    Elimination gives the reduced form below. Column 5 is not a pivot column, confirming consistency; r=2, D={1,2} and F={3,4}, so the nullity is nr=42=2.

    [101220123600000]
  4. Extract a basis for the null space

    Rows 1 and 2 give x1=x3+2x4 and x2=2x33x4 for the homogeneous system. Taking (x3,x4)=(1,0) and then (0,1) yields two independent homogeneous solutions.

    z1=[1210],z2=[2301]
  5. Verify the null space vectors

    For z1: 12+1+0=0, 14+3+0=0 and 26+4+0=0. For z2: 23+0+1=0, 26+0+4=0 and 49+0+5=0. Both are annihilated by A.

  6. Compare with a second dispatch

    Elimination with both free variables set to zero returns y=(2,6,0,0), which also satisfies the balances: 2+6=4, 2+12=10, 4+18=14. The two dispatches look nothing alike, yet their difference must lie in the null space.

    yw=[2600][1111]=[3511]=(1)z1+(1)z2
  7. Write the full solution set

    With one particular solution and a null space basis, every feasible dispatch is now described exactly.

    S={[1111]+α1[1210]+α2[2301]α1,α2}
Result

The two dispatches differ by z1z2, exactly as the theorem requires, so both are members of the same two-parameter family. Operationally, the demand fixes two degrees of freedom and leaves two free: those two directions are circulating patterns that move supply between branches without changing what is delivered, and they are the budget available for a secondary objective such as minimising cost or losses.

Applications & Industry Use

Structural engineering

Equilibrium plus self-stress

In an indeterminate frame, any force distribution in equilibrium with the applied load is a particular solution, and the null space of the equilibrium matrix is the space of self-stress states. Prestressing and cable tensioning are the deliberate selection of a null space element to improve the response without disturbing equilibrium.

Power systems

Economic dispatch on a redundant network

Generation schedules meeting demand form an affine set; the null space describes redistributions that leave every bus balance satisfied. Dispatch optimisation searches exactly this set, so characterising it first converts an equality-constrained problem into an unconstrained one over the free parameters.

Robotics

Self-motion of redundant manipulators

Joint velocities producing a commanded end-effector twist are a particular solution plus any null space velocity. Null-space projection uses that freedom to avoid joint limits, singularities and obstacles while the tool follows its path unchanged.

Mechanical vibration

Forced response plus free response

The response of a linear structure to harmonic excitation is a particular forced solution superposed on free vibration determined by the initial conditions. The decomposition is what allows steady-state and transient behaviour to be designed for separately.

Chemical engineering

Reaction extents and mass balance closure

A measured composition change satisfying elemental balances is a particular solution; the null space of the atomic matrix gives the independent reactions. Data reconciliation exploits this to adjust measurements only along directions that keep the balances closed.

Statistics & modelling

Non-identifiable parameters

In a rank-deficient regression, the fitted parameters are a particular solution plus any vector in the design matrix null space. Contrasts orthogonal to that null space are estimable; contrasts inside it are not, which determines what may honestly be reported.

Design Considerations

Verify the particular solution before building on it

The whole description hinges on w being an exact solution. If it came from a floating-point solver, check the residual Awb relative to b before declaring the set. An approximate particular solution shifts the entire family.

Choose the particular solution to mean something

Since any solution serves, choose one with engineering content: a minimum-norm dispatch, a zero-prestress force state, a nominal operating point. Choosing the accidental output of an elimination is legitimate but hands an arbitrary variable ordering a role it should not have.

Compute the null space once per matrix

The homogeneous part depends only on A. In parameter sweeps over the right-hand side, hoist that computation out of the loop; in sweeps over the matrix, do not, because a small change in A can change the nullity discontinuously.

Do not add two solutions

Solution sets of inhomogeneous systems are not closed under addition. Convex or affine combinations with coefficients summing to one remain solutions; arbitrary sums do not. Code operating on solution sets must respect that distinction explicitly.

Treat a large nullity as a modelling signal

A high-dimensional null space usually means the model is under-specified rather than that the design is unusually flexible: missing constraints, duplicated equations or an over-parametrised description. Inspect the null space basis for physical meaning before spending the freedom.

Numerical nullity is a tolerance decision

In floating point the null space is characterised by small rather than zero singular values, and the boundary is a choice. State the tolerance, prefer an SVD-based null space to a row-reduced one for measured data, and report the smallest retained singular value alongside the nullity.

Standards & Codes

Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.

Applicable standards, conventions and reference implementations
ReferenceTitleRelevance to this topic
ISO 80000-2Quantities and units — Part 2: MathematicsFixes the notation for sets, translates and the null space symbol N(A) used to state the decomposition.
LAPACK / BLAS referenceLinear Algebra PACKage reference implementationMinimum-norm particular solutions to rank-deficient systems come from xGELSD; an orthonormal null space basis is obtained from the trailing right singular vectors returned by xGESVD.
IEEE 754-2019IEEE Standard for Floating-Point ArithmeticGoverns the residual arithmetic used to certify a particular solution and to test whether the difference of two solutions is genuinely annihilated by the matrix.
ISO 2394General principles on reliability for structuresUnderpins the equilibrium and superposition arguments used in structural analysis, where the particular-plus-self-stress decomposition is the standard treatment of indeterminate systems.
ISO/IEC 40314Mathematical Markup Language (MathML) Version 3.0Encodes the set-builder and vector expressions on this page so that the affine structure remains machine-readable.

Material Selection

For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.

Representation and precision selection
RepresentationSelect whenTrade-off
Exact rational arithmeticSmall integer systems where the null space basis is to be reported symbolically or checked for exact membership.Gives an unambiguous nullity with no tolerance, but scales badly and can produce unwieldy fractions in the basis vectors.
IEEE 754 binary64 with SVD-based null spaceMeasured or simulated data where the matrix is only approximately rank-deficient.Robust and gives an orthonormal basis with a numerical rank criterion, at roughly ten times the cost of elimination.
IEEE 754 binary64 with row reductionWell-conditioned systems where speed matters and the pivot pattern is trustworthy.Cheap and gives basis vectors with a readable 0/1 pattern, but the rank decision is fragile near dependence.
QR with column pivotingModerate-size dense problems needing both a particular solution and a rank estimate in one factorisation.Cheaper than SVD and rank-revealing in practice, but can fail on contrived matrices and gives a less stable basis.
Sparse iterative solve with null space deflationVery large network or finite element systems with a small, known null space.Keeps memory tractable and converges well once the null space is deflated, but requires the null space to be characterised in advance, usually from the physics.
Complex scalarsPhasor and frequency-domain systems where the right-hand side and null space are complex.The decomposition is unchanged and applies verbatim, at double storage and roughly four times the multiply cost.

Manufacturing Notes

Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.

Cost profile

Obtaining one particular solution costs a factorisation, roughly 23n3 for a dense square system, plus O(n2) per additional right-hand side. Obtaining the null space costs a rank-revealing factorisation, comparable for elimination and around an order of magnitude more for an SVD. Once both are in hand, generating any number of further solutions is O(n(nr)) each.

Certifying the decomposition

Two residual checks certify everything: Awb small relative to b, and Azj small relative to Azj for each basis vector. Checking individual members of the family adds nothing, because any member is a combination of quantities already certified.

Library behaviour

SymPy's linsolve returns a parametrised family that is precisely a particular solution plus a null space combination. NumPy's lstsq returns the minimum-norm particular solution and discards the null space; scipy.linalg.null_space supplies it separately with an explicit rcond. MATLAB's backslash on a rank-deficient system returns a basic solution with zeros in non-pivot positions, which is a different particular solution again — not an error.

Reconciling two solvers

When two tools return different answers to the same under-determined system, subtract them and apply the matrix. If the product is at rounding level the tools agree, having picked different points of the same coset. Only a significant residual indicates a real discrepancy. This test should be built into any regression suite covering under-determined solves.

Exploiting the freedom

To optimise a secondary objective within the solution set, parametrise as x=w+Ut with U holding the null space basis, and optimise over t unconstrained. This eliminates the equality constraints entirely and is the standard null-space method for equality-constrained quadratic programming.

Failure Modes & Common Mistakes

Failure modes, root causes and prevention
Failure mode / mistakeImpactRoot causePrevention & detection
Applying the theorem to an inconsistent systemhighAssuming a particular solution exists without checking consistency.The hypothesis is that at least one solution exists. Test consistency first; if it fails, the solution set is empty and the null space is irrelevant.
Using an approximate particular solutionhighTaking a floating-point solve at face value when the matrix is ill-conditioned.Compute and report the relative residual before using the vector as the anchor of the whole family.
Adding two solutionshighTreating the solution set as if it were a subspace.Only differences of solutions, and affine combinations with coefficients summing to one, stay in the set. Add homogeneous solutions to a particular one, never solutions to each other.
Expecting a unique solution from a singular matrixmediumAssuming that a square system always determines its unknowns.Check the null space. A non-trivial null space forces the count of solutions to be zero or infinite; a solver that returns one answer has silently chosen among many.
Recomputing the null space per right-hand sidelowPlacing the homogeneous solve inside the load-case loop.The null space depends only on the matrix. Compute it once and reuse it for every load case that shares the same geometry.
Confusing nullity with the number of zero rowsmediumReading the count of freedoms off the row count of the reduced form.Nullity is nr, computed from the number of unknowns. Zero rows count redundant equations, which is a different quantity unless m=n.
Reporting a basis-dependent answer as canonicallowTreating a particular null space basis as though it were determined by the problem.Any basis describes the same subspace. When exchanging results, compare the spans, or agree on an orthonormal basis with a fixed sign convention.
Spending the null space freedom without checking physical validitymediumAdding a null space element that satisfies the balances but violates an unmodelled constraint such as non-negativity or a capacity limit.Validate every generated member against the constraints that were left out of the linear model.

FAQs

Does it matter which particular solution I choose?

Not for the description of the set: w+N(A) is the same set for every solution w. It matters for readability and for reporting, since a minimum-norm or physically nominal choice communicates more than an arbitrary one produced by elimination.

Why can a singular system never have exactly one solution?

Because a singular matrix has a non-zero null space vector z. If one solution w exists then w+αz is a solution for every scalar α, giving infinitely many. So the only possibilities are none or infinitely many.

How is this different from the vector form of a solution set?

It is the same fact at a different level of abstraction. The vector form is the constructive recipe that reads a specific particular solution and a specific null space basis off the reduced row-echelon form; this theorem states the structure without reference to any construction, and therefore applies to solutions found by any method.

Can I use the decomposition when the system is over-determined?

Yes, provided it is consistent. Consistency, not the shape of the matrix, is the hypothesis. If an over-determined system is inconsistent, the analogous statement applies to the least-squares problem: the set of minimisers is one minimiser plus N(A).

What does the null space mean physically?

It is the set of changes that the system cannot see: internal redistributions producing no observable effect on the right-hand side. Self-stress states, circulating flows, manipulator self-motions and non-identifiable parameter directions are all instances.

If two solvers give different answers, is one of them wrong?

Not necessarily. Subtract the answers and apply A. If the result is zero to rounding, both are correct and differ only by a null space element. Only a significant residual indicates an actual error.

Does the same structure hold for linear differential equations?

Yes, and for any linear operator. The general solution is a particular integral plus the complementary function, which is the kernel of the differential operator. The algebra is identical; only the space in which the vectors live has changed.

References

  1. Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section LC, Subsection PSHS. Licensed under the GNU Free Documentation License v1.2.
  2. ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
  3. Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
  4. Nocedal, J. and Wright, S. J. Numerical Optimization, 2nd edition. Springer, 2006. (Null-space methods for equality-constrained problems.)
  5. Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.

AI Suggested Questions

  • Given a rank-deficient system, produce two visibly different particular solutions and verify that their difference lies in the null space.
  • Show how the null-space method converts an equality-constrained quadratic programme into an unconstrained one.
  • Why is the set of solutions to a consistent inhomogeneous system an affine set rather than a subspace, and what operations does it support?
  • Compare the particular solution returned by MATLAB backslash, NumPy lstsq and SymPy linsolve on the same rank-deficient system.
  • Explain how the particular-plus-homogeneous structure appears in the general solution of a linear ordinary differential equation.
  • How should the numerical nullity be reported so that a downstream engineer can judge whether a freedom is genuine?

Related Calculators

Continue learning

Algebraic and Geometric Multiplicities of Eigenvalues | KEVOS® MathematicsArticle · Project ManagementAmitsur’s Theorem on the Radical of a Polynomial Ring | KEVOS®Article · Project ManagementAmitsur’s Theorem on the Radical of an Algebra of Small Dimension | KEVOS®Article · Project ManagementArchetypes: Reference Catalogue of Worked Systems | KEVOS® MathematicsArticle · Project Management