Engineering/Mathematics/Eigenvalues
Algebraic and Geometric Multiplicities of Eigenvalues
Each eigenvalue carries two independent counts: how often it repeats as a root of the characteristic polynomial, and how many independent eigenvectors it actually supplies. The inequality governs the relationship, and the gap between the two decides whether a matrix can be diagonalised.
- Advanced level
- Stream: eigen
- Reading time 16 min
- Ref KVS-ENG-MATH-0084
- Taxonomy
- Engineering / Mathematics
- Level
- Advanced
- Prerequisite
- Characteristic polynomial, dimension, similarity
- Core inequality
- Counting law
- Consequence
- At most distinct eigenvalues; means defective
Overview
A repeated eigenvalue is the first place where the theory stops being uniform. When every root of the characteristic polynomial is simple, everything follows automatically: one eigenvector per eigenvalue, of them, independent by the distinct-eigenvalue theorem, and a diagonal representation. As soon as a root repeats, a question opens that the polynomial cannot answer — does the repeated eigenvalue supply as many independent eigenvectors as its repetition count suggests?
The two multiplicities formalise the question. The algebraic multiplicity is read from the factored characteristic polynomial and is a statement about a scalar equation. The geometric multiplicity is the dimension of the eigenspace and is a statement about a subspace. They are produced by different computations from different objects, and there is no reason on the face of it that they should be related at all.
They are related, in one direction only. Every eigenvalue has at least one eigenvector, so . And a similarity argument shows that a -dimensional eigenspace forces at least factors of into the characteristic polynomial, giving . Since the characteristic polynomial has degree exactly , the algebraic multiplicities sum to and none can exceed it. The full chain is .
The practical weight of the inequality is in its strict cases. Summed over all eigenvalues, the algebraic multiplicities always reach ; the geometric multiplicities reach only when every eigenvalue is non-deficient, and that is exactly the condition for a basis of eigenvectors to exist. A single eigenvalue with makes the matrix defective, blocks diagonalisation, and introduces polynomial-in- terms into the response of any dynamic model built on it.
Definition
Algebraic Multiplicity of an Eigenvalue
AMELet be a square matrix with eigenvalue . The algebraic multiplicity is the highest power of that divides the characteristic polynomial .
Since is a root, the factor occurs at least once and . Values with are called simple eigenvalues.
Geometric Multiplicity of an Eigenvalue
GMELet be a square matrix of size with eigenvalue . The geometric multiplicity is the dimension of the eigenspace, .
Computed as the count of non-pivot columns in the reduced row-echelon form of .
Defective Eigenvalue
DEFAn eigenvalue of a square matrix is defective when ; the difference is the defect. A matrix with any defective eigenvalue is itself called defective and admits no basis of eigenvectors.
Concepts
The characteristic polynomial has degree exactly
For an matrix , is a polynomial of degree with leading coefficient . The proof is an induction on size, strengthened to cover a more general array: a square matrix whose entries are complex constants or linear polynomials of the form , with at most one such entry in any row and any column. Cofactor expansion about a row containing one of these entries produces a term of degree one higher than the submatrix's, and every other term comes from a submatrix with one fewer -entry and so contributes lower degree. Since has exactly entries of the form , one in each row and each column, the result applies directly.
Algebraic multiplicities sum to the size
Factoring completely over and grouping equal roots gives with distinct . Comparing degrees on the two sides gives . This is the counting law that closes an eigenvalue search: once the exponents found sum to , no eigenvalue remains undiscovered. It also bounds the number of distinct eigenvalues immediately, since each contributes at least to a sum of : a square matrix of size has at most distinct eigenvalues.
Why the geometric multiplicity cannot exceed the algebraic
Set and take a basis of the eigenspace. Extend it to a basis of with further vectors and assemble all vectors as the columns of a matrix . The columns are independent by construction, so is non-singular and hence invertible. Because , the identity holds for . Computing column by column, the first columns become — zero everywhere except a on the diagonal.
Completing the argument through similarity
A determinant identity shows that and have the same characteristic polynomial, since can be inserted around and the factors recombined. Expanding down each of the first columns in turn extracts a factor each time, leaving for some square matrix of size . So divides at least times, which is precisely . The final bound follows from the counting law, since multiplicities are positive and they sum to .
The defect and what it costs
Summing over all distinct eigenvalues gives , with equality precisely when no eigenvalue is defective. The left-hand sum is the total number of independent eigenvectors available, because eigenvectors drawn from distinct eigenspaces are independent. Equality is therefore exactly the condition for a basis of made of eigenvectors, and hence for diagonalisability. When the sum falls short, the shortfall is the total defect, and it is the number of generalised eigenvectors that must be adjoined to complete a basis.
Where the two multiplicities cannot differ
Two common situations remove the question entirely. If then the inequality forces equality, so simple eigenvalues are never defective — a matrix with distinct eigenvalues is always diagonalisable. If is Hermitian, or real and symmetric, then a full orthonormal eigenvector basis exists and every eigenvalue satisfies regardless of repetition. Defectiveness is therefore confined to non-normal matrices with repeated eigenvalues, which is a small but operationally important corner of the subject.
Determining the multiplicities of an eigenvalue
Equations
Degree of the characteristic polynomial
EQ-ME-01Exactly entries of contain the indeterminate, one per row and one per column, and each contributes one degree to the leading term.
Complete factorisation and the counting law
EQ-ME-02Degrees must agree on both sides, so the algebraic multiplicities of the distinct eigenvalues account for exactly roots.
Multiplicity inequality
EQ-ME-03The central result. Both multiplicities are positive, the geometric never exceeds the algebraic, and neither exceeds the size of the matrix.
Maximum number of distinct eigenvalues
EQ-ME-04Each distinct eigenvalue contributes at least one to a total of , so a matrix of size has at most distinct eigenvalues.
Similarity factorisation used in the proof
EQ-ME-05Extending an eigenspace basis to a basis of exposes factors of explicitly, which is the mechanism behind .
Diagonalisability criterion
EQ-ME-06The geometric multiplicities sum to exactly when no eigenvalue is defective, which is exactly when the matrix is diagonalisable.
Defect of a matrix
EQ-ME-07The number of generalised eigenvectors that must be adjoined to the eigenvectors to complete a basis of .
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Matrix | The square matrix under examination | n x n complex matrix | |
| Size | Common row and column count; also the degree of | positive integer | |
| Distinct eigenvalue count | Number of distinct roots of the characteristic polynomial | 1 to n | |
| Algebraic multiplicity | Exponent of in the factored characteristic polynomial | 1 to n | |
| Geometric multiplicity | Dimension of the eigenspace for | 1 to alpha | |
| Eigenspace | , all eigenvectors for plus | subspace of C^n | |
| Basis matrix | Non-singular matrix whose first columns are an eigenspace basis | n x n non-singular | |
| Residual block | Square matrix of size left after extracting the factor | (n-g) x (n-g) matrix | |
| Characteristic polynomial | , of degree | polynomial over C |
Worked Numerical Example
Problem statement
A three-state coupled actuator model has state matrix . A preliminary analysis found a repeated pole and concluded that the model has two independent slow modes. Determine both multiplicities for every eigenvalue and assess whether that conclusion is justified.
State the matrix
The third state is driven by the first two but does not feed back into them, which shows as a column of zeros above the diagonal:
Expand the determinant down the third column
Only the entry of that column is non-zero, so a single cofactor term survives and the determinant collapses to a one.
Factor the characteristic polynomial
The bracket expands to , a perfect square. Writing the result in monic form gives the algebraic multiplicities directly.
Record the algebraic multiplicities and check the counting law
The eigenvalues are with and with . Their sum is , as required. The weighted eigenvalue sum matches , and the weighted product matches .
Geometric multiplicity of the simple eigenvalue
For the algebraic multiplicity is , so the inequality settles the matter without any computation. Reducing confirms two pivot columns and the eigenvector below.
Geometric multiplicity of the repeated eigenvalue
This is the case that requires work. Form and reduce. Rows one and two are identical, but the third row is not a multiple of them, so the rank is , not .
Read the eigenspace dimension
The reduced form has pivot columns and , leaving one free variable. So and , strictly less than .
Total the counts and conclude
The geometric multiplicities sum to , so there are only two independent eigenvectors in a three-dimensional space. The matrix is defective with defect , and the preliminary claim of two independent slow modes is wrong: the repeated pole at supplies exactly one eigenvector, not two.
The model has a defective eigenvalue at with defect . Practically this means the matrix cannot be diagonalised and the free response contains a term proportional to alongside the pure exponential. Any simulation or controller tuning that assumed a decomposition into three independent exponential modes will underestimate the transient amplitude, and a generalised eigenvector must be computed to complete the basis.
Applications & Industry Use
Repeated poles and transient overshoot
A defective pole of a continuous-time model contributes terms to the free response rather than a pure exponential, producing an initial rise before the eventual decay. Gain schedules tuned against a purely exponential assumption will underpredict peak deviation, so the multiplicity comparison belongs in the model review checklist for every repeated pole.
Multiplicity of natural frequencies in symmetric structures
Symmetric structures produce repeated natural frequencies whose eigenspaces are genuinely multi-dimensional, so geometric and algebraic multiplicities agree. Any modal extraction that returns fewer independent mode shapes than the repetition count indicates a modelling artefact — typically a non-symmetric damping or follower-force term — rather than a physical property.
Counting independent conservation laws
The geometric multiplicity of the zero eigenvalue of a stoichiometric or Jacobian matrix is the number of independent conserved quantities in the network. The algebraic multiplicity may be larger, and where it is, the extra factor signals a slowly drifting near-invariant rather than a strict conservation law.
Degenerate spectra in graph analysis
Highly symmetric graphs produce adjacency and Laplacian spectra with large multiplicities. Because these matrices are symmetric, the eigenvalue repetition is always matched by eigenspace dimension, so spectral embedding must select a basis of a subspace rather than a unique set of eigenvectors — a fact that explains why repeated runs can produce rotated but equivalent embeddings.
Mode coalescence at flutter onset
As airspeed approaches the flutter boundary, two structural modes migrate together and the state matrix approaches a defective configuration where two eigenvalues merge but the eigenvectors do not span two dimensions. The near-defect makes the eigenvectors nearly parallel and the eigenvalue sensitivity extremely large, which is the mathematical signature of the instability.
Eigenvalue sensitivity near a defect
The sensitivity of an eigenvalue to parameter perturbation is inversely proportional to the inner product of its left and right eigenvectors, which tends to zero as an eigenvalue becomes defective. Near-defective modes therefore move enormous distances under small changes in loading, and identifying them by their multiplicity gap is a prerequisite for robust small-signal assessment.
Design Considerations
Compute the geometric multiplicity for every repeated eigenvalue
The characteristic polynomial cannot distinguish a diagonalisable repeated eigenvalue from a defective one. Any workflow that reports only algebraic multiplicities has left the decisive question unanswered. Add an explicit rank computation of for each repeated root.
Use the inequality to skip work on simple eigenvalues
When , the inequality pins with no computation. For a matrix with all distinct eigenvalues this eliminates the entire multiplicity analysis and guarantees diagonalisability, which is why checking for distinctness first is worth the effort.
Treat defectiveness as structurally fragile
Defective matrices are not generic: an arbitrarily small perturbation of a defective matrix almost always has distinct eigenvalues and is diagonalisable. A model that is exactly defective is usually exactly defective for a structural reason — an idealisation, a symmetry, an exactly repeated component. Where the defect arises from a modelling assumption, test whether it survives realistic parameter variation.
Do not test for defectiveness in floating point alone
Near-defective and exactly defective matrices are numerically indistinguishable: both produce nearly parallel eigenvectors and clustered eigenvalues. The correct instrument is the condition number of the eigenvector matrix, or a Schur or Jordan-structure analysis, rather than an equality test on computed multiplicities.
Exploit symmetry to remove the question
Hermitian and real symmetric matrices are never defective; every eigenvalue satisfies and an orthonormal eigenvector basis always exists. Where a model can be formulated symmetrically — a stiffness matrix, a covariance, a Gram matrix — doing so removes an entire class of failure at no analytical cost.
Budget for generalised eigenvectors when a defect is real
If the defect is genuine and must be handled, the shortfall is exactly the number of generalised eigenvectors required. These are found by solving for an existing eigenvector , and they complete a basis in which the matrix takes Jordan rather than diagonal form.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Governs the Greek symbols and used for the two multiplicities and the presentation of the summation and product notation on this page. |
LAPACK reference implementation | Linear Algebra PACKage driver routines | xGEESX and xGEEVX return reciprocal condition numbers for eigenvalues and eigenvectors, which are the practical numerical proxy for detecting near-defective behaviour that a multiplicity count cannot see. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Sets the rounding behaviour that makes an exact multiplicity determination impossible in floating point, since a defective double root is perturbed to two distinct roots at the square root of the unit roundoff. |
ISO 7626 | Mechanical vibration and shock — Experimental determination of mechanical mobility | Experimental modal identification under this standard must resolve repeated natural frequencies, where the eigenspace dimension rather than the frequency count determines how many independent mode shapes exist. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the multiplicity inequality and the summation expressions as semantic markup so that the relationships remain machine-readable. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic | Multiplicities must be certified, as in a symbolic model review or a published result. | The only representation in which can be established with certainty; limited to matrices whose characteristic polynomial factors over the rationals. |
| Arbitrary-precision floating point | The polynomial does not factor rationally but multiplicities must still be resolved to high confidence. | Allows a repeated root to be separated from a close pair by increasing precision until the behaviour stabilises, at a substantial runtime cost. |
| IEEE 754 binary64 | Routine numerical eigenanalysis of engineering models. | Sufficient for eigenvalues and eigenvectors but incapable of a reliable multiplicity decision; supplement with eigenvector condition numbers. |
| Schur form rather than eigendecomposition | A matrix is suspected of being defective or near-defective and a stable factorisation is needed. | Always exists and is computed by orthogonal transformations, so it is numerically robust; it gives eigenvalues and invariant subspaces but not eigenvectors directly. |
| Symmetric or Hermitian storage | The matrix is known self-adjoint, guaranteeing throughout. | Removes defectiveness by construction and halves the computational cost, but silently invalid if the assembly code does not enforce exact symmetry. |
| Rational canonical or Jordan structure computation | The Jordan block sizes, not just the multiplicities, are required. | Gives the complete similarity invariants including block sizes, but is numerically unstable and viable only in exact arithmetic on modest sizes. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of the multiplicity comparison
Algebraic multiplicities come free with the factorisation of . Each geometric multiplicity costs one row reduction of an matrix, about operations, and is required only for repeated eigenvalues. For a matrix with repeated eigenvalues the additional work is , which is comparable to a single eigendecomposition when is small.
Computing the rank reliably
The geometric multiplicity is minus the rank of , and rank in floating point is a tolerance decision. Determine it from the singular values of with a threshold scaled to and the machine epsilon, not from a count of non-zero pivots in a row reduction, which is far more sensitive to rounding.
Library behaviour
sympy.Matrix.eigenvects returns each eigenvalue with its algebraic multiplicity and a basis of its eigenspace, so the geometric multiplicity is the length of that basis and the comparison is immediate. sympy.Matrix.jordan_form exposes the block structure, which refines the multiplicity data further. NumPy provides neither; numpy.linalg.matrix_rank applied to is the closest numerical equivalent.Detecting near-defectiveness numerically
Compute the eigenvector matrix and its condition number . A well-separated diagonalisable matrix gives a modest value; a near-defective one gives a value approaching the reciprocal of the machine epsilon. This single scalar is more informative than any comparison of computed multiplicities and should accompany any reported eigendecomposition of a non-symmetric matrix.
Finding generalised eigenvectors
Where a defect exists, extend the basis by solving with an existing eigenvector for . The system is consistent precisely when lies in the column space of , which is what the defect guarantees for at least one choice of . Each solve is one row reduction, and the chain continues until the count of vectors for reaches .
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Inferring eigenspace dimension from the polynomial | high | Reading off the factorisation and reporting it as the number of independent eigenvectors. | Compute for every repeated eigenvalue. The two counts come from different objects. |
| Assuming eigenvectors always exist | high | Treating diagonalisability as automatic and building a modal transformation matrix that turns out to be singular. | Verify that the geometric multiplicities sum to before assembling any eigenvector basis, and check that the assembled matrix is invertible. |
| Believing can exceed | medium | Miscounting free variables in the reduced form, or reducing the wrong matrix. | The inequality is a theorem; a computed is always an arithmetic error. Re-derive both counts. |
| Declaring a matrix defective from floating-point output | high | Observing two nearly equal computed eigenvalues and nearly parallel eigenvectors, and concluding an exact defect. | Base the claim on exact arithmetic or on structural reasoning. Report eigenvector condition numbers as evidence of near-defectiveness instead. |
| Stopping the factorisation early | medium | Finding roots and not confirming that the algebraic multiplicities sum to . | Divide out each factor found and continue until the quotient is constant. The degree of is exactly , so the sum is a complete audit. |
| Confusing defect with rank deficiency | medium | Equating a defective eigenvalue with a singular matrix, or assuming defect implies . | Defectiveness concerns the structure of an eigenspace at any eigenvalue; singularity concerns the eigenvalue zero specifically. A non-singular matrix can be defective, and a singular matrix can be diagonalisable. |
| Assuming a symmetric matrix can be defective | low | Applying general defective-case handling to a Hermitian or real symmetric matrix. | Self-adjoint matrices always satisfy . Exploit the guarantee rather than testing for it, and use the symmetric eigensolver. |
| Counting geometric multiplicities across different eigenvalues | low | Adding eigenvector counts from distinct eigenvalues into a single eigenspace dimension. | Each eigenvalue owns its own eigenspace. The sum of the geometric multiplicities measures the total eigenvector supply, not the dimension of any one subspace. |
FAQs
Why can the geometric multiplicity never exceed the algebraic multiplicity?
Because a -dimensional eigenspace can be extended to a basis of , and the resulting similarity transformation puts columns of the transformed matrix into the form . Expanding the determinant down each of those columns extracts factors of from the characteristic polynomial, so the algebraic multiplicity is at least . Similar matrices share a characteristic polynomial, which is what transfers the conclusion back to .
What does it mean in practice for a matrix to be defective?
It means the matrix has fewer than independent eigenvectors, so no basis of eigenvectors exists and the matrix cannot be diagonalised. For a dynamic model this shows up as response terms of the form rather than pure exponentials, and computationally it means the eigenvector matrix is singular and any modal decomposition built on it fails.
Can a matrix with all distinct eigenvalues be defective?
No. Distinct eigenvalues all have algebraic multiplicity one, and the inequality forces geometric multiplicity one as well. Such a matrix always has independent eigenvectors and is always diagonalisable, which is why checking for distinctness is the fastest route to a diagonalisability decision.
How is the number of distinct eigenvalues bounded?
By the size of the matrix. Each distinct eigenvalue contributes an algebraic multiplicity of at least one, and those multiplicities sum to exactly because the characteristic polynomial has degree . So the count of distinct eigenvalues is at most , with equality precisely when every eigenvalue is simple.
Why is the characteristic polynomial guaranteed to have degree exactly ?
Because contains exactly entries involving , one in each row and one in each column, and each contributes one degree to the highest-order term of the determinant expansion. Every other product in the expansion misses at least one diagonal entry and therefore contributes lower degree. The leading coefficient is .
Can I detect defectiveness from a numerical eigensolver?
Not reliably. In floating point a defective matrix presents as clustered eigenvalues with nearly parallel eigenvectors, exactly as a near-defective but diagonalisable matrix would. The practical diagnostic is the condition number of the eigenvector matrix, which grows without bound as a defect is approached, or an eigenvalue condition estimate from a driver such as xGEEVX.
If a matrix is defective, what completes the basis?
Generalised eigenvectors. For an eigenvalue with defect , one solves starting from an existing eigenvector and continues the chain until vectors are associated with . In the resulting basis the matrix takes Jordan form: diagonal blocks with on the diagonal and ones on the superdiagonal.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section PEE, Subsection ME. Licensed under the GNU Free Documentation License v1.2.
- Horn, R. A. and Johnson, C. R. Matrix Analysis, 2nd edition. Cambridge University Press, 2012. Section 1.4 and Chapter 3, Canonical Forms.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013. Section 7.1, Properties and Decompositions.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
AI Suggested Questions
- Construct a matrix with a single eigenvalue of algebraic multiplicity four and geometric multiplicity two, and show its Jordan structure.
- Explain why an arbitrarily small perturbation of a defective matrix is almost always diagonalisable, and what that implies for numerical analysis.
- How does the defect of an eigenvalue relate to the sizes of its Jordan blocks?
- Derive the sensitivity of a simple eigenvalue to matrix perturbation in terms of its left and right eigenvectors, and show what happens as a defect is approached.
- Give an example of a singular matrix that is diagonalisable and a non-singular matrix that is defective.
- Show how to compute a generalised eigenvector for a defective eigenvalue and verify that it completes a basis.
