Engineering/Mathematics/Eigenvalues
Properties of Eigenvalues and Eigenvectors
Once a spectrum is known, a family of theorems delivers the spectra of related matrices for free: scalar multiples, powers, polynomials, inverses and transposes all inherit their eigenvalues by a simple rule. A separate result — that eigenvectors for distinct eigenvalues are linearly independent — is the structural fact that makes diagonalisation possible at all.
- Core level
- Stream: eigen
- Reading time 16 min
- Ref KVS-ENG-MATH-0083
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Eigenvalues, linear independence, matrix inverses
- Key theorem
- Distinct eigenvalues independent eigenvectors
- Singularity test
- singular is an eigenvalue
- Spectral rule
- Not true for
- Sums and products of unrelated matrices
Overview
Computing a spectrum from the characteristic polynomial is expensive. Computing it a second time for a closely related matrix is usually unnecessary, because the operations that engineers actually apply to matrices — scaling, raising to a power, forming a polynomial, inverting, transposing — move the eigenvalues in an entirely predictable way while leaving the eigenvectors alone. Each of the theorems below is proved by the same short argument: start from , apply the operation to both sides, and read off the new eigenvalue.
The reason the eigenvectors survive is worth stating plainly. On the subspace spanned by a single eigenvector, the matrix acts as multiplication by a scalar. Any expression built from and the identity by addition and multiplication therefore acts on that same subspace as the corresponding expression in . This is the conceptual content of the whole family of results, and it is why a polynomial in has eigenvalues given by the same polynomial evaluated at the eigenvalues of .
The boundaries of the technique matter as much as its reach. There is no theorem giving the eigenvalues of or in terms of the eigenvalues of and separately. The obstruction is exactly that two unrelated matrices do not share eigenvectors, so the argument above has nothing to work with. Assuming otherwise is one of the most consequential errors in applied linear algebra, and it recurs in stability analysis of coupled subsystems.
Two results on this page stand apart from the operational family. Eigenvectors belonging to distinct eigenvalues are always linearly independent — a fact that requires a genuine induction and that underwrites every diagonalisation argument. And a matrix is singular precisely when zero is one of its eigenvalues, which slots the spectrum directly into the standing list of equivalent conditions for non-singularity.
Definition
Spectrum of a Matrix
SPECThe spectrum of a square matrix , written , is the set of all its eigenvalues — equivalently the set of distinct roots of the characteristic polynomial . For an matrix over the spectrum is a non-empty set of at most complex numbers.
The spectrum records only which values occur, not how often. Multiplicity information is carried separately by and .
Polynomial of a Matrix
PMFor a square matrix of size and a polynomial , the matrix is defined as . The constant term becomes a multiple of the identity, since a scalar cannot be added to a matrix.
Powers are defined by repeated multiplication with . Because every term is a power of the same matrix, all terms commute with one another.
Concepts
Eigenvectors for distinct eigenvalues are linearly independent
Let be a square matrix and let be eigenvectors of for eigenvalues that are pairwise distinct. Then is linearly independent. The proof takes the shortest dependent initial segment and writes a non-trivial relation . Multiplying by replaces each by ; multiplying instead by the scalar replaces each by . Subtracting removes the -th term entirely and leaves for on a set already known to be independent. Distinctness forces , hence every , and the surviving relation forces because eigenvectors are non-zero. The relation was not non-trivial after all.
Zero eigenvalues detect singularity
A square matrix is singular if and only if is an eigenvalue of . The equivalence is immediate once written out: is singular exactly when some satisfies , and , which is the eigenvalue equation with . Taking the contrapositive adds a new entry to the standing list of conditions equivalent to non-singularity: is non-singular if and only if . This is the reason an eigenvalue computation doubles as an invertibility test, and why the eigenspace for is exactly .
Scalar multiples and powers
If then , so is an eigenvalue of with the same eigenvector. Powers follow by induction: assuming , applying once more gives , with the base case reading . So is an eigenvalue of for every integer . This is the analytical basis for reasoning about long-run behaviour: grows or decays according to the largest , the spectral radius.
Polynomials of a matrix and spectral shaping
Combining the previous two results term by term gives the strongest statement of the family: if is an eigenvalue of and is any polynomial, then is an eigenvalue of , and remains an eigenvector. Over the converse also holds, so is exactly the image — the spectral mapping theorem. The engineering consequence is constructive: to obtain a matrix with a prescribed spectrum, build an interpolating polynomial that sends each existing eigenvalue to its target and apply it to . Multiplicities are not preserved by this construction, because may map two distinct eigenvalues to the same value.
Inverses and transposes
If is non-singular with eigenvalue , then (otherwise the matrix would be singular) and , so the inverse has the reciprocal eigenvalues with identical eigenvectors. The transpose behaves differently. From applied to it follows that , so and have identical characteristic polynomials, identical eigenvalues and identical algebraic multiplicities. Their eigenvectors are generally different: the eigenvectors of are the left eigenvectors of , and confusing the two is a common and silent error in modal analysis of non-symmetric systems.
Real matrices produce conjugate pairs
Suppose has real entries and . Conjugating every entry of both sides gives , and because the entries are real, so is an eigenvector of for . Complex eigenvalues of a real matrix therefore arrive in conjugate pairs with conjugate eigenvectors, and computing one member of a pair determines the other with no further work. The same conclusion follows from the characteristic polynomial having real coefficients, but the direct argument also delivers the eigenvector relationship.
What does not transfer
There is no theorem of the form or for general matrices, and both statements are false in easily constructed examples. The proofs above work only because every matrix involved is built from a single and therefore shares its eigenvectors. Two matrices with a common eigenvector do inherit the additive and multiplicative rule on that vector, which is why simultaneously diagonalisable families — equivalently, commuting families — are the exception that recovers the intuition.
Deriving a related spectrum without recomputation
Equations
Independence of eigenvectors for distinct eigenvalues
EQ-PEE-01Eigenvectors chosen one per distinct eigenvalue are always independent, regardless of the size or structure of the matrix.
Singularity and the zero eigenvalue
EQ-PEE-02The eigenvalue , a trivial null space and a vanishing determinant are three descriptions of the same condition.
Scalar multiple and integer powers
EQ-PEE-03Both operations leave the eigenvector untouched and transform the eigenvalue by the same scalar operation.
Polynomial of a matrix
EQ-PEE-04The spectral mapping rule. Building as an interpolating polynomial through prescribed target values produces a matrix with a designed spectrum.
Inverse and transpose
EQ-PEE-05The inverse has reciprocal eigenvalues with the same eigenvectors; the transpose has identical eigenvalues and multiplicities but different eigenvectors.
Conjugate pairs for a real matrix
EQ-PEE-06Conjugating the eigenvalue equation of a real matrix produces a second, genuinely distinct eigenpair whenever is not real.
Spectral radius and asymptotic growth
EQ-PEE-07A direct consequence of the power rule: the largest eigenvalue modulus decides whether repeated application of decays or grows.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Matrix | The square matrix whose spectrum is known | n x n complex matrix | |
| Eigenvalue | An element of the spectrum of | complex number | |
| Eigenvector | Non-zero vector satisfying | non-zero vector in C^n | |
| Scalar factor | Multiplier applied to the whole matrix | complex number | |
| Power index | Exponent in , with | non-negative integer | |
| Polynomial | Polynomial applied to the matrix to reshape its spectrum | polynomial over C | |
| Spectrum | Set of distinct eigenvalues of | subset of C | |
| Spectral radius | Largest modulus among the eigenvalues | non-negative real | |
| Transpose | Matrix with rows and columns interchanged | n x n matrix |
Worked Numerical Example
Problem statement
A discrete-time process model has state matrix with known spectrum. A designer proposes replacing the plant model by a shaped version intended to place two of the three modes at the origin. Derive the spectra of , , , and without recomputing any characteristic polynomial.
Start from the known spectrum
The base matrix is symmetric and tridiagonal, with eigenvalues and eigenvectors established by direct computation:
Scalar multiple
Doubling the matrix doubles every eigenvalue and changes no eigenvector. The check is immediate: .
Square of the matrix
Squaring squares each eigenvalue. Since , repeated application of grows without bound — a discrete-time model with this state matrix is unstable, and no amount of eigenvector analysis changes that conclusion.
Inverse
No eigenvalue is zero, so is non-singular and the inverse exists. Its eigenvalues are the reciprocals, with the same eigenvectors. Their product equals , confirming the arithmetic.
Transpose
Here is symmetric, so and the spectra coincide trivially. For a non-symmetric matrix the eigenvalues would still coincide, but the eigenvectors of would be the left eigenvectors of and would generally point in different directions.
Construct the shaping polynomial
The design goal is to send and while leaving the middle mode non-zero. A polynomial with roots at and does exactly this, and its value at follows automatically.
Form and read its spectrum
Substituting the matrix for the indeterminate, with the constant term becoming , gives a rank-one matrix. The spectral mapping rule predicts eigenvalues , so now has algebraic multiplicity — the polynomial has merged two originally distinct eigenvalues.
Verify the eigenvector claim
The eigenvector of for is . Multiplying, . The eigenvector is unchanged and the eigenvalue is , exactly as predicted.
Five related spectra were obtained from one computation. The shaped matrix is singular by construction, since zero entered its spectrum the moment the polynomial was given roots at two existing eigenvalues; its rank is and its null space is the plane spanned by the eigenvectors for and . The example also exposes the limit of the technique: multiplicities are not preserved, so the merged eigenvalue at zero must have its geometric multiplicity checked independently rather than inherited.
Applications & Industry Use
Stability from the spectral radius
A discrete-time model decays to the origin from every initial state exactly when every eigenvalue has modulus less than one. The power rule is what licenses that statement: on each eigenvector the state is multiplied by , and the slowest-decaying mode is the one with the largest .
Reciprocal spectra in flexibility and stiffness
Flexibility is the inverse of stiffness, so the flexibility matrix has the reciprocal eigenvalues of the stiffness matrix with identical mode shapes. The softest structural mode is therefore the stiffest flexibility mode, and an analysis performed in one formulation transfers to the other without recomputation.
Convergence of iterative solvers
Stationary iterations such as Jacobi and Gauss-Seidel converge if and only if the iteration matrix has spectral radius below one, and the asymptotic rate is governed by that value. Preconditioning is precisely the practice of replacing the iteration matrix by a related one, often a polynomial in the original, with a smaller spectral radius.
Zero eigenvalues as conservation laws
A zero eigenvalue in a linearised network model is equivalent to singularity of the system matrix, and the associated eigenvector identifies a conserved combination of species. Detecting it through the spectrum rather than through a failed matrix inversion gives the diagnosis and the conserved quantity in one step.
Left eigenvectors and participation factors
Modal analysis of a power network uses the eigenvectors of to describe mode shape and the eigenvectors of to describe mode observability. Because both matrices share a spectrum but not their eigenvectors, the two sets must be computed and labelled separately; combining them elementwise gives the participation factors used to site damping controllers.
Designed spectra by polynomial shaping
Where a plant matrix must be modified to place modes at target locations without changing the physical eigenvectors, an interpolating polynomial applied to the matrix achieves it directly. The construction guarantees the intended eigenvalue placement while preserving every mode shape, which is valuable when the mode shapes have physical meaning that must be retained.
Design Considerations
Never assume eigenvalues add or multiply across matrices
The eigenvalues of bear no simple relation to those of and unless the two matrices share a full set of eigenvectors, which is equivalent to their commuting. Coupled subsystems almost never commute, so the stability of an interconnection cannot be inferred from the stability of its parts. Compute the spectrum of the combined matrix.
Distinguish right from left eigenvectors
and have the same eigenvalues, and this equality tempts practitioners to treat their eigenvectors as interchangeable. They are not, except when the matrix is symmetric. Any code that assembles a modal transformation must be explicit about which side it is using, and any documentation should name the convention.
Check invertibility through the spectrum when it is already available
If eigenvalues have been computed for another purpose, invertibility is free: the matrix is non-singular exactly when no eigenvalue is zero, and the condition number in the two-norm of a normal matrix is the ratio of largest to smallest eigenvalue modulus. For non-normal matrices this ratio is a lower bound, not the condition number, and singular values must be used instead.
Recount multiplicities after a spectral mapping
A polynomial can send two distinct eigenvalues to the same image, merging their algebraic multiplicities, and it can send an eigenvalue to zero, making a non-singular matrix singular. The eigenvectors carry across, but the multiplicity bookkeeping does not. Recount on the image spectrum.
Beware inverting near-zero eigenvalues numerically
The theorem that has eigenvalues is exact, but it also explains why inversion amplifies error: an eigenvalue computed with absolute error near zero produces a reciprocal with error of order . Where the smallest eigenvalue is close to the noise floor, solve a linear system rather than forming an inverse.
Use the power rule for asymptotics, not for computation
Knowing that has eigenvalues answers questions about growth and decay, but computing by repeated multiplication is both expensive and numerically poor for large . Use a diagonalisation or a scaling-and-squaring scheme, and reserve the eigenvalue rule for the qualitative conclusion.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Sets the conventions for the conjugate bar, the transpose superscript and the use of upright operator names, all of which appear throughout the theorems on this page. |
IEC 61508 | Functional safety of electrical/electronic/programmable electronic safety-related systems | Stability arguments submitted in a safety case for a digital controller rest on the spectral radius of the closed-loop state matrix, which is the power rule applied to the discretised model. |
LAPACK reference implementation | Linear Algebra PACKage driver routines | xGEEV optionally returns left eigenvectors alongside right ones precisely because the transpose shares eigenvalues but not eigenvectors; the two output arrays must not be confused. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Governs the accuracy of reciprocal eigenvalues and of repeated squaring, where the standard's rounding guarantees bound the error growth in the power rule. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the set-valued spectral notation and the conjugate and transpose accents used here as semantic markup rather than images. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic for polynomial shaping | Constructing an interpolating polynomial to place a spectrum, where the coefficients must be exact for the target values to be hit precisely. | Guarantees the designed eigenvalues exactly, but the coefficients of a high-degree interpolant grow large and the resulting matrix polynomial becomes expensive to form. |
| IEEE 754 binary64 | Routine engineering spectra, stability margins and spectral radius estimates. | Adequate for all qualitative conclusions, but reciprocals of small eigenvalues and high powers both amplify rounding error substantially. |
| Complex binary64 pairs | Real matrices with oscillatory modes, where conjugate pairs must be stored and manipulated. | Doubles storage per eigenvalue but keeps the conjugate structure explicit; halving the computation by conjugation recovers most of the cost. |
| Symmetric or Hermitian storage | The matrix equals its own transpose or adjoint, as for stiffness, covariance and Gram matrices. | Left and right eigenvectors coincide, eliminating an entire class of error, and the eigenvalues are guaranteed real; the assumption must be enforced at assembly time. |
| Scaled fixed-point | Embedded controllers where the stability test must be evaluated on a device without floating-point hardware. | Deterministic timing and small footprint, but the limited dynamic range makes eigenvalues near the unit circle indistinguishable from those on it. |
| Interval arithmetic | A certified bound on the spectral radius is needed rather than an estimate. | Produces guaranteed enclosures suitable for a formal argument, at a large runtime cost and with intervals that widen quickly under repeated squaring. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost of deriving a related spectrum
Every rule on this page is free in the computational sense: the derived eigenvalues cost scalar operations once the base spectrum is known, against for a fresh eigendecomposition. For a matrix polynomial the only real expense is forming itself, which requires matrix multiplications at operations each, or fewer using Horner's scheme.
Forming a matrix polynomial correctly
Evaluate by Horner's rule in matrix form: start from , then repeatedly multiply by and add . This uses matrix products rather than computing each power separately, and it never requires storing more than two intermediate matrices. Remember that the constant term becomes ; adding a bare scalar to a matrix is undefined.
Library behaviour for left eigenvectors
scipy.linalg.eig accepts left=True and right=True flags and returns the left eigenvectors satisfying , that is the eigenvectors of the conjugate transpose rather than the plain transpose. NumPy's numpy.linalg.eig returns right eigenvectors only; obtaining left eigenvectors requires an explicit call on the transposed matrix.Verification of a derived spectrum
Each derived spectrum admits its own cheap check. Compare the sum of the derived eigenvalues against the trace of the derived matrix and their product against its determinant. For the inverse, confirm that the product of all eigenvalues of and of is . For a polynomial mapping, verify one eigenpair by direct multiplication as in the worked example.
Numerical caution with high powers
Computing by repeated multiplication accumulates error proportional to and can overflow when or underflow when . Scaling-and-squaring reduces the operation count to products and is the standard approach; where only the asymptotic behaviour matters, use the spectral radius and do not form the power at all.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Assuming | high | Extending the scalar-multiple and power rules to two unrelated matrices. | The rules hold only for expressions built from a single matrix. For a sum or product of distinct matrices, compute the spectrum of the combined matrix directly. |
| Using eigenvectors of as eigenvectors of | high | Correctly noting that the two matrices share a spectrum and incorrectly assuming they share eigenvectors. | Compute right and left eigenvectors separately and label them. They coincide only when the matrix is symmetric or, more generally, normal. |
| Inverting a matrix with a zero eigenvalue | high | Applying the reciprocal rule without first confirming non-singularity. | Check that before using . A zero eigenvalue is exactly the condition under which the inverse does not exist. |
| Copying multiplicities through a polynomial map | medium | Assuming when merges two eigenvalues. | Recount algebraic multiplicities on the image spectrum, and compute geometric multiplicities from the null space of . |
| Adding a scalar to a matrix in a polynomial | medium | Writing instead of . | The constant term of a matrix polynomial is always a multiple of the identity. Most libraries will broadcast the scalar to every entry instead and produce a silently wrong matrix. |
| Concluding independence from repeated eigenvalues | medium | Applying the distinct-eigenvalue independence theorem to a set of eigenvectors that includes two for the same eigenvalue. | The theorem covers one eigenvector per distinct eigenvalue. Within a single eigenspace, independence must be established from the null space basis itself. |
| Reading the condition number off the eigenvalues | medium | Taking as the two-norm condition number of a non-normal matrix. | That ratio equals the condition number only for normal matrices. Otherwise use singular values, which can differ from eigenvalue moduli by orders of magnitude. |
| Expecting real eigenvalues from a real matrix | low | Ignoring that conjugate pairs are the normal outcome for a non-symmetric real matrix. | Work over throughout, and require symmetry or another structural property if real eigenvalues are needed. |
FAQs
Why are eigenvectors for distinct eigenvalues automatically independent?
Because a dependence relation among them can be attacked from two sides. Multiplying the relation by scales each term by its own eigenvalue; multiplying by one of the eigenvalues scales every term equally. Subtracting eliminates one term and leaves a relation whose coefficients each carry a factor . Distinctness makes those factors non-zero, forcing every coefficient to vanish and contradicting the assumed dependence.
If and have the same eigenvalues, do they have the same eigenvectors?
No, not in general. The equality of spectra follows from applied to , which says nothing about eigenvectors. The eigenvectors of are the left eigenvectors of and generally point elsewhere. They coincide when is symmetric, and more broadly when is normal.
Can I compute the eigenvalues of from those of and ?
Not in general. There is no formula, and simple counterexamples exist with matrices. What is true is that and share the same non-zero eigenvalues with the same multiplicities, and that if and commute they can be simultaneously triangularised, so their eigenvalues can be paired multiplicatively.
Does the polynomial rule give all the eigenvalues of or only some?
Over the complex numbers it gives all of them: the spectrum of is exactly the image of the spectrum of under . The elementary argument only proves the inclusion in one direction, which is enough for most engineering purposes, but the equality is a standard result and is what makes spectral shaping a reliable design technique.
What happens to the eigenvalues when I add a multiple of the identity?
They shift by that multiple: has eigenvalues with unchanged eigenvectors. This is the degenerate case of the polynomial rule with , and it is the mechanism behind shift strategies in iterative eigensolvers, which move a target eigenvalue near zero to accelerate convergence.
Is the spectral radius the same as the matrix norm?
No. The spectral radius is always at most any induced matrix norm, and the two coincide for the two-norm only when the matrix is normal. A non-normal matrix can have spectral radius below one and still exhibit large transient growth in before eventual decay, which is why transient analysis cannot rest on eigenvalues alone.
Why does the power rule require ?
Because for negative means a power of the inverse, which only exists when is non-singular. Under that additional hypothesis the rule does extend: has eigenvalues , combining the power rule with the inverse rule. Without non-singularity, negative powers are undefined.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section PEE. Licensed under the GNU Free Documentation License v1.2.
- Horn, R. A. and Johnson, C. R. Matrix Analysis, 2nd edition. Cambridge University Press, 2012.
- Trefethen, L. N. and Embree, M. Spectra and Pseudospectra. Princeton University Press, 2005.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
AI Suggested Questions
- Give a concrete pair of matrices where the eigenvalues of are not sums of eigenvalues of and .
- Construct an interpolating polynomial that maps a given set of three eigenvalues to three prescribed targets, and show the resulting matrix.
- Prove that and have the same non-zero eigenvalues with the same algebraic multiplicities.
- Show a non-normal matrix with spectral radius below one whose powers grow substantially before decaying, and quantify the transient.
- How do the left and right eigenvectors of a non-symmetric matrix combine to give participation factors in modal analysis?
- Under what conditions on and can the eigenvalues of the product be obtained by pairing the eigenvalues of the factors?
Related Calculators
Form by Horner's scheme and report the mapped spectrum alongside the original one.
Spectral Radius & Stability CheckCompute and report whether repeated application of the matrix decays, grows or is marginal.
Eigenvalue & Eigenvector CalculatorCompute the base spectrum with left and right eigenvectors reported separately.
