Engineering/Mathematics/Representations
Computing Eigenvectors of Linear Transformations
An eigenvector of a linear transformation need not be a column vector at all — it can be a polynomial, a matrix or any element of . The method for finding one is nonetheless entirely mechanical: coordinatise, solve a matrix eigenproblem, then un-coordinatise.
- Advanced level
- Stream: eigen
- Reading time 16 min
- Ref KVS-ENG-MATH-0116
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Matrix representations and vector representation
- Requires
- Domain and codomain the same space,
- Key property
- Eigenvalues are independent of the basis chosen
- Output
- Eigenvalues, eigenspaces of , and both multiplicities
- Cost
- One representation build, then a standard eigenproblem
Overview
A linear transformation from a vector space to itself can stretch some directions without rotating them. Those invariant directions are the eigenvectors, and the stretch factors are the eigenvalues. Stated for an abstract space the definition is identical to the matrix case — a non-zero with — but the objects involved may be polynomials, matrices, functions or anything else the space contains, so the familiar apparatus of determinants and null spaces cannot be applied directly.
The bridge is coordinatisation. Fix any basis of with elements. The vector representation map is an invertible linear transformation, and relative to the transformation acquires an matrix representation . The central result of this page is that is an eigenvector of for if and only if is an eigenvector of for the same . The abstract eigenproblem and the concrete matrix eigenproblem are the same problem, wearing different clothes.
That equivalence yields a procedure with no free choices left in it beyond the initial basis: build one representation, extract its characteristic polynomial, find the roots, compute the null space of for each root, and push each resulting column vector back into through . The eigenvalues obtained are the eigenvalues of ; the pulled-back vectors form a basis of the corresponding eigenspace of .
The result also settles a question of well-definedness that would otherwise be fatal. Two different bases produce two different matrices, so it is not obvious that the answer means anything. It does, because those two matrices are similar via a change-of-basis matrix, and similar matrices share a characteristic polynomial. Eigenvalues, the characteristic polynomial, algebraic multiplicity and geometric multiplicity are therefore intrinsic properties of , not artefacts of the coordinates used to compute them. Only the particular basis reported for each eigenspace depends on the route taken.
Definition
Eigenvalue and Eigenvector of a Linear Transformation
EELTLet be a linear transformation on a vector space . A non-zero vector is an eigenvector of for the eigenvalue when . The scalar may be zero; the vector may not.
The domain and codomain must be the same space. If with , the equation compares elements of two different spaces and has no meaning.
Eigenspace of a Linear Transformation
EELT-SPFor an eigenvalue of , the eigenspace is the set of all eigenvectors of for together with the zero vector of . Equivalently , the kernel of the transformation , which makes it a subspace of .
Adjoining is what converts a bare collection of vectors into a subspace; the zero vector is never itself an eigenvector.
Algebraic and Geometric Multiplicity for a Transformation
AME-GMELet be any matrix representation of relative to a single basis used for both domain and codomain. The algebraic multiplicity is the highest power of dividing the characteristic polynomial of . The geometric multiplicity . Both are well defined because every such representation is similar to every other.
Always . Equality for every eigenvalue is exactly the condition under which admits a diagonal representation.
Concepts
Representation converts the eigenproblem, faithfully
The governing result states that for a basis of and a linear transformation , a vector is an eigenvector of for precisely when is an eigenvector of for . The forward direction follows in three lines: , using in turn the defining property of a matrix representation, the eigenvector hypothesis, and the linearity of . The reverse direction runs the same chain backwards through , which exists because is an isomorphism.
Why the answer does not depend on the basis
Choosing a second basis of produces a second matrix , and the two are related by the change-of-basis matrix through . That is precisely the statement that the two representations are similar. Similar matrices have identical characteristic polynomials, hence identical eigenvalues with identical algebraic multiplicities, and their eigenspaces have equal dimensions. The eigenvalues of are therefore an intrinsic invariant, and it is legitimate to speak of the characteristic polynomial of a linear transformation.
Eigenspaces are the same subspace, not the same list
Basis independence applies to the eigenspace as a set, not to the particular spanning vectors that a computation happens to emit. Two bases and will generally return two different-looking bases for when , because the null space of is computed in different coordinates. The two answers span the same subspace of . Confirming that requires the standard argument: show each reported vector lies in the span of the other set, and note that the two sets have equal size, so equal dimension forces set equality.
Choosing a basis that makes the arithmetic cheap
No theorem constrains the choice of , so it should be chosen to make the representation easy to build by hand. For , the monomial basis reads coefficients straight off. For , the basis of matrices with a single entry does the same. The pay-off is that and become transcription rather than computation, and the only real work is the matrix eigenproblem. A poorly chosen basis does not change the answer, only the labour required to reach it.
The diagonalisable case and its meaning
If the representation is diagonalisable, then has a basis consisting entirely of eigenvectors of , obtained by un-coordinatising a full set of independent eigenvectors of the matrix. Representing relative to that basis gives a diagonal matrix whose diagonal entries are the eigenvalues, repeated according to multiplicity. Read in reverse, matrix diagonalisation is the search for a basis in which a linear transformation acts by independent scaling along directions — decoupling a coupled operator into scalar operators.
Complex scalars are not optional
The characteristic polynomial of an matrix has exactly roots counted with multiplicity over , and may have none at all over . A rotation-like transformation on a real space has no real eigenvalue, yet has a complete set of complex ones. Working over therefore guarantees that eigenvalues exist, and complex eigenvectors of a real transformation arrive in conjugate pairs. Un-coordinatising a complex eigenvector yields an element of with complex coefficients — a polynomial with complex coefficients, or a complex matrix — which is legitimate provided was taken over from the outset.
Procedure: eigenvalues and eigenvectors of
Equations
Eigenvector condition for a transformation
EQ-CELT-01The defining relation. The exclusion of the zero vector is essential: without it every scalar would be an eigenvalue of every transformation.
Representation transports the eigenproblem
EQ-CELT-02The equivalence that licenses the whole procedure. It holds for every basis of , with no restriction whatever on the choice.
Characteristic polynomial of the transformation
EQ-CELT-03Independent of , because any two representations relative to a single basis are similar and similar matrices have equal characteristic polynomials.
Similarity of two representations
EQ-CELT-04Here is the change-of-basis matrix from to , itself the representation of the identity transformation on .
Eigenspace recovered by un-coordinatisation
EQ-CELT-05The image of a subspace of under an isomorphism is a subspace of of the same dimension, so a basis maps to a basis.
Multiplicity bounds
EQ-CELT-06Algebraic multiplicities always exhaust the dimension of over . Geometric multiplicities do so only when is diagonalisable.
Diagonal representation on an eigenbasis
EQ-CELT-07Obtained when is a basis of made entirely of eigenvectors of . Each basis vector is scaled and none is mixed with any other.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Linear transformation | A linear map from to itself, the object whose eigenstructure is sought | linear transformation V to V | |
| Vector space | The common domain and codomain, of finite dimension | vector space over C | |
| Computation basis | Any basis of , chosen for convenience; used for both domain and codomain | basis of V, size n | |
| Vector representation map | The isomorphism sending to its coordinate column relative to | isomorphism V to C^n | |
| Matrix representation | The matrix whose -th column is | n x n complex matrix | |
| Eigenvalue | Scale factor satisfying for some non-zero | complex scalar | |
| Eigenspace | Subspace of containing all eigenvectors for , plus | subspace of V | |
| Algebraic multiplicity | Multiplicity of as a root of the characteristic polynomial | integer 1 to n | |
| Geometric multiplicity | Dimension of the eigenspace | integer 1 to alpha | |
| Change-of-basis matrix | Representation of the identity on relative to and | n x n nonsingular matrix |
Worked Numerical Example
Problem statement
A signal-conditioning stage acts on quadratic calibration curves. Modelled on the space of polynomials of degree at most two, the stage is the linear transformation . Find the calibration curves that pass through the stage unchanged up to a gain, and the gains themselves.
Choose the monomial basis
Take , so . Coordinates relative to are just the coefficient triples, which makes and pure transcription.
Build the matrix representation
Apply to each basis element and record the coordinate column. , , and . These three columns assemble into .
Factor the characteristic polynomial
The third column of is , so expansion along that column is immediate. The eigenvalues are with algebraic multiplicity , and with algebraic multiplicity .
Solve for the eigenspace at
Row-reduce . Every row is a multiple of , so the rank is and the null space has dimension : .
Solve for the eigenspace at
Row-reduce . Two pivots appear, so the null space is one-dimensional and . Setting the free variable gives the single basis vector below.
Un-coordinatise into
Read each column as coefficients on , and . The null-space basis for becomes , and for becomes .
Verify directly in
Substitute back into the original rule, never into the matrix. For take , , : . For take , , : , an eigenvalue of .
Confirm basis independence with a second basis
Repeat with . The representation becomes below, whose characteristic polynomial is again . Its eigenspace at un-coordinatises to — a different list, but , so it spans the same subspace. Its eigenvector for un-coordinatises to exactly .
The stage has two gains: it multiplies any curve in the two-dimensional family spanned by and by exactly , and multiplies the single curve by , leaving it untouched. Because for both eigenvalues, the three eigenpolynomials form a basis of : every quadratic calibration curve decomposes uniquely into a part amplified threefold and a part passed through unchanged, and the stage is fully characterised by those two numbers.
Applications & Industry Use
Mode shapes as functions, not coordinate lists
Discretised beam and plate models represent deflection by coefficients on a set of shape functions, so the natural state space is a function space rather than . Modal analysis then asks for eigenvectors of an operator on that space. Coordinatising with the shape-function basis converts the question into a matrix eigenproblem; un-coordinatising returns the mode shapes as actual deflection functions, which is the form an engineer can plot and interpret.
Basis-invariant assessment of a plant
State-space models of a single physical plant differ by a similarity transformation whenever the state variables are redefined — currents versus fluxes, positions versus modal amplitudes. Because eigenvalues survive similarity, pole locations, stability margins and time constants can be computed in whichever state basis is most convenient and quoted as properties of the plant itself.
Operators on spaces of basis functions
Electronic-structure calculations express an energy operator in a chosen basis of atomic orbitals. The resulting matrix eigenproblem yields orbital energies and coefficient vectors; the coefficient vectors are then un-coordinatised back into functions to obtain the orbitals themselves. Changing basis set changes the matrix but not the underlying spectrum, which is the property that makes basis-set convergence a meaningful concept.
Filter stages acting on polynomial or spline models
A conditioning stage applied to a curve represented in a polynomial or B-spline basis is a linear transformation of the coefficient space. Its eigenpolynomials are the curve shapes the stage merely rescales; identifying them shows which features of a calibration profile pass through a processing chain undistorted and which are attenuated.
Decoupling interacting unit operations
A recycle loop couples composition variables so that no single stream can be adjusted independently. Representing the loop transformation on a suitable state space and finding its eigenvectors identifies combinations of compositions that evolve independently. Control in those coordinates reduces a multivariable problem to a set of single-loop problems.
Invariant directions of a transformation on a shape space
Deformation operators acting on control-point or blend-shape spaces are linear transformations on a space whose elements are geometric configurations rather than triples. Their eigenvectors are configurations that the operator merely scales, which is how principal deformation modes are extracted from a rig and how a large blend-shape basis is reduced to a compact one.
Design Considerations
Confirm domain and codomain coincide before starting
The eigenvector equation compares with , so both must live in the same space. A transformation has no eigenvalues at all, however well behaved it is. This check costs nothing and rules out an entire class of meaningless computations.
Spend the effort on choosing the basis, not on the algebra
The representation must be built by hand at least once, and a basis in which is transcription rather than a linear solve saves the bulk of the work. Monomials for polynomial spaces and single-entry matrices for matrix spaces are almost always the right first choice; specialised bases become attractive only when they make visibly block-structured.
Report eigenspaces, not eigenvectors
When a geometric multiplicity exceeds one, the individual basis vectors returned by a null-space computation are arbitrary. Two correct computations can disagree vector by vector while agreeing perfectly as subspaces. Documentation and test cases should therefore state the eigenspace and its dimension, and any comparison between two results must be a subspace comparison.
Treat the multiplicity gap as the headline diagnostic
The single most informative output beyond the eigenvalues is whether for every . Equality throughout means a basis of eigenvectors exists and the transformation decouples completely. A deficiency means it does not, and that any attempt to build a diagonal representation will fail no matter how the search is organised.
Verify against the original rule, never the representation
Substituting a candidate eigenvector back into only re-checks the null-space arithmetic. Substituting the un-coordinatised element into the original definition of additionally checks the representation build and both coordinate maps, which is where hand errors actually occur.
Decide early whether complex scalars are admissible
If is a real vector space, a real transformation may have no eigenvectors whatever. Widening the scalars to restores existence but produces eigenvectors with complex coefficients, which may or may not be physically interpretable in the model at hand. Where complex eigenvalues arise in conjugate pairs, the real span of the real and imaginary parts of a complex eigenvector gives a two-dimensional invariant subspace that stays inside the real space.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Fixes the typographic conventions used for the objects on this page: italic for the transformation symbol and scalars such as , upright for operators such as and , and the notation for mappings between sets. |
LAPACK / BLAS reference | Linear Algebra PACKage reference implementation | Once the abstract problem has been coordinatised, the remaining work is a dense eigenproblem handled by xGEEV for the general case and xSYEV or xHEEV when the representation is symmetric or Hermitian. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Defines the arithmetic in which the characteristic polynomial roots and null spaces are computed numerically, and hence the rounding behaviour that makes an exactly repeated eigenvalue impossible to certify from floating-point output alone. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the subscripted representation symbols , and semantically, so that a screen reader distinguishes the transformation superscript from an exponent. |
W3C WCAG 2.1 AA | Web Content Accessibility Guidelines | Matrices and coordinate columns on this page are semantic markup with alternative text rather than images, keeping the notation legible under magnification and available to assistive technology. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational arithmetic on the representation | The transformation has integer or rational coefficients and the multiplicity structure is the deliverable. | Gives certified algebraic and geometric multiplicities, but characteristic-polynomial roots are only exact when the polynomial factors over the rationals. |
| Symbolic algebra over an algebraic extension | Eigenvalues are irrational or complex and exact eigenvectors are required, for example to prove a decoupling result. | Exact throughout, at the cost of expression swell that makes anything beyond about size ten impractical. |
| IEEE 754 binary64 with a general eigensolver | The representation comes from measured or simulated data and approximate eigenvalues suffice. | Fast and robust, but repeated eigenvalues split into nearby distinct ones, so geometric multiplicity cannot be read from the output without a tolerance. |
| Complex scalars throughout | The transformation is not known in advance to have real spectrum, or oscillatory behaviour is expected. | Guarantees a full complement of eigenvalues and doubles storage; interpreting a complex eigenvector as a physical configuration requires an extra modelling step. |
| Real arithmetic with a real Schur form | The space is genuinely real and complex coefficients would be meaningless in the model. | Keeps every quantity real by using two-dimensional invariant blocks in place of complex conjugate pairs, but no longer delivers eigenvectors in the literal sense. |
| Dense storage of the representation | The representation is built from an abstract rule, as here, so it is dense by construction. | Sparse storage rarely helps, because a matrix representation of an operator on a polynomial or matrix space is usually full; the size of the space, not its sparsity, is the limiting factor. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Cost breakdown of the procedure
Building the representation costs applications of plus coordinate solves; with a well-chosen basis the latter are free. The eigenproblem itself dominates at roughly floating-point operations for a general dense matrix when eigenvectors are wanted. Un-coordinatisation is at most. In short, the abstract wrapper is cheap and the matrix core is the whole cost.
Building the representation reliably by hand
Work one basis vector at a time and write each image as an explicit linear combination of the basis before extracting the column. Recording the intermediate combination is what catches sign errors. A frequent slip is to write the coordinate vectors as rows; the definition places in column , and transposing the result silently replaces by a different transformation.
Library behaviour and the missing abstraction
Numerical libraries expose eigensolvers for matrices only — numpy.linalg.eig, scipy.linalg.eig, MATLAB's eig, Eigen's EigenSolver. None of them knows about abstract vector spaces, so the coordinatisation and un-coordinatisation steps are the caller's responsibility. Symbolic systems fare better: SymPy's polynomial and matrix classes make the representation build scriptable, and its eigenvects returns exact eigenspace bases with multiplicities attached.
Certifying multiplicities in floating point
A repeated eigenvalue is structurally unstable under rounding: a perturbation of size can split an eigenvalue of algebraic multiplicity into values differing by order . Clustering the computed spectrum with a tolerance is the practical remedy, and the corresponding invariant subspace should be extracted as a whole rather than as individual eigenvectors.
Two independent verification routes
First, substitute each un-coordinatised eigenvector into the original rule for and confirm the scaling exactly. Second, recompute the representation relative to a second basis and confirm the characteristic polynomial is unchanged; agreement here validates the change-of-basis reasoning as well as the arithmetic, and disagreement localises the error to the representation build.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Applying the method when the codomain differs from the domain | high | Treating any linear transformation as an eigenproblem candidate without checking that maps to . | Verify first. For with , eigenvalues are undefined and the correct questions are about rank, kernel and range. |
| Reporting coordinate columns as the eigenvectors | high | Stopping after the matrix eigenproblem and omitting the step. | The answer must be an element of — a polynomial, a matrix, whatever contains. A column of numbers is a representation of the answer, not the answer. |
| Using different bases for domain and codomain | high | Building with out of habit from general representation work. | A rectangular or mixed-basis representation has no meaningful eigenvalues. Use one basis in both roles, giving a square matrix similar to every other such representation. |
| Concluding two eigenspaces differ because their bases differ | medium | Comparing the vectors returned by two computations elementwise instead of comparing the subspaces they span. | Show mutual containment, or confirm equal dimension plus one-way containment. Different bases of the same subspace are the expected outcome, not an error. |
| Assuming every eigenvalue yields as many eigenvectors as its multiplicity | medium | Conflating algebraic with geometric multiplicity, which coincide only for diagonalisable transformations. | Compute as the nullity of independently, and compare it with the exponent in the characteristic polynomial. |
| Searching for a real eigenvalue that does not exist | medium | Restricting to real scalars for a transformation with rotational character, whose characteristic polynomial has no real roots. | Work over so that roots always exist, and interpret conjugate pairs as two-dimensional invariant subspaces if the model must remain real. |
| Transposing the representation during construction | medium | Writing each as a row of the matrix rather than a column. | Check one column against its defining basis vector before proceeding. The transpose generally has the same eigenvalues but different eigenvectors, so the error is not self-announcing. |
| Trusting a floating-point eigensolver on an exactly repeated eigenvalue | medium | Reading distinct computed values as distinct eigenvalues when they are a split multiple root. | Cluster the spectrum with a tolerance scaled to the matrix norm, and extract the invariant subspace for a cluster rather than individual eigenvectors. |
| Including the zero vector as an eigenvector | low | Reading the eigenspace definition as if qualified, since holds for every . | Keep the definitions separate: the eigenspace contains so that it is a subspace, but is never an eigenvector. |
FAQs
Does the choice of basis change the eigenvalues I compute?
No. Two representations of the same transformation relative to two bases are similar matrices, and similar matrices have identical characteristic polynomials. The eigenvalues, their algebraic multiplicities and the dimensions of the eigenspaces are therefore properties of the transformation alone. Only the coordinate columns and the particular basis reported for an eigenspace change.
Why do two bases give me visibly different eigenvectors for the same eigenvalue?
Because a null-space computation returns one basis of a subspace, and a subspace of dimension two or more has infinitely many bases. Both answers are correct and span the same eigenspace of . Confirm this by expressing each reported vector as a linear combination of the other set, then invoke equal dimension to conclude the subspaces coincide.
Can a linear transformation between different spaces have eigenvalues?
No. The equation requires and to be comparable, which forces the codomain to be the domain. For a transformation between genuinely different spaces the meaningful invariants are the rank, the kernel and the range, and the analogue of an eigen-decomposition is the singular value decomposition of a representation.
What does it mean if the geometric multiplicity is smaller than the algebraic multiplicity?
It means the transformation cannot be diagonalised: there are not enough independent eigenvectors to form a basis of , so no choice of basis makes the representation diagonal. Physically it signals a defective mode, and dynamically it produces responses with polynomial-in-time factors alongside the exponential ones rather than pure exponentials.
How do I know I have found every eigenvalue?
Count algebraic multiplicities. Over the characteristic polynomial has degree and factors completely, so the multiplicities must sum to . If they do not, a root has been missed or mis-multiplied. Over the reals no such guarantee exists, which is one reason the theory is set in .
Is there any way to avoid building a matrix representation at all?
For small or highly structured transformations, guessing and verifying works: propose a candidate, apply , and see whether the result is a scalar multiple. That confirms eigenvectors but never proves the list is complete. Establishing completeness requires the characteristic polynomial, and that requires a representation.
Which basis should I pick when the transformation is defined on a space of matrices?
Start with the basis of matrices having a single entry equal to one and the rest zero, ordered consistently. Coordinates are then just the entries listed in that order, so both coordinate maps become transcription. Only if visibly preserves a structural subspace, such as the symmetric matrices, is a specialised basis worth the extra setup.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section CB, Subsection CELT. Licensed under the GNU Free Documentation License v1.2.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013. Chapter 7, the unsymmetric eigenvalue problem.
- Anderson, E. et al. LAPACK Users' Guide, 3rd edition. Society for Industrial and Applied Mathematics, 1999.
- Halmos, P. R. Finite-Dimensional Vector Spaces. Springer, 1974. Treatment of linear transformations and their invariant subspaces without reference to coordinates.
AI Suggested Questions
- Show me a linear transformation on the space of 2x2 matrices whose eigenvectors are not diagonal matrices, and compute them by coordinatising.
- Why does a defective eigenvalue produce a term proportional to time multiplied by an exponential in the solution of a linear dynamical system?
- Given two matrix representations of one transformation, how do I recover the change-of-basis matrix that relates them?
- Work through a transformation on the space of quadratics whose characteristic polynomial has complex roots, and interpret the resulting eigenpolynomials.
- How can I prove that two computed eigenspace bases span the same subspace without solving anything twice?
- Compare the cost of coordinatising an operator on a polynomial space against solving the eigenproblem directly in a specialised basis.
Related Calculators
Enter a linear transformation rule and a basis, and obtain column by column with the intermediate linear combinations shown.
Eigenvalue & Eigenvector CalculatorFactor the characteristic polynomial and return an exact basis for each eigenspace with algebraic and geometric multiplicities.
Change-of-Basis CalculatorCompute between two bases and verify that two representations of one transformation are similar.
Diagonalisation CheckerTest whether a transformation admits a basis of eigenvectors and, if so, return that basis and the resulting diagonal representation.
