Engineering/Mathematics/Representations
Vector Representation
Fixing an ordered basis of an -dimensional vector space attaches to every vector a unique column of scalars, and the map that does so is an invertible linear transformation onto . It is the bridge between abstract vector spaces and the arithmetic engineers actually run.
- Advanced level
- Stream: representations
- Reading time 16 min
- Ref KVS-ENG-MATH-0106
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- Basis, dimension, unique representation
- Notation
- Key property
- Invertible linear transformation
- Depends on
- The basis and its ordering
- Inverse
- — un-coordinatising
Overview
An abstract vector space offers no arithmetic that a computer can execute. Polynomials, matrices, solution spaces of differential equations and spaces of piecewise functions all satisfy the same ten axioms, but none of them arrives with a list of numbers attached. Vector representation supplies that list. Choose an ordered basis of a space ; every vector can be written as a linear combination of the basis vectors in exactly one way, and the column of coefficients is defined to be .
Two claims have to be established before the definition is legitimate. The first is that the coefficients exist and are unique, which is exactly the defining property of a basis: spanning gives existence and linear independence gives uniqueness. Without both halves the recipe would either fail on some vectors or produce several answers for the same vector, and would not be a function at all. The second is that the resulting map respects the vector space operations, which follows from comparing the unique expansions of and against those of and .
With those in place, turns out to be as well behaved as a map can be. Its kernel is trivial, because a vector whose coefficients all vanish is the zero vector, so it is injective. It is surjective, because any column of scalars can be used as weights to build a vector in that represents it. Injective and surjective together make an invertible linear transformation, and the inverse reassembles a vector from its coefficients.
The engineering consequence is that any finite-dimensional vector space can be worked in as if it were a space of column vectors, provided the basis is recorded. Modal coordinates in structural dynamics, coefficient vectors in finite element analysis, transform coefficients in signal processing and orbital expansion coefficients in computational chemistry are all instances of applied to a domain-specific basis. The coefficients are meaningless without the basis, which is why every one of those fields treats the basis specification as part of the data.
Definition
Vector Representation
VRLet be a vector space with ordered basis . For , take the unique scalars with
and define the function entry by entry through for .
The subscript is not decoration. A different basis, or the same basis in a different order, defines a different function.
Coordinate Vector
The column is called the coordinate vector of relative to . Its th entry is the weight applied to the th basis vector. Applying is referred to as coordinatising and applying as un-coordinatising.
A coordinate vector is a description of a vector, not the vector itself. The vector does not change when the basis does; only its description does.
Unique Representation Property
If is a basis of then every has exactly one expansion as a linear combination of the vectors of . Spanning supplies at least one expansion; linear independence forbids a second, since the difference of two expansions would be a non-trivial relation of linear dependence. This property is what makes the definition of well posed.
Concepts
Why the definition needs a basis and not merely a spanning set
The phrase find scalars in the definition looks permissive, and it would be fatal if the set were only a spanning set. Suppose spans but is dependent: then some vector has two different expansions, and the recipe returns two different columns for one input, so no function has been defined. Suppose instead that is independent but does not span: then some vector has no expansion, and the recipe is undefined on part of .
A basis is precisely the condition that excludes both defects. This is worth internalising because it is the same pair of failure modes seen elsewhere in the subject: dependence causes multiply-defined answers, failure to span causes undefined ones, and it is exactly the pair that injectivity and surjectivity exclude for an inverse map. The unique representation property is the vector-space statement of that principle.
The coordinate map is linear
Let and have expansions with coefficients and . Adding the two expansions and collecting terms on each basis vector produces an expansion of with coefficients . Uniqueness then says those are the coefficients of , so . The same argument with a scalar multiple gives .
Note where the work happens. The collecting step uses commutativity, associativity and distributivity in ; the conclusion uses uniqueness. Linearity of is therefore not an assumption about coordinates but a consequence of the axioms of combined with the defining property of a basis.
Injectivity and surjectivity
For injectivity, compute the kernel. If then every coefficient in the expansion of is zero, so is a sum of zero multiples of the basis vectors, which is the zero vector of . The kernel is trivial and is injective.
For surjectivity, take any column and use its entries as weights: define . By construction the unique expansion of has exactly those coefficients, so . Every column is hit, and the range is all of .
Coordinatising is an invertible linear transformation
A linear transformation that is both injective and surjective is invertible, so has an inverse and that inverse is itself a linear transformation. The inverse has an explicit and cheap formula: applied to a column simply forms the linear combination of the basis vectors weighted by its entries. Un-coordinatising is therefore always easier than coordinatising, which in general requires solving a system.
The asymmetry is worth remembering in implementation. Building a vector from coefficients costs one pass over the basis; extracting coefficients from a vector costs a solve, unless the basis has been chosen to make it cheap. Orthonormal bases exist precisely to remove that cost, replacing the solve by a sequence of inner products.
The representation depends on the ordering, not just the set
A basis for the purposes of representation is an ordered list. Permuting the list permutes the entries of every coordinate vector, so two engineers using the same set of basis vectors in different orders will exchange numerically incompatible columns while both being correct. This is not a subtlety to be tidied away; it is why coordinate conventions are published in standards and why file formats for modal, spectral and geometric data always fix a component order.
The same point applies to scaling. Replacing a basis vector by a non-zero multiple of itself is still a basis, but every coordinate vector changes accordingly. A basis specification is therefore a list of vectors in a fixed order with fixed normalisation, and anything less leaves the coefficients ambiguous.
Computing the representation in a concrete space
When is itself, coordinatising relative to a basis means solving , where is the matrix whose columns are the basis vectors. Since is a basis, is nonsingular and the solution is unique, giving as a statement of uniqueness. In practice one factorises once and solves for each vector to be coordinatised.
For an abstract space the same idea applies after one preliminary step: express both the basis vectors and the target in terms of a convenient reference basis, such as the monomials for polynomials or the single-entry matrices for . Coordinatising relative to an awkward basis then becomes a numerical system in the reference coordinates, which is the standard route to any representation in practice.
Procedure: computing
Equations
Unique expansion relative to a basis
EQ-VR-01Existence of the scalars comes from spanning, uniqueness from linear independence. Both are needed for the coordinate map to be a function.
Definition of the coordinate map
EQ-VR-02The th entry of the coordinate vector is the weight applied to the th basis vector, which is why the ordering of is part of the definition.
Linearity of the coordinate map
EQ-VR-03Proved by comparing unique expansions. It is what allows any computation built from the two operations to be carried out on coordinates instead.
Trivial kernel
EQ-VR-04A vector all of whose coefficients vanish is the zero vector, so no two distinct vectors share a coordinate column.
Un-coordinatising
EQ-VR-05The inverse map is an explicit linear combination, so rebuilding a vector from its coordinates is always cheaper than extracting them.
Coordinatising inside complex n-space
EQ-VR-06When , the coordinate vector is the solution of a nonsingular linear system whose coefficient matrix holds the basis vectors as columns.
Coordinatisation is an isomorphism
EQ-VR-07Injective and surjective together make an invertible linear transformation, which identifies structurally with a space of columns.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Vector space | The abstract space in which the vectors of interest live | vector space of dimension n | |
| Ordered basis | The list of basis vectors, fixed in order and normalisation, that defines the representation | ordered set of n vectors | |
| Basis vector | The th member of the ordered basis | vector in V | |
| Vector being represented | The element of whose coefficients are sought | vector in V | |
| Coordinate | The unique weight applied to in the expansion of | complex number | |
| Vector representation map | The invertible linear transformation sending a vector to its coordinate column | linear map V to C^n | |
| Un-coordinatisation | Rebuilds a vector from a column of coefficients by forming a linear combination | linear map C^n to V | |
| Basis matrix | Matrix whose columns are the basis vectors, used when is a space of columns | nonsingular n x n matrix | |
| Dimension | Number of basis vectors, and the height of every coordinate column | positive integer |
Worked Numerical Example
Problem statement
A profile fitting routine stores quadratic shapes internally as coefficients relative to the non-standard basis of . Verify that is a basis, coordinatise two profiles, confirm that the coordinate map is linear, show that reordering the basis changes the stored column, and un-coordinatise a stored column back to a profile.
Confirm the set is a basis
Express each candidate basis vector in the reference basis and assemble the coefficient columns into a matrix. Its determinant is , which is non-zero, so the three polynomials are independent. Three independent vectors in a space of dimension three form a basis.
Set up the defining equation for the first profile
Take and seek scalars with . Expanding the right-hand side and collecting powers of gives the coefficients as sums of pairs.
Solve and record the coordinate vector
Adding all three equations gives , so the total is . Subtracting each equation from that total isolates the missing unknown: , and .
Verify by rebuilding the profile
Un-coordinatise the answer: has constant term , linear term and quadratic term . The original profile is recovered exactly, confirming both the arithmetic and the claim that is a plain linear combination.
Coordinatise a second profile
For the same three equations become , and , whose total is . This gives , and , and rebuilding confirms .
Check linearity on the sum
The sum of the two profiles is . Coordinatising it directly gives the system , , with total , hence the column with entries , and — exactly the sum of the two coordinate vectors already computed.
Show that the ordering matters
Relative to the reference basis the first profile needs no computation at all: its coordinate column is just its coefficient list. Reversing that basis to leaves the same three numbers but in a different order, so the stored column differs even though the polynomial has not changed.
Un-coordinatise an arbitrary stored column
A stored record holding the column with entries , and is decoded by forming the corresponding combination: , whose constant term is , linear term and quadratic term .
Three different columns — the entries and and — all describe the same polynomial. A stored coefficient record is therefore meaningless without the basis that produced it, and any file format or interface that transmits coordinates must transmit the ordered basis alongside them. The linearity check also shows the practical payoff: once profiles are stored as columns, adding and scaling them requires no polynomial arithmetic at all.
Applications & Industry Use
Modal coordinates
Expressing a displacement field in the basis of mode shapes replaces a coupled system of equations of motion with a set of independent single-degree-of-freedom equations. The modal amplitude vector is precisely applied to the displacement, with the ordered set of mode shapes, and truncating the expansion to the first few modes is a deliberate approximation made in coordinate space.
Nodal degrees of freedom as coefficients
Within an element, the displacement field is a linear combination of shape functions, and the nodal degree-of-freedom vector is its coordinate vector relative to the shape function basis. Assembly, constraint application and post-processing all operate on those coefficients, and the mapping back to a continuous field is exactly un-coordinatisation.
Transform coefficients
A discrete Fourier, cosine or wavelet transform is coordinatisation relative to a specific ordered basis of the signal space. The forward transform is and the inverse transform is . The choice of basis is the entire engineering decision: compression works because the coefficient vector is sparse in a well-chosen basis and dense in a poor one.
Basis set expansion of orbitals
A molecular orbital is represented by its coefficients relative to a chosen set of atom-centred functions. Published results quote the basis set by name because the coefficients are meaningless without it, and comparing two calculations requires either the same basis or an explicit change of representation.
Coordinates relative to a reference frame
A position is reported as a triple of numbers only after a datum, axis order and unit convention have been fixed. That specification is the ordered basis, and the widespread failure to transmit it — latitude and longitude exchanged, or the wrong datum assumed — is the practical form of the ordering hazard described on this page.
Local, object and world frames
The same geometric point carries different coordinate triples in model space, world space and camera space, each corresponding to a different ordered basis. Rendering pipelines are chains of coordinatisations and un-coordinatisations, and the correctness of the pipeline depends on tracking which frame each stored triple belongs to.
Design Considerations
Transmit the basis with the coefficients
A coordinate vector is a description relative to a convention. Storing coefficients without the ordered basis that produced them creates data that cannot be interpreted later and cannot be exchanged safely. Treat the basis specification — vectors, order and normalisation — as part of the record, not as documentation.
Choose the basis for conditioning, not just for convenience
All bases of an -dimensional space are equivalent in theory; they are not equivalent numerically. Coordinatising a polynomial relative to the monomials on a wide interval involves a basis matrix whose condition number grows explosively with degree, so small changes in the function cause large changes in the coefficients. Orthogonal polynomial bases exist to avoid exactly this.
Exploit orthonormality when it is available
For a general basis, coordinatising requires solving an system. For an orthonormal basis under an available inner product, each coefficient is a single inner product, so the whole coordinate vector costs with no factorisation and no conditioning penalty. When an inner product exists, orthonormalising the basis once usually repays itself immediately.
Factor the basis matrix once
When many vectors are to be coordinatised relative to the same basis, the basis matrix does not change. Factorise it once and reuse the factors, reducing each subsequent coordinatisation from to . Re-solving from scratch for each vector is the most common inefficiency in coordinate-handling code.
Keep the vector and its representation distinct in the model
The polynomial does not change when the basis does; only its column changes. Code and documentation that conflate the two produce bugs that are hard to trace, because two columns that disagree may describe the same object. Name variables to indicate which basis a stored column belongs to, and convert explicitly rather than implicitly.
Validate the basis before trusting any coefficients
If the supposed basis is dependent, the coordinatisation system is singular and the coefficients are either non-unique or non-existent. Check independence — by a determinant, a rank computation or a factorisation that reports singularity — before accepting a set as a basis, particularly when it has been generated numerically rather than constructed.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Establishes the conventions for indexed families, component notation and the bracketed entry form used to state the definition of the coordinate map. |
ISO 19111 | Geographic information — Referencing by coordinates | The clearest standardised statement of the principle on this page: coordinates are meaningless without the coordinate reference system that defines them, and axis order and units are part of that definition. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Sets the precision within which the coordinatisation system is solved, and therefore the accuracy of a round trip through and for an ill-conditioned basis. |
ISO 10303-42 | Product data representation and exchange: Geometric and topological representation | Fixes the basis conventions for spline and polynomial geometry in exchange files, so that a coefficient list transferred between systems is decoded against the basis it was encoded with. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Provides the semantic encoding for subscripted maps and column vectors on this page, keeping the basis subscript on machine-readable rather than typographic decoration. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Orthonormal basis with binary64 coefficients | The space carries an inner product and repeated coordinatisation is required, as in modal or spectral work. | Coefficients come from inner products at cost with perfect conditioning, but the orthonormal basis must be constructed first and may be dense where the original basis was sparse. |
| General basis with a stored LU factorisation | The basis is fixed by the application and many vectors must be coordinatised against it. | Amortises the factorisation over all subsequent solves, but the factors must be kept alongside the basis and invalidated whenever the basis changes. |
| Exact rational coefficients | Small symbolic spaces where the coordinate vector is the answer, as in verifying that a proposed set is a basis. | Gives an unambiguous result and detects a singular basis matrix decisively, but is impractical once dimensions reach the hundreds. |
| Orthogonal polynomial basis | Representing functions on an interval where the monomial basis would be ill-conditioned. | Condition numbers stay modest even at high degree and coefficients decay meaningfully, at the cost of extra machinery for evaluation and for conversion to the monomial form other tools expect. |
| Sparse coefficient storage | A basis chosen so that typical vectors have few significant coefficients, as in wavelet compression. | Storage proportional to the significant coefficients only, but the basis must be transmitted or agreed in advance and thresholding introduces a controlled approximation. |
| Fixed-point coefficients | Embedded systems storing modal or transform coefficients under tight memory and power budgets. | Compact and fast without a floating-point unit, but the coefficient dynamic range must be analysed against the chosen basis in advance, since a poorly scaled basis will saturate. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
Reducing an abstract representation to a numerical system
Choose a convenient reference basis of the abstract space — monomials for polynomials, single-entry matrices for — and coordinatise both the target and each vector of the working basis against it. Assemble the working basis columns into a matrix and solve against the target column. This two-stage route turns any abstract coordinatisation into a standard linear solve.
Cost of the two directions
Un-coordinatising is one linear combination: scalar multiples and additions of vectors, or scalar operations when the vectors are themselves columns of length . Coordinatising against a general basis requires a solve at for the first vector and for each subsequent one if the factorisation is retained. Against an orthonormal basis, coordinatising drops to with no factorisation.
Verification by round trip
The cheapest and most effective check is to un-coordinatise the computed column and compare with the original vector. It exercises the whole computation, requires no second method, and in exact arithmetic must reproduce the input exactly. In floating point, compare the residual against a tolerance scaled by the norm of the input and the condition number of the basis matrix.
Library support
There is no single library function named for this operation, because it is a solve. In NumPy the coordinate vector is numpy.linalg.solve(M, w) with holding the basis as columns, and scipy.linalg.lu_factor with lu_solve gives the factor-once pattern. SymPy provides exact coordinatisation for symbolic bases, and for orthonormal bases the coefficients are simply a matrix-vector product with the conjugate transpose.
Detecting a bad basis at run time
A basis matrix that is singular or nearly so signals that the supposed basis is dependent or badly scaled. Rather than testing the determinant, which is not scale-aware, obtain a reciprocal condition estimate from the factorisation and reject the basis when it falls below a documented threshold. This catches numerically generated bases that have drifted towards dependence.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Storing coefficients without the basis | high | A coordinate vector is written to a file or passed across an interface with no record of the ordered basis used. | Make the basis specification part of the data structure and the file format. Reject any incoming coefficient record that does not identify its basis. |
| Treating the basis as an unordered set | high | Two implementations use the same basis vectors in different orders and exchange columns that appear compatible. | Define the basis as an ordered list, and validate an interface with a test vector whose coefficients are all distinct so a permutation is immediately visible. |
| Using a spanning set that is dependent | high | A generating set is mistaken for a basis, so the coordinatisation system is singular and the coefficients are not unique. | Verify independence before use. Numerically, obtain a rank or reciprocal condition estimate from a factorisation of the basis matrix. |
| Ill-conditioned basis at high degree | high | Coordinatising relative to monomials on a wide interval, where the basis matrix condition number grows very rapidly with dimension. | Use an orthogonal polynomial basis, or map the interval to a standard one before representation, and monitor the condition number of the basis matrix. |
| Comparing coordinate vectors from different bases | medium | Two columns describing the same vector under different bases are compared entry by entry and judged different. | Convert to a common basis before comparing, or compare the un-coordinatised vectors directly. Tag every stored column with its basis identifier. |
| Assuming coordinates respect operations the space does not have | medium | Multiplying coordinate vectors entry by entry and expecting the result to represent a product of the original vectors. | The coordinate map preserves addition and scalar multiplication only. Any other operation must be represented separately and explicitly. |
| Rescaling a basis vector silently | medium | Normalising the basis after coefficients have been computed, so old and new columns disagree by scale factors. | Treat normalisation as part of the basis definition. Recompute or rescale all stored coefficients whenever the basis is changed in any way. |
| Assuming a standard basis makes the step free | low | Working in and forgetting that the coordinate column coincides with the vector only for the standard basis in its usual order. | State the basis even when it is the standard one, so that a later change of basis does not silently invalidate stored results. |
FAQs
Why does the definition require a basis rather than just a spanning set?
A spanning set guarantees that some expansion exists but not that it is unique, so the recipe could return several different columns for one vector and would not define a function. Linear independence removes the ambiguity. Conversely an independent set that fails to span leaves the map undefined on part of the space. Only a basis supplies both existence and uniqueness.
Does the coordinate vector change if I reorder the basis?
Yes. The th entry is by definition the weight on the th basis vector, so permuting the basis permutes the entries. The vector itself is unaffected. This is why a basis for representation purposes must be treated as an ordered list, and why coordinate exchange formats always fix a component order.
Why is un-coordinatising cheaper than coordinatising?
Rebuilding a vector from coefficients is a single linear combination, evaluated directly. Extracting coefficients requires solving a system whose coefficient matrix holds the basis. The asymmetry disappears for an orthonormal basis, where each coefficient is an inner product, which is one of the main reasons orthonormal bases are constructed.
Is the coordinate map the same thing as an isomorphism with ?
Yes. Because is a linear transformation that is both injective and surjective, it is invertible, and the existence of an invertible linear transformation is exactly what makes two vector spaces isomorphic. Every choice of ordered basis therefore produces a different isomorphism between and .
Can two different vectors have the same coordinate vector?
Not relative to the same basis. The coordinate map is injective because a vector whose coefficients all vanish must be the zero vector, so distinct vectors give distinct columns. Two different bases can of course assign the same column to different vectors, which is why comparisons must always be made within one basis.
How do I coordinatise a vector in an abstract space where there is no obvious arithmetic?
Introduce a convenient reference basis for the space, such as monomials for polynomials or single-entry matrices for a matrix space. Coordinatise both the target and each working basis vector against the reference basis, then solve the resulting numerical system. This reduces any abstract representation to a standard linear solve.
What goes wrong when the basis is badly conditioned?
The coordinatisation system becomes sensitive: small perturbations in the vector produce large changes in the coefficients, and a round trip through and loses accuracy. The monomial basis on a wide interval is the standard example. The remedy is a better-conditioned basis, typically an orthogonal or orthonormal one, rather than higher precision.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section VR. Licensed under the GNU Free Documentation License v1.2.
- Halmos, P. R. Finite-Dimensional Vector Spaces, 2nd edition. Springer, 1974.
- Trefethen, L. N. Approximation Theory and Approximation Practice. Society for Industrial and Applied Mathematics, 2013.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- ISO 19111:2019, Geographic information — Referencing by coordinates. International Organization for Standardization.
- Golub, G. H. and Van Loan, C. F. Matrix Computations, 4th edition. Johns Hopkins University Press, 2013.
AI Suggested Questions
- Show how the condition number of the monomial basis matrix on the interval from zero to ten grows with polynomial degree, and compare it with a Chebyshev basis.
- Coordinatise a symmetric matrix relative to a basis of six symmetric matrices and explain how the choice relates to Voigt notation.
- Explain why the discrete Fourier transform is a vector representation map and identify the ordered basis it uses.
- Given two bases of the same space, derive the matrix that converts a coordinate vector from one to the other and show it is nonsingular.
- For an orthonormal basis, prove that each coordinate is an inner product and quantify the operation count saved compared with solving a system.
- Construct a case where a numerically generated basis has drifted towards dependence, and show how a reciprocal condition estimate detects it before the coefficients become meaningless.
Related Calculators
Compute for a chosen ordered basis, with the solve shown and the reconstruction verified.
Basis ValidatorCheck whether a proposed set is an ordered basis by testing independence and reporting the condition number of the basis matrix.
Change-of-Basis CalculatorConvert a coordinate vector from one ordered basis to another and display the conversion matrix.
Polynomial Basis ConverterTranslate polynomial coefficients between monomial, Chebyshev and Bernstein bases and compare conditioning.
