Engineering/Mathematics/Vector Spaces
Recycling Definitions in Abstract Vector Spaces
Four definitions that were built for column vectors — linear combination, span, relation of linear dependence and linear independence — require nothing but vector addition, scalar multiplication and a zero vector. They therefore transfer verbatim to polynomials, matrices, functions and every other vector space, and so does the machinery built on top of them.
- Core level
- Stream: vector-spaces
- Reading time 12 min
- Ref KVS-ENG-MATH-0058
- Taxonomy
- Engineering / Mathematics
- Prerequisite
- The ten vector space axioms
- Definitions recycled
- Linear combination, span, relation of linear dependence, linear independence
- What changes
- Only the objects and the two operations
- What is unchanged
- Every statement, proof and theorem built from them
- Payoff
- One body of theory serves , , and function spaces
Overview
The early development of linear algebra is carried out on column vectors, because a column of numbers is concrete and its arithmetic is unambiguous. That concreteness is a scaffold, not a foundation. Once the ten axioms of a vector space are in place, the axioms are the only facts about the objects that any argument is permitted to use, and the scaffold can be removed without the building falling down.
The observation that makes the transfer work is narrow and checkable. Read the definitions of linear combination, span, relation of linear dependence and linear independence and ask what each one actually mentions. Each mentions scalars, vectors, addition of vectors and multiplication of a vector by a scalar — and nothing else. No definition refers to entries, rows, columns, sizes, or the number . A definition that never names a coordinate cannot break when the coordinates are removed.
The practical consequence is leverage. If , and are elements of a vector space , the expression is unambiguous whether is , the space of polynomials of degree at most five, the space of matrices, or a space of continuous functions. Because the expression parses, so does every theorem whose statement is built from such expressions. One proof discharges an unlimited family of concrete cases.
This is also where the abstraction pays for itself computationally. Membership in a span, or a test for independence, becomes a question about scalars, and equating coordinates in whatever description the space naturally has — coefficients of a polynomial, entries of a matrix — converts that question into a system of linear equations over . The abstract setting supplies the vocabulary; row reduction still supplies the answer.
Definition
Vector Space
VSA vector space is a set of objects called vectors, together with a rule for adding two vectors and a rule for multiplying a vector by a scalar from , such that both operations return elements of and the ten standard axioms hold: additive and scalar closure; commutativity and associativity of addition; existence of a zero vector ; existence of an additive inverse for each vector; associativity of scalar multiplication; distributivity of scalar multiplication over vector addition and over scalar addition; and the identity rule .
The last axiom cannot be derived from the other nine. Taking any with addition unchanged but with redefined to be for every and satisfies the first nine and fails only the identity rule, which shows the axiom list is irredundant.
Linear Combination
LCLet be a vector space. Given vectors in and scalars in , the linear combination of those vectors with those scalars is the vector
.
Closure guarantees that the result is again an element of , so linear combinations never leave the space.
This is word-for-word the column-vector definition with the phrase "column vectors of size " replaced by "vectors from ". Nothing else was altered, and nothing else needed to be.
Concepts
What a definition is allowed to mention
A definition is portable exactly to the extent that its statement refers only to structure the target setting possesses. The four recycled definitions pass this test because each is phrased entirely in terms of the two operations. By contrast, the definition of the inner product of two column vectors names entries and a summation index, so it does not transfer to an arbitrary vector space without additional structure being supplied. Testing a definition for portability is a mechanical exercise: underline every noun, and check whether the axioms alone provide it.
The four definitions that transfer
Four definitions carry over unchanged, keeping their content and shedding only the words "column vector" from their titles.
- Linear combination: a weighted sum .
- Span: the set of all linear combinations of a given finite set , written or .
- Relation of linear dependence: an equation , trivial when every .
- Linear independence: the property that the trivial relation is the only relation of linear dependence on .
The zero vector is the pivot of the whole transfer
Two of the four definitions mention . In the zero vector is obvious, so its role is easy to overlook; in an abstract space it is supplied by an axiom, and it is unique, which is a theorem rather than a convention. That uniqueness is what makes "a relation of linear dependence" a well-posed notion: there is exactly one right-hand side it can have. In the zero vector is the polynomial all of whose coefficients vanish; in it is the matrix of zeros; in a function space it is the function identically equal to zero. Substituting the correct zero object is the only translation step required.
Theorems inherit portability from their statements
If a theorem's statement and proof use only recycled definitions and the axioms, the theorem itself is recycled with no additional work. The result that a span is always a subspace is proved by exhibiting as a linear combination and by collecting coefficients under distributivity — three axioms and one definition, no coordinates — and so it holds in every vector space. This is why the abstract chapter is short: most of its content is a re-reading of arguments already made, not a fresh set of arguments.
Computation returns to systems of equations
Abstraction changes the vocabulary, not the arithmetic. Asking whether lies in inside produces an equation between two polynomials; equality of polynomials means equality of coefficients, which is a system of five linear equations in the unknown scalars. Asking the same question in produces six equations, one per entry. In every case the abstract question is decided by row-reducing an augmented matrix and applying the consistency test, so no new computational technique is needed — only a translation into coordinates and back.
Where the promotion of leaves the theory
The statement that satisfies ten specific properties was originally a theorem about columns of complex numbers. In the abstract setting the same statement is demoted to an example: is now merely one vector space among many, verified against a definition rather than established by calculation. Nothing is lost — the ten properties are still true — but the logical direction reverses, and that reversal is precisely what licenses reasoning about , and function spaces with the tools built for columns.
Transferring a definition to a new vector space
Equations
A linear combination in an arbitrary vector space
EQ-VSRD-01Unambiguous in every vector space. The two closure axioms guarantee that the result is again a vector of , so no expression of this shape can escape the space.
General linear combination
EQ-VSRD-02The recycled definition. Scalars , vectors ; no reference to entries or size appears anywhere.
Span of a finite set
EQ-VSRD-03For . The set of every linear combination that can be formed from .
Relation of linear dependence
EQ-VSRD-04Trivial when every . The set is linearly independent precisely when no other solution exists.
Zero vectors of three concrete spaces
EQ-VSRD-05The only translation a recycled definition ever requires: identify the zero vector of the target space and substitute it.
Counterexample showing the identity axiom is independent
EQ-VSRD-06With ordinary addition on and this scalar multiplication, nine axioms hold and only fails. The axiom list therefore cannot be shortened.
Variable Definitions
| Symbol | Name | Meaning | Domain / type |
|---|---|---|---|
| Vector space | The ambient set together with its two operations | any set satisfying the ten axioms | |
| Vector | An element of ; may be a column, a polynomial, a matrix or a function | element of V | |
| Scalar | Coefficient multiplying a vector in a linear combination | complex number | |
| Zero vector | The unique additive identity of | element of V | |
| Finite set of vectors | The set whose linear combinations are being formed | finite subset of V | |
| Span | Set of all linear combinations of the vectors of | subset of V | |
| Polynomial space | Polynomials in of degree at most with complex coefficients | vector space of dimension n+1 | |
| Matrix space | All matrices with complex entries | vector space of dimension mn | |
| Column vector space | Column vectors of size with complex entries | vector space of dimension m |
Worked Numerical Example
Problem statement
A sensor calibration is modelled by a quadratic in the raw reading , so the working space is , the polynomials of degree at most two. Two stored correction curves are combined, and a third candidate curve is tested for independence — using the column-vector definitions with no modification.
Fix the vector space and its zero vector
Take with the usual addition of polynomials and multiplication by a complex scalar. This is a vector space; its zero vector is the polynomial with all coefficients zero. Every recycled definition below is applied with this .
Name the vectors
Let , and . These are vectors in the sense of the definition: nothing about them is a column of numbers.
Form a linear combination
Apply the recycled definition with , , . Collecting like powers is exactly the vector addition of :
Confirm closure
The result has degree , so it is again an element of . This is not a coincidence to be checked case by case — the closure axioms guarantee it for every choice of scalars.
Write a relation of linear dependence
Set a general linear combination equal to the zero vector of and expand:
Equate coefficients to get a linear system
Two polynomials are equal exactly when corresponding coefficients agree, so the abstract equation becomes a homogeneous system of three equations in three unknowns:
Solve and interpret
The first equation forces ; the second gives ; substituting into the third gives , hence . Only the trivial relation exists, so is linearly independent by the recycled definition.
Three curves with no redundancy between them: no correction curve in the set can be reproduced by scaling and adding the other two, so all three coefficients are identifiable from calibration data. Every step used a definition written for column vectors, applied without alteration to polynomials, and the decisive computation was an ordinary homogeneous linear system.
Applications & Industry Use
Basis expansions of waveforms
A finite-energy signal is expanded as a linear combination of Fourier, wavelet or Gabor atoms. The atoms are functions rather than columns, yet independence, span and redundancy are defined and tested exactly as for column vectors, which is what makes dictionary design a linear-algebra problem rather than an analysis problem.
Superposition of load cases
Deflected shapes of a linear elastic structure form a vector space under pointwise addition and scaling. Combining unit load cases with scalar factors is a linear combination in that space, so the entire apparatus of independence and spanning applies to load-case libraries without reformulating them as coordinate vectors first.
Spaces of transfer polynomials
Controller design frequently manipulates polynomials of bounded degree — characteristic polynomials, Diophantine equation solutions, observer polynomials. Treating as a vector space means pole-placement questions become questions about spanning sets, and are settled by the same consistency test used on numeric systems.
Reaction stoichiometry over species vectors
Reaction vectors live in a space indexed by chemical species. Independent reactions, redundant mechanisms and the dimension of the reaction space are read off using the recycled definitions, whether the species are held as a column, a sparse map or a symbolic table.
Spaces of transformation matrices
Blend shapes, skinning weights and linear transformation blending all combine matrices with scalar weights. Recognising as a vector space means the interpolation is a linear combination and its degrees of freedom are computed with standard independence tests.
Spaces of basis functions in regression
Spline, polynomial and radial basis regressions fit a linear combination of basis functions. Collinearity in the design is precisely linear dependence of those functions restricted to the sample points, and detecting it uses the same relation-of-linear-dependence test applied in any vector space.
Design Considerations
State the space and its operations before anything else
The same underlying set can carry more than one pair of operations, and the answers depend on which pair is intended. A written argument should name the set, the addition and the scalar multiplication once, at the top, rather than leaving them implicit. Ambiguity here is the source of most spurious paradoxes about abstract spaces.
Do not import definitions that need extra structure
Norm, inner product, orthogonality, angle and length are not consequences of the ten axioms. They require an inner product to be supplied as additional structure. Transferring them by analogy is the most common overreach; check that the target space actually carries the structure the definition names.
Choose a coordinate description before computing
Abstract statements are proved abstractly, but numbers require coordinates. Decide early which description of you will equate against — coefficients of a polynomial, entries of a matrix, samples of a function — and use it consistently, since mixing descriptions silently changes the linear system being solved.
Keep scalars over unless a real result is required
Working over avoids case analysis and is the setting in which eigenvalue and factorisation results are cleanest. If a downstream requirement is that scalars remain real, state that restriction explicitly; a set independent over may behave differently when complex scalars are permitted.
Treat finite dimension as an assumption, not a given
Spaces of all polynomials, all sequences or all continuous functions are vector spaces but are not finite-dimensional. Definitions of linear combination and independence still apply, but results that count vectors or compare a set size with a dimension do not. Verify finite dimension before invoking a counting argument.
Standards & Codes
Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.
| Reference | Title | Relevance to this topic |
|---|---|---|
ISO 80000-2 | Quantities and units — Part 2: Mathematics | Fixes the notation used for sets, operations and scalars in this article, including the blackboard-bold forms and and the convention that operator names are set upright. |
ISO/IEC 40314 | Mathematical Markup Language (MathML) Version 3.0 | Encodes the abstract expressions on this page as structured markup, so that a linear combination is machine-readable rather than a picture of one. |
ISO/IEC 14882 | Programming languages — C++ | Specifies the concept and template machinery by which a single generic algorithm can be instantiated over any type supplying addition and scalar multiplication — the software analogue of recycling a definition. |
IEEE 754-2019 | IEEE Standard for Floating-Point Arithmetic | Defines the arithmetic in which abstract scalar coefficients are ultimately represented, and therefore the tolerance issues that appear once an abstract independence test is executed numerically. |
W3C WCAG 2.1 AA | Web Content Accessibility Guidelines | Requires that polynomial and matrix expressions on this page be exposed semantically to assistive technology rather than rendered as unlabelled images. |
Material Selection
For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.
| Representation | Select when | Trade-off |
|---|---|---|
| Exact rational coefficients | Symbolic work in or where the answer is a yes/no independence or membership verdict. | Verdicts are certain and no tolerance is required, but coefficient growth during elimination can be severe for large sets. |
| IEEE 754 binary64 scalars | Numerical evaluation of coefficients in engineering models where inputs already carry measurement error. | Fast and compact, but the independence verdict becomes a rank decision with a tolerance rather than an exact statement. |
| Complex scalars () | The default for this theory, and mandatory when eigenvalue or root-based arguments follow. | Doubles storage and arithmetic cost relative to real scalars for problems whose data are genuinely real. |
| Real scalars () | The application forbids complex quantities, as in physical dimensions, probabilities or interval constraints. | Halves the arithmetic but forfeits results that require an algebraically closed scalar field, and changes some independence verdicts. |
| Coefficient-vector representation of | Any computation in a polynomial space; store the coefficients as a dense column. | Reduces abstract questions to standard array code, but ties the answer to the chosen monomial ordering and can be badly conditioned for high degree. |
| Column-major flattening of | Independence and span computations on matrix sets, where each matrix becomes a column of length . | Makes existing dense solvers directly usable, but discards structure such as symmetry or sparsity that a native representation would preserve. |
Manufacturing Notes
Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.
The standard reduction to a linear system
Every abstract membership or independence question in a finite-dimensional space is executed the same way: choose a coordinate description, write the unknown scalars, expand, equate coordinates, assemble an augmented or coefficient matrix, and row-reduce. For a set of vectors in a space of dimension this produces a system, so the cost is that of one elimination on a matrix of that shape.
Cost of the flattening step
Flattening matrices from into columns of length is work and touches memory once. The subsequent elimination dominates at roughly operations for . In practice the flattening is negligible, which is why generic libraries flatten rather than implement matrix-native elimination.
Library support for abstract spaces
SymPy exposes polynomials and matrices as first-class objects and will solve linear systems in their coefficients directly. NumPy and Eigen have no notion of an abstract vector space, so the flattening must be performed by the caller. In both cases the underlying computation is identical; only the amount of boilerplate differs.
Verifying a transfer argument
To check that a proof really is coordinate-free, run a substitution audit: replace every occurrence of with , delete every reference to an entry index, and confirm the proof still parses. Any step that fails the audit is a step that silently used the column structure and must be repaired or the theorem restricted.
Guarding against degenerate operations
When defining a new vector space in code, unit-test all ten axioms on randomised inputs, including the identity rule . Implementations that scale in place or short-circuit on a zero scalar are exactly where that last axiom is accidentally broken, and the failure is invisible until a downstream independence test returns nonsense.
Failure Modes & Common Mistakes
| Failure mode / mistake | Impact | Root cause | Prevention & detection |
|---|---|---|---|
| Assuming an inner product exists | high | Carrying orthogonality, norm or angle arguments into a space whose axioms supply neither. | List the structure a definition requires before transferring it; add an inner product explicitly if the argument needs one. |
| Using the wrong zero vector | high | Writing a relation of linear dependence against the scalar or against a zero object from a different space. | Name the zero vector of explicitly at the start of any argument that mentions . |
| Treating facts as axioms | medium | Invoking properties of columns — entries, size, componentwise comparison — inside an argument about a general . | Restrict every step to a cited axiom, definition or previously proved abstract theorem. |
| Silently changing the operations | medium | Using a familiar set with a non-standard addition or scalar multiplication without saying so, so readers apply the wrong arithmetic. | State the set and both operations as a triple whenever a non-standard space is introduced. |
| Confusing degree with dimension in | medium | Assuming that has degrees of freedom because its members have degree at most . | Count the coefficients: has dimension , because the constant term is a coefficient too. |
| Applying counting theorems in infinite dimension | medium | Using results that compare the number of vectors with the dimension of the space when the space has no finite basis. | Establish finite dimension before invoking any theorem that counts vectors. |
| Assuming closure without checking | low | Treating a subset defined by an inequality or a non-linear condition as though linear combinations stayed inside it. | Verify the two closure axioms explicitly for any newly proposed set of vectors. |
| Dropping the identity axiom | low | Believing follows from the other nine axioms and omitting it from a verification. | Test it separately; the degenerate scalar multiplication satisfies the other nine and fails only this one. |
FAQs
Why bother restating definitions that are word-for-word identical?
Because the hypothesis changes even when the words do not. The original definitions were stated for column vectors, so any theorem citing them formally applies only to columns. Restating them inside a vector space widens the scope of every downstream theorem at the cost of one sentence, which is an exceptionally good trade.
Which familiar definitions do <em>not</em> transfer to an arbitrary vector space?
Anything requiring structure beyond the two operations. Inner product, norm, orthogonality, orthonormality and the Gram-Schmidt procedure all need an inner product, which the axioms do not supply. Determinant, transpose and matrix product need the objects to be matrices. Those notions return only when the extra structure is added deliberately.
Does the theory work if the scalars are real rather than complex?
Yes. All ten axioms and all four recycled definitions read identically over , and every result on this page holds. The difference appears later: is not algebraically closed, so results guaranteeing the existence of eigenvalues or the factorisation of a polynomial can fail over the reals.
How do I actually compute in an abstract space?
Choose a description that identifies each vector by a finite list of numbers — coefficients for a polynomial, entries for a matrix — then equate those lists. The abstract equation becomes a linear system in the unknown scalars, and row reduction answers it. The abstraction organises the argument; the arithmetic is unchanged.
Is a vector space allowed to have exactly one element?
Yes. The set containing only a zero vector, with the only possible operations, satisfies all ten axioms. It is the trivial vector space, has dimension zero, and its only basis is the empty set. It appears constantly as the null space of a nonsingular matrix and as the kernel of an injective transformation.
Why is the axiom kept if it looks obvious?
Because it is independent of the other nine. Take with its usual addition but define for every scalar and vector. The first nine axioms hold; the identity rule fails, since . Without the tenth axiom that degenerate structure would qualify as a vector space and the theory would collapse.
Are polynomials really vectors?
In the technical sense, yes. A vector is an element of a vector space, and polynomials of degree at most satisfy all ten axioms under ordinary addition and scalar multiplication. The word carries no geometric commitment; arrows in the plane are one example among many, not the definition.
References
- Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section VS, Subsection RD. Licensed under the GNU Free Documentation License v1.2.
- Halmos, P. R. Finite-Dimensional Vector Spaces, 2nd edition. Springer, 1974.
- Axler, S. Linear Algebra Done Right, 3rd edition. Springer, 2015.
- ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
- W3C. Mathematical Markup Language (MathML) Version 3.0, 2nd edition (ISO/IEC 40314).
AI Suggested Questions
- Give me a definition from linear algebra that fails to transfer to an abstract vector space, and identify exactly which words break it.
- Construct a set with ordinary addition and a strange scalar multiplication that satisfies nine vector space axioms and fails exactly one, other than the identity axiom.
- Show how a linear independence question in becomes a homogeneous system of six equations, and explain what determines the number of equations.
- Compare the dimension of with the dimension of and explain why both are counted by listing coefficients.
- Why does the theory of linear algebra prefer complex scalars, and which specific theorems fail over the real numbers?
- Walk me through checking all ten vector space axioms for the set of continuous functions on an interval.
Related Calculators
Combine polynomials in with arbitrary scalars and return the result in coefficient form.
Abstract Independence TesterTest a set of polynomials or matrices for linear independence by flattening to coordinates and row-reducing.
Vector Space Axiom CheckerVerify all ten axioms for a user-supplied set with custom addition and scalar multiplication rules.
