← LibraryRecycling Definitions in Abstract Vector Spaces | KEVOS® MathematicsProject Delivery · Project ManagementLesson 134/189← PrevNext →
ArticlePublished 8 Aug 202621 min readBy Kevin Jogin
Skip to content

Engineering/Mathematics/Vector Spaces

Recycling Definitions in Abstract Vector Spaces

Four definitions that were built for column vectors — linear combination, span, relation of linear dependence and linear independence — require nothing but vector addition, scalar multiplication and a zero vector. They therefore transfer verbatim to polynomials, matrices, functions and every other vector space, and so does the machinery built on top of them.

  • Core level
  • Stream: vector-spaces
  • Reading time 12 min
  • Ref KVS-ENG-MATH-0058
Taxonomy
Engineering / Mathematics
Prerequisite
The ten vector space axioms
Definitions recycled
Linear combination, span, relation of linear dependence, linear independence
What changes
Only the objects and the two operations
What is unchanged
Every statement, proof and theorem built from them
Payoff
One body of theory serves m, Pn, Mmn and function spaces

Overview

The early development of linear algebra is carried out on column vectors, because a column of numbers is concrete and its arithmetic is unambiguous. That concreteness is a scaffold, not a foundation. Once the ten axioms of a vector space are in place, the axioms are the only facts about the objects that any argument is permitted to use, and the scaffold can be removed without the building falling down.

The observation that makes the transfer work is narrow and checkable. Read the definitions of linear combination, span, relation of linear dependence and linear independence and ask what each one actually mentions. Each mentions scalars, vectors, addition of vectors and multiplication of a vector by a scalar — and nothing else. No definition refers to entries, rows, columns, sizes, or the number m. A definition that never names a coordinate cannot break when the coordinates are removed.

The practical consequence is leverage. If u1, u2 and u3 are elements of a vector space V, the expression 5u1+7u213u3 is unambiguous whether V is 4, the space P5 of polynomials of degree at most five, the space M23 of 2×3 matrices, or a space of continuous functions. Because the expression parses, so does every theorem whose statement is built from such expressions. One proof discharges an unlimited family of concrete cases.

This is also where the abstraction pays for itself computationally. Membership in a span, or a test for independence, becomes a question about scalars, and equating coordinates in whatever description the space naturally has — coefficients of a polynomial, entries of a matrix — converts that question into a system of linear equations over . The abstract setting supplies the vocabulary; row reduction still supplies the answer.

Definition

Vector Space

VS

A vector space is a set V of objects called vectors, together with a rule for adding two vectors and a rule for multiplying a vector by a scalar from , such that both operations return elements of V and the ten standard axioms hold: additive and scalar closure; commutativity and associativity of addition; existence of a zero vector 0; existence of an additive inverse for each vector; associativity of scalar multiplication; distributivity of scalar multiplication over vector addition and over scalar addition; and the identity rule 1u=u.

The last axiom cannot be derived from the other nine. Taking any n with addition unchanged but with αx redefined to be 0 for every α and x satisfies the first nine and fails only the identity rule, which shows the axiom list is irredundant.

Linear Combination

LC

Let V be a vector space. Given vectors u1,u2,,un in V and scalars α1,α2,,αn in , the linear combination of those vectors with those scalars is the vector
α1u1+α2u2++αnun.
Closure guarantees that the result is again an element of V, so linear combinations never leave the space.

This is word-for-word the column-vector definition with the phrase "column vectors of size m" replaced by "vectors from V". Nothing else was altered, and nothing else needed to be.

Concepts

What a definition is allowed to mention

A definition is portable exactly to the extent that its statement refers only to structure the target setting possesses. The four recycled definitions pass this test because each is phrased entirely in terms of the two operations. By contrast, the definition of the inner product of two column vectors names entries and a summation index, so it does not transfer to an arbitrary vector space without additional structure being supplied. Testing a definition for portability is a mechanical exercise: underline every noun, and check whether the axioms alone provide it.

The four definitions that transfer

Four definitions carry over unchanged, keeping their content and shedding only the words "column vector" from their titles.

  • Linear combination: a weighted sum α1u1++αnun.
  • Span: the set of all linear combinations of a given finite set S, written span(S) or S.
  • Relation of linear dependence: an equation α1u1++αnun=0, trivial when every αi=0.
  • Linear independence: the property that the trivial relation is the only relation of linear dependence on S.
Each is stated inside a vector space V, which is the single hypothesis added when the definition is generalised.

The zero vector is the pivot of the whole transfer

Two of the four definitions mention 0. In m the zero vector is obvious, so its role is easy to overlook; in an abstract space it is supplied by an axiom, and it is unique, which is a theorem rather than a convention. That uniqueness is what makes "a relation of linear dependence" a well-posed notion: there is exactly one right-hand side it can have. In P4 the zero vector is the polynomial all of whose coefficients vanish; in M23 it is the 2×3 matrix of zeros; in a function space it is the function identically equal to zero. Substituting the correct zero object is the only translation step required.

Theorems inherit portability from their statements

If a theorem's statement and proof use only recycled definitions and the axioms, the theorem itself is recycled with no additional work. The result that a span is always a subspace is proved by exhibiting 0 as a linear combination and by collecting coefficients under distributivity — three axioms and one definition, no coordinates — and so it holds in every vector space. This is why the abstract chapter is short: most of its content is a re-reading of arguments already made, not a fresh set of arguments.

Computation returns to systems of equations

Abstraction changes the vocabulary, not the arithmetic. Asking whether y lies in span(S) inside P4 produces an equation between two polynomials; equality of polynomials means equality of coefficients, which is a system of five linear equations in the unknown scalars. Asking the same question in M32 produces six equations, one per entry. In every case the abstract question is decided by row-reducing an augmented matrix and applying the consistency test, so no new computational technique is needed — only a translation into coordinates and back.

Where the promotion of m leaves the theory

The statement that m satisfies ten specific properties was originally a theorem about columns of complex numbers. In the abstract setting the same statement is demoted to an example: m is now merely one vector space among many, verified against a definition rather than established by calculation. Nothing is lost — the ten properties are still true — but the logical direction reverses, and that reversal is precisely what licenses reasoning about Pn, Mmn and function spaces with the tools built for columns.

Transferring a definition to a new vector space

Confirm the setting is a vector spaceCheck the ten axioms for the candidate set with its stated addition and scalar multiplication, or cite a known example.
Audit the definition's vocabularyList everything the definition names. If it mentions only scalars, vectors, +, scalar multiplication and 0, it transfers.
Substitute the correct objectsReplace "column vector" with the elements of V, and replace the zero column with the zero vector of V.
Re-read the theorems built on itAny proof that used only the axioms and the recycled definition is now a proof in V with no edits.
Coordinatise to computeEquate coefficients or entries to turn the abstract question into a linear system, then row-reduce.

Equations

A linear combination in an arbitrary vector space

EQ-VSRD-01
5u1+7u213u3Vfor all u1,u2,u3V

Unambiguous in every vector space. The two closure axioms guarantee that the result is again a vector of V, so no expression of this shape can escape the space.

General linear combination

EQ-VSRD-02
α1u1+α2u2+α3u3++αnun

The recycled definition. Scalars αi, vectors uiV; no reference to entries or size appears anywhere.

Span of a finite set

EQ-VSRD-03
span(S)={α1u1+α2u2++αtutαi,1it}

For S={u1,,ut}V. The set of every linear combination that can be formed from S.

Relation of linear dependence

EQ-VSRD-04
α1u1+α2u2++αnun=0

Trivial when every αi=0. The set is linearly independent precisely when no other solution exists.

Zero vectors of three concrete spaces

EQ-VSRD-05
0P4=0x4+0x3+0x2+0x+0,0M23=[000000]

The only translation a recycled definition ever requires: identify the zero vector of the target space and substitute it.

Counterexample showing the identity axiom is independent

EQ-VSRD-06
αx=0for all α,x21x=0x

With ordinary addition on 2 and this scalar multiplication, nine axioms hold and only 1u=u fails. The axiom list therefore cannot be shortened.

Variable Definitions

Symbols used on this page
SymbolNameMeaningDomain / type
VVector spaceThe ambient set together with its two operationsany set satisfying the ten axioms
uiVectorAn element of V; may be a column, a polynomial, a matrix or a functionelement of V
αiScalarCoefficient multiplying a vector in a linear combinationcomplex number
0Zero vectorThe unique additive identity of Velement of V
SFinite set of vectorsThe set whose linear combinations are being formedfinite subset of V
span(S)SpanSet of all linear combinations of the vectors of Ssubset of V
PnPolynomial spacePolynomials in x of degree at most n with complex coefficientsvector space of dimension n+1
MmnMatrix spaceAll m×n matrices with complex entriesvector space of dimension mn
mColumn vector spaceColumn vectors of size m with complex entriesvector space of dimension m

Worked Numerical Example

Problem statement

A sensor calibration is modelled by a quadratic in the raw reading x, so the working space is P2, the polynomials of degree at most two. Two stored correction curves are combined, and a third candidate curve is tested for independence — using the column-vector definitions with no modification.

  1. Fix the vector space and its zero vector

    Take V=P2 with the usual addition of polynomials and multiplication by a complex scalar. This is a vector space; its zero vector is the polynomial with all coefficients zero. Every recycled definition below is applied with this 0.

  2. Name the vectors

    Let u1=1+x, u2=1x and u3=2+x2. These are vectors in the sense of the definition: nothing about them is a column of numbers.

    u1=x+1,u2=x+1,u3=x2+2
  3. Form a linear combination

    Apply the recycled definition with α1=3, α2=2, α3=1. Collecting like powers is exactly the vector addition of P2:

    3u1+2u2u3=3(x+1)+2(x+1)(x2+2)=x2+x+3
  4. Confirm closure

    The result x2+x+3 has degree 2, so it is again an element of P2. This is not a coincidence to be checked case by case — the closure axioms guarantee it for every choice of scalars.

  5. Write a relation of linear dependence

    Set a general linear combination equal to the zero vector of P2 and expand:

    α1(x+1)+α2(x+1)+α3(x2+2)=α3x2+(α1α2)x+(α1+α2+2α3)
  6. Equate coefficients to get a linear system

    Two polynomials are equal exactly when corresponding coefficients agree, so the abstract equation becomes a homogeneous system of three equations in three unknowns:

    {α3=0α1α2=0α1+α2+2α3=0
  7. Solve and interpret

    The first equation forces α3=0; the second gives α1=α2; substituting into the third gives 2α1=0, hence α1=α2=0. Only the trivial relation exists, so {u1,u2,u3} is linearly independent by the recycled definition.

Result

Three curves with no redundancy between them: no correction curve in the set can be reproduced by scaling and adding the other two, so all three coefficients are identifiable from calibration data. Every step used a definition written for column vectors, applied without alteration to polynomials, and the decisive computation was an ordinary homogeneous linear system.

Applications & Industry Use

Signal processing

Basis expansions of waveforms

A finite-energy signal is expanded as a linear combination of Fourier, wavelet or Gabor atoms. The atoms are functions rather than columns, yet independence, span and redundancy are defined and tested exactly as for column vectors, which is what makes dictionary design a linear-algebra problem rather than an analysis problem.

Structural engineering

Superposition of load cases

Deflected shapes of a linear elastic structure form a vector space under pointwise addition and scaling. Combining unit load cases with scalar factors is a linear combination in that space, so the entire apparatus of independence and spanning applies to load-case libraries without reformulating them as coordinate vectors first.

Control systems

Spaces of transfer polynomials

Controller design frequently manipulates polynomials of bounded degree — characteristic polynomials, Diophantine equation solutions, observer polynomials. Treating Pn as a vector space means pole-placement questions become questions about spanning sets, and are settled by the same consistency test used on numeric systems.

Chemical & process engineering

Reaction stoichiometry over species vectors

Reaction vectors live in a space indexed by chemical species. Independent reactions, redundant mechanisms and the dimension of the reaction space are read off using the recycled definitions, whether the species are held as a column, a sparse map or a symbolic table.

Computer graphics

Spaces of transformation matrices

Blend shapes, skinning weights and linear transformation blending all combine matrices with scalar weights. Recognising Mmn as a vector space means the interpolation is a linear combination and its degrees of freedom are computed with standard independence tests.

Statistics & data science

Spaces of basis functions in regression

Spline, polynomial and radial basis regressions fit a linear combination of basis functions. Collinearity in the design is precisely linear dependence of those functions restricted to the sample points, and detecting it uses the same relation-of-linear-dependence test applied in any vector space.

Design Considerations

State the space and its operations before anything else

The same underlying set can carry more than one pair of operations, and the answers depend on which pair is intended. A written argument should name the set, the addition and the scalar multiplication once, at the top, rather than leaving them implicit. Ambiguity here is the source of most spurious paradoxes about abstract spaces.

Do not import definitions that need extra structure

Norm, inner product, orthogonality, angle and length are not consequences of the ten axioms. They require an inner product to be supplied as additional structure. Transferring them by analogy is the most common overreach; check that the target space actually carries the structure the definition names.

Choose a coordinate description before computing

Abstract statements are proved abstractly, but numbers require coordinates. Decide early which description of V you will equate against — coefficients of a polynomial, entries of a matrix, samples of a function — and use it consistently, since mixing descriptions silently changes the linear system being solved.

Keep scalars over unless a real result is required

Working over avoids case analysis and is the setting in which eigenvalue and factorisation results are cleanest. If a downstream requirement is that scalars remain real, state that restriction explicitly; a set independent over may behave differently when complex scalars are permitted.

Treat finite dimension as an assumption, not a given

Spaces of all polynomials, all sequences or all continuous functions are vector spaces but are not finite-dimensional. Definitions of linear combination and independence still apply, but results that count vectors or compare a set size with a dimension do not. Verify finite dimension before invoking a counting argument.

Standards & Codes

Notation, interchange and numerical standards that govern how this material is written down, stored and computed in production systems.

Applicable standards, conventions and reference implementations
ReferenceTitleRelevance to this topic
ISO 80000-2Quantities and units — Part 2: MathematicsFixes the notation used for sets, operations and scalars in this article, including the blackboard-bold forms and and the convention that operator names are set upright.
ISO/IEC 40314Mathematical Markup Language (MathML) Version 3.0Encodes the abstract expressions on this page as structured markup, so that a linear combination is machine-readable rather than a picture of one.
ISO/IEC 14882Programming languages — C++Specifies the concept and template machinery by which a single generic algorithm can be instantiated over any type supplying addition and scalar multiplication — the software analogue of recycling a definition.
IEEE 754-2019IEEE Standard for Floating-Point ArithmeticDefines the arithmetic in which abstract scalar coefficients are ultimately represented, and therefore the tolerance issues that appear once an abstract independence test is executed numerically.
W3C WCAG 2.1 AAWeb Content Accessibility GuidelinesRequires that polynomial and matrix expressions on this page be exposed semantically to assistive technology rather than rendered as unlabelled images.

Material Selection

For a mathematical topic, "material" is the numeric representation: the scalar field, storage format and precision the computation is built from.

Representation and precision selection
RepresentationSelect whenTrade-off
Exact rational coefficientsSymbolic work in Pn or Mmn where the answer is a yes/no independence or membership verdict.Verdicts are certain and no tolerance is required, but coefficient growth during elimination can be severe for large sets.
IEEE 754 binary64 scalarsNumerical evaluation of coefficients in engineering models where inputs already carry measurement error.Fast and compact, but the independence verdict becomes a rank decision with a tolerance rather than an exact statement.
Complex scalars ()The default for this theory, and mandatory when eigenvalue or root-based arguments follow.Doubles storage and arithmetic cost relative to real scalars for problems whose data are genuinely real.
Real scalars ()The application forbids complex quantities, as in physical dimensions, probabilities or interval constraints.Halves the arithmetic but forfeits results that require an algebraically closed scalar field, and changes some independence verdicts.
Coefficient-vector representation of PnAny computation in a polynomial space; store the n+1 coefficients as a dense column.Reduces abstract questions to standard array code, but ties the answer to the chosen monomial ordering and can be badly conditioned for high degree.
Column-major flattening of MmnIndependence and span computations on matrix sets, where each matrix becomes a column of length mn.Makes existing dense solvers directly usable, but discards structure such as symmetry or sparsity that a native representation would preserve.

Manufacturing Notes

Implementation notes — how the result is actually produced by hand, by algorithm and by library, including cost and numerical behaviour.

The standard reduction to a linear system

Every abstract membership or independence question in a finite-dimensional space is executed the same way: choose a coordinate description, write the unknown scalars, expand, equate coordinates, assemble an augmented or coefficient matrix, and row-reduce. For a set of t vectors in a space of dimension d this produces a d×t system, so the cost is that of one elimination on a matrix of that shape.

Cost of the flattening step

Flattening t matrices from Mmn into columns of length mn is O(tmn) work and touches memory once. The subsequent elimination dominates at roughly O(t2mn) operations for tmn. In practice the flattening is negligible, which is why generic libraries flatten rather than implement matrix-native elimination.

Library support for abstract spaces

SymPy exposes polynomials and matrices as first-class objects and will solve linear systems in their coefficients directly. NumPy and Eigen have no notion of an abstract vector space, so the flattening must be performed by the caller. In both cases the underlying computation is identical; only the amount of boilerplate differs.

Verifying a transfer argument

To check that a proof really is coordinate-free, run a substitution audit: replace every occurrence of m with V, delete every reference to an entry index, and confirm the proof still parses. Any step that fails the audit is a step that silently used the column structure and must be repaired or the theorem restricted.

Guarding against degenerate operations

When defining a new vector space in code, unit-test all ten axioms on randomised inputs, including the identity rule 1u=u. Implementations that scale in place or short-circuit on a zero scalar are exactly where that last axiom is accidentally broken, and the failure is invisible until a downstream independence test returns nonsense.

Failure Modes & Common Mistakes

Failure modes, root causes and prevention
Failure mode / mistakeImpactRoot causePrevention & detection
Assuming an inner product existshighCarrying orthogonality, norm or angle arguments into a space whose axioms supply neither.List the structure a definition requires before transferring it; add an inner product explicitly if the argument needs one.
Using the wrong zero vectorhighWriting a relation of linear dependence against the scalar 0 or against a zero object from a different space.Name the zero vector of V explicitly at the start of any argument that mentions 0.
Treating m facts as axiomsmediumInvoking properties of columns — entries, size, componentwise comparison — inside an argument about a general V.Restrict every step to a cited axiom, definition or previously proved abstract theorem.
Silently changing the operationsmediumUsing a familiar set with a non-standard addition or scalar multiplication without saying so, so readers apply the wrong arithmetic.State the set and both operations as a triple whenever a non-standard space is introduced.
Confusing degree with dimension in PnmediumAssuming that Pn has n degrees of freedom because its members have degree at most n.Count the coefficients: Pn has dimension n+1, because the constant term is a coefficient too.
Applying counting theorems in infinite dimensionmediumUsing results that compare the number of vectors with the dimension of the space when the space has no finite basis.Establish finite dimension before invoking any theorem that counts vectors.
Assuming closure without checkinglowTreating a subset defined by an inequality or a non-linear condition as though linear combinations stayed inside it.Verify the two closure axioms explicitly for any newly proposed set of vectors.
Dropping the identity axiomlowBelieving 1u=u follows from the other nine axioms and omitting it from a verification.Test it separately; the degenerate scalar multiplication αx=0 satisfies the other nine and fails only this one.

FAQs

Why bother restating definitions that are word-for-word identical?

Because the hypothesis changes even when the words do not. The original definitions were stated for column vectors, so any theorem citing them formally applies only to columns. Restating them inside a vector space V widens the scope of every downstream theorem at the cost of one sentence, which is an exceptionally good trade.

Which familiar definitions do <em>not</em> transfer to an arbitrary vector space?

Anything requiring structure beyond the two operations. Inner product, norm, orthogonality, orthonormality and the Gram-Schmidt procedure all need an inner product, which the axioms do not supply. Determinant, transpose and matrix product need the objects to be matrices. Those notions return only when the extra structure is added deliberately.

Does the theory work if the scalars are real rather than complex?

Yes. All ten axioms and all four recycled definitions read identically over , and every result on this page holds. The difference appears later: is not algebraically closed, so results guaranteeing the existence of eigenvalues or the factorisation of a polynomial can fail over the reals.

How do I actually compute in an abstract space?

Choose a description that identifies each vector by a finite list of numbers — coefficients for a polynomial, entries for a matrix — then equate those lists. The abstract equation becomes a linear system in the unknown scalars, and row reduction answers it. The abstraction organises the argument; the arithmetic is unchanged.

Is a vector space allowed to have exactly one element?

Yes. The set containing only a zero vector, with the only possible operations, satisfies all ten axioms. It is the trivial vector space, has dimension zero, and its only basis is the empty set. It appears constantly as the null space of a nonsingular matrix and as the kernel of an injective transformation.

Why is the axiom 1u=u kept if it looks obvious?

Because it is independent of the other nine. Take 2 with its usual addition but define αx=0 for every scalar and vector. The first nine axioms hold; the identity rule fails, since 1x=0x. Without the tenth axiom that degenerate structure would qualify as a vector space and the theory would collapse.

Are polynomials really vectors?

In the technical sense, yes. A vector is an element of a vector space, and polynomials of degree at most n satisfy all ten axioms under ordinary addition and scalar multiplication. The word carries no geometric commitment; arrows in the plane are one example among many, not the definition.

References

  1. Beezer, R. A. A First Course in Linear Algebra, Version 0.70. University of Puget Sound, 2006. Section VS, Subsection RD. Licensed under the GNU Free Documentation License v1.2.
  2. Halmos, P. R. Finite-Dimensional Vector Spaces, 2nd edition. Springer, 1974.
  3. Axler, S. Linear Algebra Done Right, 3rd edition. Springer, 2015.
  4. ISO 80000-2:2019, Quantities and units — Part 2: Mathematics. International Organization for Standardization.
  5. W3C. Mathematical Markup Language (MathML) Version 3.0, 2nd edition (ISO/IEC 40314).

AI Suggested Questions

  • Give me a definition from linear algebra that fails to transfer to an abstract vector space, and identify exactly which words break it.
  • Construct a set with ordinary addition and a strange scalar multiplication that satisfies nine vector space axioms and fails exactly one, other than the identity axiom.
  • Show how a linear independence question in M23 becomes a homogeneous system of six equations, and explain what determines the number of equations.
  • Compare the dimension of Pn with the dimension of Mmn and explain why both are counted by listing coefficients.
  • Why does the theory of linear algebra prefer complex scalars, and which specific theorems fail over the real numbers?
  • Walk me through checking all ten vector space axioms for the set of continuous functions on an interval.

Related Calculators

Continue learning

Algebraic and Geometric Multiplicities of Eigenvalues | KEVOS® MathematicsArticle · Project ManagementAmitsur’s Theorem on the Radical of a Polynomial Ring | KEVOS®Article · Project ManagementAmitsur’s Theorem on the Radical of an Algebra of Small Dimension | KEVOS®Article · Project ManagementArchetypes: Reference Catalogue of Worked Systems | KEVOS® MathematicsArticle · Project Management