Context and scope
the supplied physics reference, Applications of Classical Physics — Chapters 3–6 Kinetic Theory · Statistical Mechanics · Statistical Thermodynamics · Random Processes
/20 Summary
- Central object: the distribution function in 6-D (or 7-D relativistic) phase space — number of particles per unit volume per unit momentum.
- Three pillars of statistical physics:
- Kinetic theory (Ch. 3): non-equilibrium evolution via Liouville / Boltzmann equations.
- Statistical mechanics (Ch. 4–5): equilibrium ensembles connect microstates ↔︎ thermodynamics.
- Random processes (Ch. 6): time-series fluctuations, noise, Brownian motion, FDT.
- Bedrock principle: maximum entropy under given constraints ⇒ all equilibrium distributions (Maxwell-Boltzmann, Bose-Einstein, Fermi-Dirac, Planck).
- The triple connection between (i) microscopic dynamics, (ii) equilibrium thermodynamics, and (iii) fluctuations is the fluctuation-dissipation theorem — the signature result of this Part.
- Three ensembles as Legendre transforms:
- Microcanonical: fixed → entropy
- Canonical: fixed → Helmholtz
- Grand canonical: fixed → grand potential
- Practical payoff: every later Part (fluids, plasma, optics, GR) imports equations of state, transport coefficients, and noise spectra from here.
Master Map
mindmap
root((Stat Physics))
Ch.3 Kinetic Theory
Phase space
Distribution function N
Liouville theorem
Quantum statistics
Maxwell-Boltzmann
Bose-Einstein
Fermi-Dirac
Planck
Equations of state
Mean free path
Boltzmann eqn
Ch.4 Stat Mechanics
Microcanonical
Canonical
Grand canonical
Partition function Z
Entropy
Density of states
Bose condensation
Blackbody radiation
Ch.5 Stat Thermo
U F G H Omega
Maxwell relations
Phase transitions
Saha equation
Chemical potential
Fluctuations
Ch.6 Random Processes
Markov chains
Stationary ensembles
Wiener-Khinchin
Langevin
Fokker-Planck
Brownian motion
Fluctuation-Dissipation
Shot noise
1/f noise
Kinetic Theory
The Distribution Function
The fundamental object of kinetic theory is the number density in phase space:
Properties:
- Units: (length)⁻³ (momentum)⁻³
- Always
- is a Lorentz invariant (in B&T's convention) — the volume element is the invariant measure, but conventions vary. Always verify.
Reduced/integrated quantities:
| Quantity | Definition | Units |
|---|---|---|
| Number density | per volume | |
| Number flux | per area per time | |
| Energy density | energy / volume | |
| Momentum density | momentum / volume | |
| Stress | momentum flux | |
| Stress-energy () | (relativistic) |
Mean values (single-particle averages over ):
Liouville's Theorem
For a Hamiltonian system, phase-space volume is preserved along the flow:
Equivalently (with Hamilton's equations , ):
where is the Poisson bracket.
Physical picture: the distribution function is constant along particle trajectories in phase space. It's the analog of incompressibility for the "fluid" of particles in space.
Boltzmann equation (add collisions):
The collision integral (binary collisions, classical):
Equilibrium Distributions — Master Form
Any equilibrium distribution in B&T takes the form:
where is the mean occupation number per quantum state.
| Statistics | Denominator | Particles |
|---|---|---|
| Maxwell-Boltzmann (classical) | distinguishable, no QM degeneracy | |
| Bose-Einstein | identical bosons (integer spin) | |
| Fermi-Dirac | identical fermions (half-integer spin) | |
| Planck (photons) | (photon number not conserved) |
Then where counts spin/polarization states.
Specific Cases — Number, Energy, Pressure
For an ideal classical gas (M-B distribution, non-relativistic):
- Equipartition: per particle (translation)
- (ideal gas law — emerges from )
- per particle (monatomic)
Speed distribution (Maxwell):
| Speed | Formula | Numerical (T=300K, m=H₂) |
|---|---|---|
| Most probable | — | |
| Mean | — | |
| RMS | — |
Equation of State — Polytropic Index
For an ideal classical gas:
Adiabatic index :
| Gas | |
|---|---|
| Monatomic (He, Ar) | |
| Diatomic (N₂, O₂, room T) | |
| Diatomic at very high T (vibrations active) | |
| Relativistic (photons, ultra-rel matter) | |
| Non-relativistic degenerate Fermi | |
| Relativistic degenerate Fermi |
Universal relation (from kinetic theory): holds for any isotropic distribution.
Degenerate Fermi Gas (Cold Limit)
When (Fermi energy), (step function).
Non-relativistic degenerate:
→ supports white dwarfs (Chandrasekhar)
Ultra-relativistic degenerate:
→ Chandrasekhar mass limit (no stable equilibrium above this for cold electron-degenerate stars)
Photon Gas (Planck Distribution)
Integrated quantities:
| Quantity | Result |
|---|---|
| Energy density | , |
| Pressure | (radiation EOS) |
| Number density | |
| Entropy density | |
| Stefan-Boltzmann flux | , |
Adiabatic index: .
Mean Free Path & Transport (Heuristic)
Mean free path: where is cross section.
Collision time: .
Order-of-magnitude transport coefficients (random-walk argument):
| Coefficient | Formula | Diffuses |
|---|---|---|
| Self-diffusion | particles | |
| Viscosity | momentum | |
| Thermal cond. | energy | |
| Electrical cond. | charge |
Wiedemann-Franz law (metals): , with Lorenz number — both transport coefficients carried by same electrons.
Statistical Mechanics
Microstates, Ensembles, Ergodicity
Microstate: complete specification of quantum state of the system (a point in phase space classically, or a basis state quantum-mechanically).
Macrostate: specified by macroscopic parameters — many microstates per macrostate.
Ergodic hypothesis: time average along a trajectory = ensemble average over all accessible microstates with equal a priori probability (subject to conservation laws).
Statistical equilibrium: the ensemble distribution is stationary under microscopic evolution.
The Three Ensembles
flowchart LR
A[Microcanonical<br/>E, V, N fixed<br/>S = k ln W]
B[Canonical<br/>T, V, N fixed<br/>F = -kT ln Z]
C[Grand Canonical<br/>T, V, μ fixed<br/>Ω = -kT ln Ξ]
A -->|exchange E w/ bath| B
B -->|exchange N w/ bath| C
Microcanonical Ensemble
System isolated. All accessible microstates equally probable.
Boltzmann's relation:
— inscribed on Boltzmann's tombstone, the foundation of statistical thermodynamics.
Canonical Ensemble
System exchanges energy with reservoir at temperature . Probability of microstate with energy :
Partition function:
Everything derives from :
| Quantity | Formula |
|---|---|
| Helmholtz free energy | |
| Internal energy | |
| Entropy | |
| Pressure | |
| Chemical potential | |
| Heat capacity |
Last identity = fluctuation-response relation: energy fluctuations ↔︎ heat capacity.
Grand Canonical Ensemble
System exchanges both energy and particles with reservoir.
Grand partition function:
Grand potential: .
| Quantity | Formula |
|---|---|
| Pressure | |
| Particle fluctuation |
Density of States
Continuum limit of . Number of states with energy in .
Examples:
| System | |
|---|---|
| 3-D free particle | |
| Relativistic free | |
| Photon (per polarization) | |
| 3-D harmonic oscillator |
Use: convert . All ensemble integrals become 1-D.
Bose-Einstein Condensation
For bosons with conserved number ( always for free Bose gas):
- at finite density ⇒ ground state acquires macroscopic occupation.
- Critical temperature:
- Below : condensate fraction .
- at : depends only on , not on (the condensate has zero pressure).
Observed in: ultra-cold alkali vapors (Cornell, Wieman, Ketterle, Nobel 2001), liquid ⁴He (superfluid), exciton-polariton systems.
Black-Body Radiation (Detail)
Apply grand canonical to photons (massless, , spin-1 with 2 polarizations):
Limits:
- Rayleigh-Jeans ():
- Wien ():
Wien's displacement law: , m·K.
Total flux: , Stefan-Boltzmann constant W/(m²·K⁴).
Specific Heat of Solids
| Model | High T limit | Low T limit |
|---|---|---|
| Dulong–Petit | — (fails) | |
| Einstein (single ) | (wrong shape) | |
| Debye (acoustic continuum, cutoff ) | ✓ |
Debye law (low T):
with Debye temperature , typically 100–500 K.
Statistical Thermodynamics
The Four Laws
| Law | Statement | Formal |
|---|---|---|
| 0th | Transitive thermal equilibrium ⇒ temperature exists | — |
| 1st | (energy conservation) | |
| 2nd | for isolated system; reversible iff equality | |
| 3rd | (often 0) as | Nernst |
Thermodynamic Potentials — Legendre Transforms
flowchart TD
U["U(S,V,N)\nInternal Energy"] -->|−PV| H["H = U + PV\nEnthalpy\nH(S,P,N)"]
U -->|−TS| F["F = U − TS\nHelmholtz\nF(T,V,N)"]
F -->|−PV| G["G = F + PV\nGibbs\nG(T,P,N)"]
F -->|−μN| O["Ω = F − μN\nGrand Potential\nΩ(T,V,μ)"]
Differential forms:
Natural variables determine which potential is minimized:
| Constraints | Minimized | Used for |
|---|---|---|
| fixed | Isolated mechanical | |
| fixed | Steady-flow processes, calorimetry | |
| fixed | Closed systems at fixed | |
| fixed | Chemical reactions, phase changes | |
| fixed | Open systems, surfaces |
Maxwell Relations
From equality of mixed partials of potentials (e.g., ):
Mnemonic "thermodynamic square":
V — F — T
| |
U G
| |
S — H — P
Read each side: etc. Maxwell relations follow from rotating the square.
Heat Capacities & Identities
General relation (always true):
with (thermal expansion), (isothermal compressibility).
For ideal gas: , .
Sound speed:
Chemical Potential — The "Energy Cost of Adding a Particle"
Ideal classical gas:
is the thermal de Broglie wavelength. Classical limit valid when .
Equilibrium conditions:
- Two phases coexist: at fixed .
- Reaction : .
Saha Equation (Ionization Equilibrium)
For with ionization energy :
where are internal partition functions.
Applications: stellar atmospheres, primordial recombination (z≈1100, CMB decoupling), HII regions, ionosphere.
Phase Transitions
First-order: discontinuity in first derivatives of (entropy, volume) → latent heat. Examples: water-ice, condensation.
Clausius-Clapeyron equation:
where is latent heat per particle.
Second-order (continuous): derivatives continuous, but second derivatives diverge. Examples: ferromagnet at , superfluid -transition, critical point CO₂.
Critical exponents (universal, depend on dimension + symmetry, not on microscopic details):
| Quantity | Behavior | Mean field | 3-D Ising |
|---|---|---|---|
| Specific heat | $C \sim | t | ^{-\alpha}$ |
| Order parameter | $m \sim | t | ^\beta$ () |
| Susceptibility | $\chi \sim | t | ^{-\gamma}$ |
| Field-magnet |
with .
Fluctuations of Thermodynamic Variables
In the canonical ensemble:
Key insight: fluctuations scale as , so relative fluctuations — explains why thermodynamics works (huge ).
Connection to response functions: — variance equals the response to a thermodynamic perturbation. This is the seed of the fluctuation-dissipation theorem.
Random Processes
Random Variables & Distributions
Random variable : maps outcomes to numbers.
Probability density : .
Moments: .
Cumulants: , , $\kappa_3 = $ skewness × , etc. Generated by with .
Common Distributions
| Distribution | Density | Mean | Variance |
|---|---|---|---|
| Gaussian | |||
| Poisson | |||
| Exponential | , | ||
| Power-law | , | finite if | finite if |
| Lévy stable | (no closed form) | (heavy-tailed) | if |
Central Limit Theorem: sum of iid finite-variance RVs Gaussian as , scaled as . Foundation of why Gaussians dominate.
Random Processes
A random process is a family of random variables indexed by . Realization (sample path): one outcome over time.
Ensemble average: $\langle Y(t)\rangle = $ average over realizations at fixed .
Time average: .
Ergodic theorem: for stationary processes, ensemble average = time average.
Stationarity, Correlation, Spectral Density
Stationary: statistical properties invariant under time translation. Then:
Autocorrelation function :
- (mean square)
- (uncorrelated)
- Decay scale = correlation time
Spectral density (one-sided, ):
Inverse: .
Parseval / variance: .
Units: $[S_Y] = [Y]^2 / $ Hz.
Standard Noise Spectra
| Noise type | Spectrum | Origin | Where it shows up |
|---|---|---|---|
| White | Constant | Markov, | Thermal at high , idealization |
| ("pink", flicker") | Many superposed time scales | Electronics, geophysics, biology | |
| Brownian ("red") | Integrated white noise | Position of Brownian particle | |
| Shot noise | (one-sided) | Discrete uncorrelated events | Current, photon counting |
| the practitioner-Nyquist | (one-sided) | Thermal fluctuations in resistor | All circuits at |
| Photon shot | (counts) | Poisson arrivals | Optical detection |
Markov Processes & Chapman-Kolmogorov
Markov property: future depends only on present, not on history:
Chapman-Kolmogorov equation:
Master equation (continuous-time Markov, discrete states):
Detailed balance (in equilibrium): .
Brownian Motion & Langevin Equation
Langevin equation (1-D):
where is white-noise force with:
Solution moments (relaxation):
Equipartition at long times: . Matching:
Position diffusion (long-time):
with mobility . For Stokes drag on sphere of radius in fluid of viscosity :
Fluctuation-Dissipation Theorem (FDT)
The unifying theorem of stat. physics:
For a system in equilibrium at , the dissipation (imaginary part of response) is determined by the fluctuations (correlation/spectrum) of the conjugate variable:
with the linear response function: .
Concrete realizations:
| System | Fluctuation | Dissipation | FDT statement |
|---|---|---|---|
| Resistor | Voltage noise | Resistance | (Nyquist) |
| Brownian particle | Velocity correlation | Drag | , |
| Capacitor | Charge noise | Capacitance | |
| Magnetic susceptibility | Spin fluctuations | ||
| Pendulum (LIGO) | Position noise | Mechanical losses | Test-mass thermal noise |
Fokker-Planck Equation
When jumps are small + Markov → continuous-state evolution governed by:
with drift and diffusion (from Kramers-Moyal expansion).
Special case — Brownian motion in velocity (Ornstein-Uhlenbeck):
Stationary solution: Maxwellian .
Special case — diffusion (zero drift, constant ):
→ .
Boltzmann form (general): equilibrium where is a potential. The FP equation can be cast as
making detailed balance manifest.
Kramers' Escape Rate (a key application of FP)
Particle in potential well, escape over barrier of height :
with = well frequency, = barrier curvature. Arrhenius form — exponential temperature dependence governs chemical reaction rates, vacancy diffusion, nucleation, etc.
Shot Noise
For Poisson process with rate : counts in window have , .
Current , two-sided spectrum , one-sided (Schottky formula).
Comparison with thermal: thermal noise (vanishes at ); shot noise (survives at ). Crossover at .
Workflow / Process — How to attack a stat-phys problem
flowchart TD
A["What is the question?"] --> B["Equilibrium or non-equilibrium?"]
B -->|Equilibrium| C["Which constraints?"]
B -->|Non-equilibrium| D["Kinetic / random process"]
C -->|"E, V, N fixed"| E["Microcanonical:\nS = k ln W"]
C -->|"T, V, N fixed"| F["Canonical:\nF = -kT ln Z"]
C -->|"T, V, μ fixed"| G["Grand canonical:\nΩ = -kT ln Ξ"]
D --> H["Closed-form distribution f?"]
H -->|Yes| I["Boltzmann equation"]
H -->|No| J["Markov?"]
J -->|"Yes, small jumps"| K["Fokker–Planck"]
J -->|"Yes, discrete"| L["Master equation"]
J -->|"Linear w/ noise"| M["Langevin → FDT"]
E --> N["Compute g(E), derive thermo"]
F --> N
G --> N
I --> O["Transport coefficients"]
K --> O
L --> O
M --> O
Comparison Tables
Quantum Statistics
| Maxwell-Boltzmann | Bose-Einstein | Fermi-Dirac | |
|---|---|---|---|
| Particles | classical | identical bosons | identical fermions |
| Spin | — | integer | half-integer |
| Occupation | |||
| Max per state | ∞ | ∞ | 1 |
| Limit | for | macroscopic in ground state | step function |
| EOS, ultra-rel | |||
| Examples | dilute gases | photons, ⁴He, gluons | electrons, ³He, neutrons, neutrinos |
Ensemble Comparison
| Ensemble | Variables | Probability | Potential | Use case |
|---|---|---|---|---|
| Microcanonical | Isolated systems | |||
| Canonical | Closed, fixed temp | |||
| Grand canonical | Open systems | |||
| Isothermal-isobaric | Chemistry, biology |
Noise & Their Origins
| Noise | Where | Mitigation | |
|---|---|---|---|
| Thermal (the practitioner-Nyquist) | All resistors, | Cool device | |
| Shot | Discrete carriers in current | Increase (relative drops) | |
| Slow processes, traps | Modulate / chop signal | ||
| Quantum (zero-point) | + thermal | Linear amplifiers | Squeezed states |
| Photon shot | Optical detection | More photons |
Adiabatic Indices
| System | behavior | |
|---|---|---|
| Monatomic ideal gas | adiabatically | |
| Diatomic, K | ||
| Diatomic + vibration | ||
| Photon gas | , isothermal-like | |
| Non-rel degenerate e⁻ | (white dwarfs) | |
| Ultra-rel degenerate e⁻ | (Chandrasekhar limit) |
Common Mistakes
- ❌ Conflating microcanonical and canonical. They give same thermodynamics in thermodynamic limit, but very different fluctuations (microcanonical: ; canonical: ).
- ❌ Using classical statistics when . Must use B-E or F-D. Common in electrons in metals, photons, ultra-cold atoms, neutron star matter.
- ❌ Forgetting spin degeneracy . Electrons: . Photons: (transverse polarizations only).
- ❌ Confusing mean and most-probable speeds. Maxwell distribution: . Use the right one for the right physical quantity.
- ❌ Applying ideal-gas thermodynamics to interacting/degenerate systems. Virial corrections, exchange, screening all matter.
- ❌ Ignoring for bosons. Only photons have . Atomic bosons have approaching zero at BEC.
- ❌ Treating heat as a state variable. is inexact (depends on path); , are state functions.
- ❌ Confusing reversible and quasi-static. Quasi-static needn't be reversible (e.g., slow Joule expansion).
- ❌ Wrong sign on chemical potential. for ideal gas at standard conditions is negative (large positive argument is < 1).
- ❌ Time-averaging non-stationary process. Wiener-Khinchin and FDT require stationarity. For non-stationary, use windowed analysis or two-time correlations.
- ❌ Forgetting factor of 2 (one-sided vs two-sided spectra). , so for .
- ❌ Misapplying central limit theorem. Fails for heavy-tailed (Lévy) distributions and for strongly correlated variables.
- ❌ Confusing Fokker-Planck and Boltzmann. FP: small jumps (continuous), Boltzmann: arbitrary collisions (kernel).
- ❌ Using mean-field exponents in 2-D or 3-D Ising. Mean-field is exact only above upper critical dimension ( for Ising-like).
