← ArticlesStatistical Physics and Kinetic Theory: /20 SummaryEngineering · PhysicsLesson 2/13← PrevNext →
GuidePublished 14 Aug 202628 min readBy Kevin JoginPhysicsApplied Classical PhysicsStatistical Physics and Kinetic TheoryContext and scope

Engineering · Physics · Applied Classical Physics

Statistical Physics and Kinetic Theory: /20 Summary

Engineering handbook for statistical physics and kinetic theory, covering context and scope, /20 summary, kinetic theory.

Executive summary

This handbook section converts the supplied engineering material into a practical, source-controlled reference. It concentrates on the following learning outcomes.

Context and scope
/20 Summary
Kinetic Theory
The Distribution Function
Liouville's Theorem
Equilibrium Distributions — Master Form

Context and scope

the supplied physics reference, Applications of Classical Physics — Chapters 3–6 Kinetic Theory · Statistical Mechanics · Statistical Thermodynamics · Random Processes



/20 Summary

  • Central object: the distribution function 𝒩(𝐱,𝐩,t)\mathcal{N}(\mathbf{x},\mathbf{p},t) in 6-D (or 7-D relativistic) phase space — number of particles per unit volume per unit momentum.
  • Three pillars of statistical physics:
    1. Kinetic theory (Ch. 3): non-equilibrium evolution via Liouville / Boltzmann equations.
    2. Statistical mechanics (Ch. 4–5): equilibrium ensembles connect microstates ↔︎ thermodynamics.
    3. Random processes (Ch. 6): time-series fluctuations, noise, Brownian motion, FDT.
  • Bedrock principle: maximum entropy under given constraints ⇒ all equilibrium distributions (Maxwell-Boltzmann, Bose-Einstein, Fermi-Dirac, Planck).
  • The triple connection between (i) microscopic dynamics, (ii) equilibrium thermodynamics, and (iii) fluctuations is the fluctuation-dissipation theoremthe signature result of this Part.
  • Three ensembles as Legendre transforms:
    • Microcanonical: fixed (E,V,N)(E, V, N) → entropy SS
    • Canonical: fixed (T,V,N)(T, V, N) → Helmholtz FF
    • Grand canonical: fixed (T,V,μ)(T, V, \mu) → grand potential Ω\Omega
  • Practical payoff: every later Part (fluids, plasma, optics, GR) imports equations of state, transport coefficients, and noise spectra from here.


Master Map

mindmap
  root((Stat Physics))
    Ch.3 Kinetic Theory
      Phase space
      Distribution function N
      Liouville theorem
      Quantum statistics
        Maxwell-Boltzmann
        Bose-Einstein
        Fermi-Dirac
        Planck
      Equations of state
      Mean free path
      Boltzmann eqn
    Ch.4 Stat Mechanics
      Microcanonical
      Canonical
      Grand canonical
      Partition function Z
      Entropy
      Density of states
      Bose condensation
      Blackbody radiation
    Ch.5 Stat Thermo
      U F G H Omega
      Maxwell relations
      Phase transitions
      Saha equation
      Chemical potential
      Fluctuations
    Ch.6 Random Processes
      Markov chains
      Stationary ensembles
      Wiener-Khinchin
      Langevin
      Fokker-Planck
      Brownian motion
      Fluctuation-Dissipation
      Shot noise
      1/f noise


Kinetic Theory


The Distribution Function

The fundamental object of kinetic theory is the number density in phase space:

𝒩(𝐱,𝐩,t)d3xd3p=number of particles in d3xd3p\mathcal{N}(\mathbf{x}, \mathbf{p}, t)\, d^3x\, d^3p = \text{number of particles in } d^3x\, d^3p

Properties:

  • Units: (length)⁻³ (momentum)⁻³
  • Always 0\ge 0
  • 𝒩\mathcal{N} is a Lorentz invariant (in B&T's convention) — the volume element d3xd3p/Ed^3x\, d^3p/E is the invariant measure, but conventions vary. Always verify.

Reduced/integrated quantities:

Quantity Definition Units
Number density n(𝐱,t)=𝒩d3pn(\mathbf{x},t) = \int \mathcal{N}\, d^3p per volume
Number flux 𝐒(𝐱,t)=𝐯𝒩d3p\mathbf{S}(\mathbf{x},t) = \int \mathbf{v}\,\mathcal{N}\, d^3p per area per time
Energy density u(𝐱,t)=E𝒩d3pu(\mathbf{x},t) = \int E\,\mathcal{N}\, d^3p energy / volume
Momentum density 𝛑(𝐱,t)=𝐩𝒩d3p\boldsymbol\pi(\mathbf{x},t) = \int \mathbf{p}\,\mathcal{N}\, d^3p momentum / volume
Stress Tij(𝐱,t)=pivj𝒩d3pT_{ij}(\mathbf{x},t) = \int p_i v_j\,\mathcal{N}\, d^3p momentum flux
Stress-energy (αβ\alpha\beta) Tαβ=pαpβ𝒩d3pE/cT^{\alpha\beta} = \int p^\alpha p^\beta\,\mathcal{N}\, \tfrac{d^3p}{E/c} (relativistic)

Mean values (single-particle averages over 𝒩\mathcal{N}): Q=Q𝒩d3p𝒩d3p\langle Q\rangle = \frac{\int Q\, \mathcal{N}\, d^3p}{\int \mathcal{N}\, d^3p}


Liouville's Theorem

For a Hamiltonian system, phase-space volume is preserved along the flow:

D𝒩Dt𝒩t+ẋi𝒩xi+ṗi𝒩pi=0(collisionless)\boxed{\frac{D\mathcal{N}}{Dt} \equiv \frac{\partial \mathcal{N}}{\partial t} + \dot{x}^i\frac{\partial \mathcal{N}}{\partial x^i} + \dot{p}^i\frac{\partial \mathcal{N}}{\partial p^i} = 0 \quad \text{(collisionless)}}

Equivalently (with Hamilton's equations ẋi=H/pi\dot{x}^i = \partial H/\partial p_i, ṗi=H/xi\dot{p}_i = -\partial H/\partial x^i):

𝒩t+{H,𝒩}=0\frac{\partial \mathcal{N}}{\partial t} + \{H, \mathcal{N}\} = 0

where {,}\{\cdot,\cdot\} is the Poisson bracket.

Physical picture: the distribution function is constant along particle trajectories in phase space. It's the analog of incompressibility for the "fluid" of particles in (𝐱,𝐩)(\mathbf{x},\mathbf{p}) space.

Boltzmann equation (add collisions): D𝒩Dt=(𝒩t)coll\frac{D\mathcal{N}}{Dt} = \left(\frac{\partial \mathcal{N}}{\partial t}\right)_{\text{coll}}

The collision integral (binary collisions, classical): (ft)coll=d3p1dΩ|𝐯𝐯1|σ(Ω)[ff1ff1]\left(\frac{\partial f}{\partial t}\right)_{\text{coll}} = \int d^3p_1\, d\Omega\, |\mathbf{v}-\mathbf{v}_1|\,\sigma(\Omega)\, [f' f'_1 - f f_1]


Equilibrium Distributions — Master Form

Any equilibrium distribution in B&T takes the form:

η(E)=1e(Eμ)/kBT±1 or 0\boxed{\eta(E) = \frac{1}{e^{(E-\mu)/k_B T} \pm 1 \text{ or } 0}}

where η\eta is the mean occupation number per quantum state.

Statistics Denominator Particles
Maxwell-Boltzmann (classical) e(Eμ)/kBTe^{(E-\mu)/k_B T} distinguishable, no QM degeneracy
Bose-Einstein e(Eμ)/kBT1e^{(E-\mu)/k_B T} - 1 identical bosons (integer spin)
Fermi-Dirac e(Eμ)/kBT+1e^{(E-\mu)/k_B T} + 1 identical fermions (half-integer spin)
Planck (photons) eω/kBT1e^{\hbar\omega/k_B T} - 1 μ=0\mu = 0 (photon number not conserved)

Then 𝒩=(gs/h3)η(E)\mathcal{N} = (g_s/h^3)\,\eta(E) where gsg_s counts spin/polarization states.


Specific Cases — Number, Energy, Pressure

For an ideal classical gas (M-B distribution, non-relativistic):

𝒩(𝐩)=n(12πmkBT)3/2ep2/(2mkBT)\mathcal{N}(\mathbf{p}) = n\left(\frac{1}{2\pi m k_B T}\right)^{3/2} e^{-p^2/(2 m k_B T)}

  • n=N/Vn = N/V
  • Equipartition: E=32kBT\langle E\rangle = \tfrac{3}{2} k_B T per particle (translation)
  • P=nkBTP = n k_B T (ideal gas law — emerges from pivj𝒩d3p\int p_i v_j \mathcal{N} d^3 p)
  • cV=32kBc_V = \tfrac{3}{2} k_B per particle (monatomic)

Speed distribution (Maxwell): f(v)dv=4πn(m2πkBT)3/2v2emv2/(2kBT)dvf(v)\, dv = 4\pi n \left(\frac{m}{2\pi k_B T}\right)^{3/2} v^2 e^{-mv^2/(2 k_B T)}\, dv

Speed Formula Numerical (T=300K, m=H₂)
Most probable vp=2kBT/mv_p = \sqrt{2 k_B T/m}
Mean v=8kBT/(πm)=1.128vp\bar v = \sqrt{8 k_B T/(\pi m)} = 1.128 v_p
RMS vrms=3kBT/m=1.225vpv_{\text{rms}} = \sqrt{3 k_B T/m} = 1.225 v_p

Equation of State — Polytropic Index

For an ideal classical gas: P=(γ1)uu=internal energy densityP = (\gamma-1)\, u \qquad u = \text{internal energy density}

Adiabatic index γ=cP/cV\gamma = c_P/c_V:

Gas γ\gamma
Monatomic (He, Ar) 5/31.6675/3 \approx 1.667
Diatomic (N₂, O₂, room T) 7/5=1.47/5 = 1.4
Diatomic at very high T (vibrations active) 9/71.2869/7 \approx 1.286
Relativistic (photons, ultra-rel matter) 4/31.3334/3 \approx 1.333
Non-relativistic degenerate Fermi 5/35/3
Relativistic degenerate Fermi 4/34/3

Universal relation (from kinetic theory): P=13pv𝒩d3pP = \tfrac{1}{3}\int p v\, \mathcal{N}\, d^3 p holds for any isotropic distribution.


Degenerate Fermi Gas (Cold Limit)

When kBTEFk_B T \ll E_F (Fermi energy), ηΘ(EFE)\eta \to \Theta(E_F - E) (step function).

Non-relativistic degenerate:

EF=22m(3π2n)2/3,P=25nEFn5/3E_F = \frac{\hbar^2}{2m}(3\pi^2 n)^{2/3}, \qquad P = \tfrac{2}{5} n E_F \propto n^{5/3}

→ supports white dwarfs (Chandrasekhar)

Ultra-relativistic degenerate:

EF=c(3π2n)1/3,P=14nEFn4/3E_F = \hbar c (3\pi^2 n)^{1/3}, \qquad P = \tfrac{1}{4} n E_F \propto n^{4/3}

Chandrasekhar mass limit MCh1.4MM_{\text{Ch}} \approx 1.4 M_\odot (no stable equilibrium above this for cold electron-degenerate stars)


Photon Gas (Planck Distribution)

𝒩γ(ω)dω=1π2c3ω2eω/kBT1dω\mathcal{N}_\gamma(\omega)\,d\omega = \frac{1}{\pi^2 c^3} \frac{\omega^2}{e^{\hbar\omega/k_BT} - 1} d\omega

Integrated quantities:

Quantity Result
Energy density u=aT4u = a T^4, a=π2kB4/(153c3)a = \pi^2 k_B^4/(15 \hbar^3 c^3)
Pressure P=u/3P = u/3 (radiation EOS)
Number density nγ=(2ζ(3)/π2)(kBT/c)3n_\gamma = (2 \zeta(3)/\pi^2)(k_BT/\hbar c)^3
Entropy density s=(4/3)u/T=(4/3)aT3s = (4/3)\, u/T = (4/3) a T^3
Stefan-Boltzmann flux σT4=(c/4)u\sigma T^4 = (c/4)\,u, σ=ac/4\sigma = a c/4

Adiabatic index: γrad=4/3\gamma_{\text{rad}} = 4/3.


Mean Free Path & Transport (Heuristic)

Mean free path: =1/(nσ)\ell = 1/(n\sigma) where σ\sigma is cross section.

Collision time: τ=/v\tau = \ell/\bar v.

Order-of-magnitude transport coefficients (random-walk argument):

Coefficient Formula Diffuses
Self-diffusion DD 13v\sim \tfrac{1}{3}\bar v \ell particles
Viscosity η\eta 13nmv\sim \tfrac{1}{3} n m \bar v \ell momentum
Thermal cond. κ\kappa 13ncvv\sim \tfrac{1}{3} n c_v \bar v \ell energy
Electrical cond. σe\sigma_e ne2τ/m\sim n e^2 \tau/m charge

Wiedemann-Franz law (metals): κ/(σeT)=L\kappa/(\sigma_e T) = L, with Lorenz number L=π2kB2/(3e2)L = \pi^2 k_B^2/(3 e^2) — both transport coefficients carried by same electrons.



Statistical Mechanics


Microstates, Ensembles, Ergodicity

Microstate: complete specification of quantum state of the system (a point in phase space classically, or a basis state quantum-mechanically).

Macrostate: specified by macroscopic parameters (E,V,N,T,P,μ,)(E, V, N, T, P, \mu, \ldots) — many microstates per macrostate.

Ergodic hypothesis: time average along a trajectory = ensemble average over all accessible microstates with equal a priori probability (subject to conservation laws).

Statistical equilibrium: the ensemble distribution is stationary under microscopic evolution.


The Three Ensembles

flowchart LR
    A[Microcanonical<br/>E, V, N fixed<br/>S = k ln W]
    B[Canonical<br/>T, V, N fixed<br/>F = -kT ln Z]
    C[Grand Canonical<br/>T, V, μ fixed<br/>Ω = -kT ln Ξ]
    A -->|exchange E w/ bath| B
    B -->|exchange N w/ bath| C

Microcanonical Ensemble

System isolated. All accessible microstates equally probable.

Pn=1W(E,V,N),W=#microstates with energy EP_n = \frac{1}{W(E,V,N)}, \qquad W = \#\text{microstates with energy } E

Boltzmann's relation: S(E,V,N)=kBlnW(E,V,N)\boxed{S(E,V,N) = k_B \ln W(E,V,N)}

— inscribed on Boltzmann's tombstone, the foundation of statistical thermodynamics.


Canonical Ensemble

System exchanges energy with reservoir at temperature TT. Probability of microstate nn with energy EnE_n:

Pn=eβEnZ,β=1kBTP_n = \frac{e^{-\beta E_n}}{Z}, \qquad \beta = \frac{1}{k_B T}

Partition function:

Z(T,V,N)=neβEn\boxed{Z(T,V,N) = \sum_n e^{-\beta E_n}}

Everything derives from ZZ:

Quantity Formula
Helmholtz free energy F=kBTlnZF = -k_B T \ln Z
Internal energy U=E=βlnZU = \langle E\rangle = -\partial_\beta \ln Z
Entropy S=(UF)/T=TFS = (U - F)/T = -\partial_T F
Pressure P=VFP = -\partial_V F
Chemical potential μ=NF\mu = \partial_N F
Heat capacity CV=TU=kBβ2(ΔE)2C_V = \partial_T U = k_B\beta^2 \langle (\Delta E)^2\rangle

Last identity = fluctuation-response relation: energy fluctuations ↔︎ heat capacity.


Grand Canonical Ensemble

System exchanges both energy and particles with reservoir.

Pn,N=eβ(En,NμN)ΞP_{n,N} = \frac{e^{-\beta(E_{n,N} - \mu N)}}{\Xi}

Grand partition function:

Ξ(T,V,μ)=NeβμNZ(T,V,N)=n,Neβ(En,NμN)\Xi(T,V,\mu) = \sum_N e^{\beta\mu N} Z(T,V,N) = \sum_{n,N} e^{-\beta(E_{n,N} - \mu N)}

Grand potential: Ω=kBTlnΞ=UTSμN=PV\Omega = -k_B T \ln\Xi = U - TS - \mu N = -PV.

Quantity Formula
N\langle N\rangle kBTμlnΞk_B T\, \partial_\mu \ln\Xi
E\langle E\rangle βlnΞ+μN-\partial_\beta \ln\Xi + \mu \langle N\rangle
Pressure P=(kBT/V)lnΞP = (k_BT/V)\ln\Xi
Particle fluctuation (ΔN)2=kBTμN\langle (\Delta N)^2\rangle = k_B T\,\partial_\mu \langle N\rangle

Density of States g(E)g(E)

Continuum limit of W(E)W(E). Number of states with energy in (E,E+dE)(E, E+dE).

Examples:

System g(E)g(E)
3-D free particle g(E)=(V/4π2)(2m/2)3/2Eg(E) = (V/4\pi^2)(2m/\hbar^2)^{3/2}\sqrt{E}
Relativistic free g(E)=(VEE2m2c4)/(2π23c3)g(E) = (V E\sqrt{E^2-m^2c^4})/(2\pi^2\hbar^3 c^3)
Photon (per polarization) g(ω)=Vω2/(2π2c3)g(\omega) = V\omega^2/(2\pi^2 c^3)
3-D harmonic oscillator g(E)=E2/(2(ω)3)g(E) = E^2/(2(\hbar\omega)^3)

Use: convert ng(E)dE\sum_n \to \int g(E)\, dE. All ensemble integrals become 1-D.


Bose-Einstein Condensation

For bosons with conserved number (μ<0\mu < 0 always for free Bose gas):

  • μ0\mu \to 0^- at finite density ⇒ ground state acquires macroscopic occupation.
  • Critical temperature:

kBTc=2π2m(nζ(3/2))2/3,ζ(3/2)2.612k_B T_c = \frac{2\pi\hbar^2}{m}\left(\frac{n}{\zeta(3/2)}\right)^{2/3}, \quad \zeta(3/2) \approx 2.612

  • Below TcT_c: condensate fraction N0/N=1(T/Tc)3/2N_0/N = 1 - (T/T_c)^{3/2}.
  • PP at T<TcT < T_c: depends only on TT, not on nn (the condensate has zero pressure).

Observed in: ultra-cold alkali vapors (Cornell, Wieman, Ketterle, Nobel 2001), liquid ⁴He (superfluid), exciton-polariton systems.


Black-Body Radiation (Detail)

Apply grand canonical to photons (massless, μ=0\mu=0, spin-1 with 2 polarizations):

u(ω)dω=ω3π2c3dωeω/kBT1u(\omega)\,d\omega = \frac{\hbar\omega^3}{\pi^2 c^3} \frac{d\omega}{e^{\hbar\omega/k_BT} - 1}

Limits:

  • Rayleigh-Jeans (ωkBT\hbar\omega \ll k_BT): u(ω)ω2kBT/(π2c3)u(\omega) \approx \omega^2 k_BT/(\pi^2 c^3)
  • Wien (ωkBT\hbar\omega \gg k_BT): u(ω)(ω3/π2c3)eω/kBTu(\omega) \approx (\hbar\omega^3/\pi^2 c^3)\,e^{-\hbar\omega/k_BT}

Wien's displacement law: ωpeak2.82kBT\hbar\omega_{\text{peak}} \approx 2.82 k_B T, λpeakT2.898×103\lambda_{\text{peak}} T \approx 2.898\times10^{-3} m·K.

Total flux: F=σT4F = \sigma T^4, Stefan-Boltzmann constant σ=5.67×108\sigma = 5.67\times10^{-8} W/(m²·K⁴).


Specific Heat of Solids

Model High T limit Low T limit
Dulong–Petit CV=3NkBC_V = 3 N k_B — (fails)
Einstein (single ωE\omega_E) 3NkB3Nk_B eωE/kBT\propto e^{-\hbar\omega_E/k_BT} (wrong shape)
Debye (acoustic continuum, cutoff ωD\omega_D) 3NkB3Nk_B T3\propto T^3

Debye T3T^3 law (low T):

CV12π45NkB(TΘD)3C_V \approx \frac{12\pi^4}{5} N k_B \left(\frac{T}{\Theta_D}\right)^3

with Debye temperature ΘD=ωD/kB\Theta_D = \hbar\omega_D/k_B, typically 100–500 K.



Statistical Thermodynamics


The Four Laws

Law Statement Formal
0th Transitive thermal equilibrium ⇒ temperature exists
1st dU=δQ+δWdU = \delta Q + \delta W (energy conservation) dU=TdSPdV+μdNdU = T dS - P dV + \mu dN
2nd dS0dS \ge 0 for isolated system; reversible iff equality δQTdS\delta Q \le T dS
3rd SS0S \to S_0 (often 0) as T0T \to 0 Nernst

Thermodynamic Potentials — Legendre Transforms

flowchart TD
    U["U(S,V,N)\nInternal Energy"] -->|−PV| H["H = U + PV\nEnthalpy\nH(S,P,N)"]
    U -->|−TS| F["F = U − TS\nHelmholtz\nF(T,V,N)"]
    F -->|−PV| G["G = F + PV\nGibbs\nG(T,P,N)"]
    F -->|−μN| O["Ω = F − μN\nGrand Potential\nΩ(T,V,μ)"]

Differential forms:

dU=TdSPdV+μdNdU = TdS - PdV + \mu dN dH=TdS+VdP+μdNdH = TdS + VdP + \mu dN dF=SdTPdV+μdNdF = -SdT - PdV + \mu dN dG=SdT+VdP+μdNdG = -SdT + VdP + \mu dN dΩ=SdTPdVNdμd\Omega = -SdT - PdV - Nd\mu

Natural variables determine which potential is minimized:

Constraints Minimized Used for
S,V,NS, V, N fixed UU Isolated mechanical
S,P,NS, P, N fixed HH Steady-flow processes, calorimetry
T,V,NT, V, N fixed FF Closed systems at fixed TT
T,P,NT, P, N fixed GG Chemical reactions, phase changes
T,V,μT, V, \mu fixed Ω\Omega Open systems, surfaces

Maxwell Relations

From equality of mixed partials of potentials (e.g., 2F/TV=2F/VT\partial^2 F/\partial T\partial V = \partial^2 F/\partial V\partial T):

(TV)S,N=(PS)V,N(from U)\left(\frac{\partial T}{\partial V}\right)_{S,N} = -\left(\frac{\partial P}{\partial S}\right)_{V,N} \quad (\text{from } U) (TP)S,N=+(VS)P,N(from H)\left(\frac{\partial T}{\partial P}\right)_{S,N} = +\left(\frac{\partial V}{\partial S}\right)_{P,N} \quad (\text{from } H) (SV)T,N=+(PT)V,N(from F)\left(\frac{\partial S}{\partial V}\right)_{T,N} = +\left(\frac{\partial P}{\partial T}\right)_{V,N} \quad (\text{from } F) (SP)T,N=(VT)P,N(from G)\left(\frac{\partial S}{\partial P}\right)_{T,N} = -\left(\frac{\partial V}{\partial T}\right)_{P,N} \quad (\text{from } G)

Mnemonic "thermodynamic square":

   V — F — T
   |       |
   U       G
   |       |
   S — H — P

Read each side: dU=TdSPdVdU = TdS - PdV etc. Maxwell relations follow from rotating the square.


Heat Capacities & Identities

CV=(UT)V,N,CP=(HT)P,NC_V = \left(\frac{\partial U}{\partial T}\right)_{V,N}, \qquad C_P = \left(\frac{\partial H}{\partial T}\right)_{P,N}

General relation (always true):

CPCV=TVα2κTC_P - C_V = T V \frac{\alpha^2}{\kappa_T}

with α=(1/V)(V/T)P\alpha = (1/V)(\partial V/\partial T)_P (thermal expansion), κT=(1/V)(V/P)T\kappa_T = -(1/V)(\partial V/\partial P)_T (isothermal compressibility).

For ideal gas: CPCV=NkBC_P - C_V = N k_B, γ=CP/CV\gamma = C_P/C_V.

Sound speed:

cs2=(Pρ)S=γ(Pρ)T=γPρc_s^2 = \left(\frac{\partial P}{\partial \rho}\right)_S = \gamma \left(\frac{\partial P}{\partial \rho}\right)_T = \frac{\gamma P}{\rho}


Chemical Potential — The "Energy Cost of Adding a Particle"

μ=(UN)S,V=(FN)T,V=(GN)T,P\mu = \left(\frac{\partial U}{\partial N}\right)_{S,V} = \left(\frac{\partial F}{\partial N}\right)_{T,V} = \left(\frac{\partial G}{\partial N}\right)_{T,P}

Ideal classical gas:

μ=kBTln(nλth3gs),λth=2π2mkBT\mu = k_B T \ln\!\left(\frac{n \lambda_{\text{th}}^3}{g_s}\right), \quad \lambda_{\text{th}} = \sqrt{\frac{2\pi\hbar^2}{m k_B T}}

λth\lambda_{\text{th}} is the thermal de Broglie wavelength. Classical limit valid when nλth31n\lambda_{\text{th}}^3 \ll 1.

Equilibrium conditions:

  • Two phases coexist: μ1=μ2\mu_1 = \mu_2 at fixed T,PT,P.
  • Reaction A+BCA + B \rightleftharpoons C: μA+μB=μC\mu_A + \mu_B = \mu_C.

Saha Equation (Ionization Equilibrium)

For AA++eA \rightleftharpoons A^+ + e^- with ionization energy χ\chi:

n+nen0=(mekBT2π2)3/22Z+(T)Z0(T)eχ/kBT\boxed{\frac{n_+ n_e}{n_0} = \left(\frac{m_e k_B T}{2\pi\hbar^2}\right)^{3/2} \frac{2 Z_+(T)}{Z_0(T)} e^{-\chi/k_B T}}

where Z+,Z0Z_+, Z_0 are internal partition functions.

Applications: stellar atmospheres, primordial recombination (z≈1100, CMB decoupling), HII regions, ionosphere.


Phase Transitions

First-order: discontinuity in first derivatives of GG (entropy, volume) → latent heat. Examples: water-ice, condensation.

Clausius-Clapeyron equation:

dPdT|coex=LTΔV\frac{dP}{dT}\bigg|_{\text{coex}} = \frac{L}{T\Delta V}

where L=TΔSL = T\Delta S is latent heat per particle.

Second-order (continuous): GG derivatives continuous, but second derivatives diverge. Examples: ferromagnet at TCT_C, superfluid λ\lambda-transition, critical point CO₂.

Critical exponents (universal, depend on dimension + symmetry, not on microscopic details):

Quantity Behavior Mean field 3-D Ising
Specific heat $C \sim t ^{-\alpha}$
Order parameter $m \sim t ^\beta$ (T<TcT<T_c)
Susceptibility $\chi \sim t ^{-\gamma}$
Field-magnet mH1/δm \sim H^{1/\delta} 33 4.79\approx 4.79

with t=(TTc)/Tct = (T - T_c)/T_c.


Fluctuations of Thermodynamic Variables

In the canonical ensemble:

(ΔE)2=kBT2CV\langle (\Delta E)^2\rangle = k_B T^2 C_V (ΔV)2=kBTVκT\langle (\Delta V)^2\rangle = k_B T V \kappa_T (ΔN)2=kBT(N/μ)T,V\langle (\Delta N)^2\rangle = k_B T (\partial N/\partial \mu)_{T,V}

Key insight: fluctuations scale as N\sqrt{N}, so relative fluctuations 1/N\sim 1/\sqrt{N} — explains why thermodynamics works (huge NN).

Connection to response functions: (ΔE)2/kBT2=CV\langle(\Delta E)^2\rangle / k_B T^2 = C_V — variance equals the response to a thermodynamic perturbation. This is the seed of the fluctuation-dissipation theorem.



Random Processes


Random Variables & Distributions

Random variable XX: maps outcomes to numbers.

Probability density p(x)p(x): Pr{x<X<x+dx}=p(x)dx\Pr\{x < X < x+dx\} = p(x)\,dx.

Moments: Xn=xnp(x)dx\langle X^n\rangle = \int x^n p(x)\, dx.

Cumulants: κ1=X\kappa_1 = \langle X\rangle, κ2=Var\kappa_2 = \text{Var}, $\kappa_3 = $ skewness × σ3\sigma^3, etc. Generated by lnM(t)=κntn/n!\ln M(t) = \sum \kappa_n t^n/n! with M(t)=etXM(t) = \langle e^{tX}\rangle.


Common Distributions

Distribution Density Mean Variance
Gaussian 12πσe(xμ)2/2σ2\frac{1}{\sqrt{2\pi}\sigma} e^{-(x-\mu)^2/2\sigma^2} μ\mu σ2\sigma^2
Poisson λkeλ/k!\lambda^k e^{-\lambda}/k! λ\lambda λ\lambda
Exponential λeλx\lambda e^{-\lambda x}, x>0x>0 1/λ1/\lambda 1/λ21/\lambda^2
Power-law xα\propto x^{-\alpha}, x>xminx>x_{\min} finite if α>2\alpha>2 finite if α>3\alpha>3
Lévy stable (no closed form) (heavy-tailed) \infty if α<2\alpha<2

Central Limit Theorem: sum of NN iid finite-variance RVs \to Gaussian as NN\to\infty, scaled as Nσ\sqrt{N}\sigma. Foundation of why Gaussians dominate.


Random Processes

A random process Y(t)Y(t) is a family of random variables indexed by tt. Realization (sample path): one outcome over time.

Ensemble average: $\langle Y(t)\rangle = $ average over realizations at fixed tt.

Time average: Y=limT1T0TY(t)dt\bar Y = \lim_{T\to\infty} \tfrac{1}{T}\int_0^T Y(t)\, dt.

Ergodic theorem: for stationary processes, ensemble average = time average.


Stationarity, Correlation, Spectral Density

Stationary: statistical properties invariant under time translation. Then:

Y(t)=μY=const,Y(t)Y(t)=CY(tt)\langle Y(t)\rangle = \mu_Y = \text{const}, \quad \langle Y(t)Y(t')\rangle = C_Y(t-t')

Autocorrelation function CY(τ)C_Y(\tau):

  • CY(0)=Y2C_Y(0) = \langle Y^2\rangle (mean square)
  • CY()=μY2C_Y(\infty) = \mu_Y^2 (uncorrelated)
  • Decay scale = correlation time τc\tau_c

Spectral density SY(f)S_Y(f) (one-sided, f0f\ge 0):

SY(f)=40CY(τ)cos(2πfτ)dτ(Wiener-Khinchin)\boxed{S_Y(f) = 4\int_0^\infty C_Y(\tau)\cos(2\pi f\tau)\, d\tau \quad \text{(Wiener-Khinchin)}}

Inverse: CY(τ)=0SY(f)cos(2πfτ)dfC_Y(\tau) = \int_0^\infty S_Y(f)\cos(2\pi f \tau)\, df.

Parseval / variance: Y2μY2=0SY(f)df\langle Y^2\rangle - \mu_Y^2 = \int_0^\infty S_Y(f)\, df.

Units: $[S_Y] = [Y]^2 / $ Hz.


Standard Noise Spectra

Noise type Spectrum SY(f)S_Y(f) Origin Where it shows up
White Constant S0S_0 Markov, τc0\tau_c\to 0 Thermal at high ff, idealization
1/f1/f ("pink", flicker") 1/f\propto 1/f Many superposed time scales Electronics, geophysics, biology
Brownian ("red") 1/f2\propto 1/f^2 Integrated white noise Position of Brownian particle
Shot noise S=2eIS = 2 e I (one-sided) Discrete uncorrelated events Current, photon counting
the practitioner-Nyquist SV=4kBTRS_V = 4 k_B T R (one-sided) Thermal fluctuations in resistor All circuits at T>0T>0
Photon shot Sn=2nS_n = 2\bar n (counts) Poisson arrivals Optical detection

Markov Processes & Chapman-Kolmogorov

Markov property: future depends only on present, not on history:

p(yn+1|yn,yn1,,y1)=p(yn+1|yn)p(y_{n+1} | y_n, y_{n-1}, \ldots, y_1) = p(y_{n+1} | y_n)

Chapman-Kolmogorov equation:

p(y3,t3|y1,t1)=dy2p(y3,t3|y2,t2)p(y2,t2|y1,t1)p(y_3, t_3 | y_1, t_1) = \int dy_2\, p(y_3, t_3 | y_2, t_2)\, p(y_2, t_2 | y_1, t_1)

Master equation (continuous-time Markov, discrete states):

dPndt=m[WnmPmWmnPn]\frac{dP_n}{dt} = \sum_m \left[W_{n\leftarrow m} P_m - W_{m\leftarrow n} P_n\right]

Detailed balance (in equilibrium): WnmPmeq=WmnPneqW_{n\leftarrow m} P_m^{eq} = W_{m\leftarrow n} P_n^{eq}.


Brownian Motion & Langevin Equation

Langevin equation (1-D):

mv̇=γv+F(t)m \dot v = -\gamma v + F(t)

where F(t)F(t) is white-noise force with:

  • F(t)=0\langle F(t)\rangle = 0
  • F(t)F(t)=2DFδ(tt)\langle F(t) F(t')\rangle = 2 D_F \delta(t-t')

Solution moments (relaxation):

v(t)2=v02e2t/τv+DFmγ(1e2t/τv),τv=m/γ\langle v(t)^2\rangle = v_0^2 e^{-2t/\tau_v} + \frac{D_F}{m\gamma}(1 - e^{-2t/\tau_v}), \quad \tau_v = m/\gamma

Equipartition at long times: v2kBT/m\langle v^2\rangle \to k_B T/m. Matching:

DF=γkBT(Einstein/FDT)\boxed{D_F = \gamma k_B T \quad \text{(Einstein/FDT)}}

Position diffusion (long-time):

(Δx)2=2Dt,D=kBTγ=μkBT(Einstein relation)\langle (\Delta x)^2\rangle = 2 D t, \qquad D = \frac{k_B T}{\gamma} = \mu k_B T \quad \text{(Einstein relation)}

with mobility μ=1/γ\mu = 1/\gamma. For Stokes drag on sphere of radius aa in fluid of viscosity η\eta:

γ=6πηaD=kBT6πηa\gamma = 6\pi \eta a \;\Rightarrow\; D = \frac{k_B T}{6\pi\eta a}


Fluctuation-Dissipation Theorem (FDT)

The unifying theorem of stat. physics:

For a system in equilibrium at TT, the dissipation (imaginary part of response) is determined by the fluctuations (correlation/spectrum) of the conjugate variable:

SX(f)=4kBTωχ(ω),ω=2πf\boxed{S_X(f) = \frac{4 k_B T}{\omega} \chi''(\omega), \quad \omega = 2\pi f}

with χ(ω)=χ(ω)+iχ(ω)\chi(\omega) = \chi'(\omega) + i\chi''(\omega) the linear response function: X̂(ω)=χ(ω)F̂(ω)\hat X(\omega) = \chi(\omega)\hat F(\omega).

Concrete realizations:

System Fluctuation Dissipation FDT statement
Resistor Voltage noise SVS_V Resistance RR SV=4kBTRS_V = 4 k_B T R (Nyquist)
Brownian particle Velocity correlation Drag γ\gamma v2=kBT/m\langle v^2\rangle = k_B T/m, D=kBT/γD = k_B T/\gamma
Capacitor Charge noise Capacitance CC (ΔQ)2=kBTC\langle (\Delta Q)^2\rangle = k_BT C
Magnetic susceptibility Spin fluctuations χ\chi'' SMTχ/ωS_M \propto T\chi''/\omega
Pendulum (LIGO) Position noise Mechanical losses Test-mass thermal noise

Fokker-Planck Equation

When jumps are small + Markov → continuous-state evolution governed by:

pt=x[A(x)p]+12x2[B(x)p]\boxed{\frac{\partial p}{\partial t} = -\partial_x\!\left[A(x) p\right] + \tfrac{1}{2}\partial_x^2\!\left[B(x) p\right]}

with drift A(x)=Δx/ΔtA(x) = \langle \Delta x\rangle/\Delta t and diffusion B(x)=(Δx)2/ΔtB(x) = \langle(\Delta x)^2\rangle/\Delta t (from Kramers-Moyal expansion).

Special case — Brownian motion in velocity (Ornstein-Uhlenbeck):

p(v,t)t=γmv(vp)+kBTγm2v2p\frac{\partial p(v,t)}{\partial t} = \frac{\gamma}{m}\partial_v(v p) + \frac{k_B T \gamma}{m^2}\partial_v^2 p

Stationary solution: Maxwellian peq(v)emv2/(2kBT)p_{\text{eq}}(v) \propto e^{-mv^2/(2 k_B T)}.

Special case — diffusion (zero drift, constant B=2DB = 2D):

tp=Dx2pp(x,t)=14πDtex2/(4Dt)\partial_t p = D\partial_x^2 p \quad\Rightarrow\quad p(x,t) = \frac{1}{\sqrt{4\pi Dt}} e^{-x^2/(4Dt)}

x2=2Dt\langle x^2\rangle = 2 D t.

Boltzmann form (general): equilibrium peq(x)eU(x)/kBTp_{\text{eq}}(x) \propto e^{-U(x)/k_BT} where UU is a potential. The FP equation can be cast as

tp=x[DeβUx(eβUp)]\partial_t p = \partial_x \left[D\,e^{-\beta U}\partial_x(e^{\beta U} p)\right]

making detailed balance manifest.


Kramers' Escape Rate (a key application of FP)

Particle in potential well, escape over barrier of height ΔU\Delta U:

rescape=ωaωb2πγeΔU/kBT(high friction)r_{\text{escape}} = \frac{\omega_a \omega_b}{2\pi\gamma} e^{-\Delta U / k_B T} \quad \text{(high friction)}

with ωa\omega_a = well frequency, ωb\omega_b = barrier curvature. Arrhenius form — exponential temperature dependence governs chemical reaction rates, vacancy diffusion, nucleation, etc.


Shot Noise

For Poisson process with rate λ\lambda: counts in window TT have N=λT\langle N\rangle = \lambda T, (ΔN)2=λT\langle(\Delta N)^2\rangle = \lambda T.

Current I=eλI = e\lambda, two-sided spectrum SI=eIS_I = e I, one-sided SI=2eIS_I = 2 e I (Schottky formula).

Comparison with thermal: thermal noise T\propto T (vanishes at T=0T=0); shot noise I\propto I (survives at T=0T=0). Crossover at eVkBTeV \sim k_BT.



Workflow / Process — How to attack a stat-phys problem

flowchart TD
    A["What is the question?"] --> B["Equilibrium or non-equilibrium?"]
    B -->|Equilibrium| C["Which constraints?"]
    B -->|Non-equilibrium| D["Kinetic / random process"]

    C -->|"E, V, N fixed"| E["Microcanonical:\nS = k ln W"]
    C -->|"T, V, N fixed"| F["Canonical:\nF = -kT ln Z"]
    C -->|"T, V, μ fixed"| G["Grand canonical:\nΩ = -kT ln Ξ"]

    D --> H["Closed-form distribution f?"]
    H -->|Yes| I["Boltzmann equation"]
    H -->|No| J["Markov?"]

    J -->|"Yes, small jumps"| K["Fokker–Planck"]
    J -->|"Yes, discrete"| L["Master equation"]
    J -->|"Linear w/ noise"| M["Langevin → FDT"]

    E --> N["Compute g(E), derive thermo"]
    F --> N
    G --> N

    I --> O["Transport coefficients"]
    K --> O
    L --> O
    M --> O


Comparison Tables


Quantum Statistics

Maxwell-Boltzmann Bose-Einstein Fermi-Dirac
Particles classical identical bosons identical fermions
Spin integer half-integer
Occupation η\eta e(Eμ)/kBTe^{-(E-\mu)/k_BT} 1/(e(Eμ)/kBT1)1/(e^{(E-\mu)/k_BT}-1) 1/(e(Eμ)/kBT+1)1/(e^{(E-\mu)/k_BT}+1)
Max per state 1
Limit T0T\to 0 η0\eta \to 0 for E>μE>\mu macroscopic in ground state step function Θ(EFE)\Theta(E_F-E)
EOS, ultra-rel P=u/3P=u/3 P=u/3P=u/3 P=u/3P=u/3
Examples dilute gases photons, ⁴He, gluons electrons, ³He, neutrons, neutrinos

Ensemble Comparison

Ensemble Variables Probability Potential Use case
Microcanonical E,V,NE,V,N 1/W1/W SS Isolated systems
Canonical T,V,NT,V,N eβE/Ze^{-\beta E}/Z FF Closed, fixed temp
Grand canonical T,V,μT,V,\mu eβ(EμN)/Ξe^{-\beta(E-\mu N)}/\Xi Ω=PV\Omega = -PV Open systems
Isothermal-isobaric T,P,NT,P,N eβ(E+PV)/ZPe^{-\beta(E+PV)}/Z_P GG Chemistry, biology

Noise & Their Origins

Noise S(f)S(f) Where Mitigation
Thermal (the practitioner-Nyquist) 4kBTR4 k_B T R All resistors, T>0T>0 Cool device
Shot 2eI2 e I Discrete carriers in current Increase II (relative drops)
1/f1/f 1/f\propto 1/f Slow processes, traps Modulate / chop signal
Quantum (zero-point) ω/2\hbar\omega/2 + thermal Linear amplifiers Squeezed states
Photon shot N/N\sqrt{N}/N Optical detection More photons

Adiabatic Indices

System γ\gamma P(ρ)P(\rho) behavior
Monatomic ideal gas 5/35/3 Pρ5/3P\propto\rho^{5/3} adiabatically
Diatomic, T300T\sim 300K 7/57/5 Pρ7/5P\propto\rho^{7/5}
Diatomic + vibration 9/79/7 Pρ9/7P\propto\rho^{9/7}
Photon gas 4/34/3 Pρ4/3P\propto\rho^{4/3}, isothermal-like
Non-rel degenerate e⁻ 5/35/3 Pρ5/3P\propto\rho^{5/3} (white dwarfs)
Ultra-rel degenerate e⁻ 4/34/3 Pρ4/3P\propto\rho^{4/3} (Chandrasekhar limit)


Common Mistakes

  • Conflating microcanonical and canonical. They give same thermodynamics in thermodynamic limit, but very different fluctuations (microcanonical: ΔE=0\Delta E=0; canonical: ΔE=kBT2CV\Delta E = \sqrt{k_BT^2 C_V}).
  • Using classical statistics when nλth31n\lambda_{\text{th}}^3 \gtrsim 1. Must use B-E or F-D. Common in electrons in metals, photons, ultra-cold atoms, neutron star matter.
  • Forgetting spin degeneracy gsg_s. Electrons: gs=2g_s = 2. Photons: gs=2g_s = 2 (transverse polarizations only).
  • Confusing mean and most-probable speeds. Maxwell distribution: vvpvrms\bar v \ne v_p \ne v_{rms}. Use the right one for the right physical quantity.
  • Applying ideal-gas thermodynamics to interacting/degenerate systems. Virial corrections, exchange, screening all matter.
  • Ignoring μ0\mu \ne 0 for bosons. Only photons have μ=0\mu = 0. Atomic bosons have μ<0\mu < 0 approaching zero at BEC.
  • Treating heat as a state variable. δQ\delta Q is inexact (depends on path); SS, UU are state functions.
  • Confusing reversible and quasi-static. Quasi-static needn't be reversible (e.g., slow Joule expansion).
  • Wrong sign on chemical potential. μ\mu for ideal gas at standard conditions is negative (large positive ln(nλ3/gs)\ln(n\lambda^3/g_s) argument is < 1).
  • Time-averaging non-stationary process. Wiener-Khinchin and FDT require stationarity. For non-stationary, use windowed analysis or two-time correlations.
  • Forgetting factor of 2 (one-sided vs two-sided spectra). Stwo-sided(f)=Stwo-sided(f)S_{\text{two-sided}}(-f) = S_{\text{two-sided}}(f), so Sone-sided=2Stwo-sidedS_{\text{one-sided}} = 2 S_{\text{two-sided}} for f>0f>0.
  • Misapplying central limit theorem. Fails for heavy-tailed (Lévy) distributions and for strongly correlated variables.
  • Confusing Fokker-Planck and Boltzmann. FP: small jumps (continuous), Boltzmann: arbitrary collisions (kernel).
  • Using mean-field exponents in 2-D or 3-D Ising. Mean-field is exact only above upper critical dimension (dc=4d_c = 4 for Ising-like).

Engineering use and verification

State the model, coordinate system, assumptions, boundary conditions and validity range before using an equation. Track dimensions and sign conventions through each derivation, test limiting cases, and distinguish mathematical possibility from physical realisability. Where a model informs engineering design, compare it with measurement or a second method and quantify the effect of idealisations rather than hiding them inside numerical precision.

  • Confirm scope, assumptions, interfaces and required outcome.
  • Check dimensions, sign conventions, boundary conditions and limiting cases.
  • Identify current project, customer and regulatory requirements.
  • Separate source examples from mandatory acceptance criteria.
  • Check calculations, tables and selections by an independent method.
  • Verify safety, maintainability and credible failure modes.
  • Record evidence, revisions, approvals and unresolved limitations.
  • Validate the result under representative operating conditions.

Continue learning

Classical Physics Foundations: Geometry, Tensors and DynamicsGuide · PhysicsNEXT LESSON →Statistical Physics and Kinetic Theory: Expert InsightsGuide · PhysicsGeometric and Wave Optics: /20 SummaryGuide · PhysicsGeometric and Wave Optics: Final TakeawaysGuide · Physics