A concise guide to ensembles, entropy, canonical and grand-canonical methods, quantum statistics, gases, interactions, phase transitions, and fluctuations.
Statistical mechanics explains thermodynamics from microscopic states. Entropy counts compatible microstates, equilibrium is overwhelmingly probable, and macroscopic laws emerge from averages over many degrees of freedom. Temperature and chemical potential are derivatives of entropy.
For review, be able to derive thermodynamic variables from entropy, distinguish microstate and macrostate, and explain why equilibrium is statistical. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Consider a paramagnet of N=4 distinguishable spins-1/2 in a magnetic field B=1T. Each spin has magnetic moment μ (Bohr magneton, μ≈9.27×10−24J/T). The up state has energy −μB and the down state +μB. Take the macrostate with total energy E=−2μB, which requires three spins up and one down.
Counting microstates: The number of ways to choose which spin is down is
Ω=(14)=4.
Entropy: Using S=kBlnΩ,
S=kBln4≈1.386kB≈1.91×10−23J/K.
Temperature: If the energy is raised to E=0 (two up, two down), Ω′=(24)=6 and S′=kBln6. For the small energy step ΔE=2μB≈1.85×10−23J,
Microstate counting for an Einstein solid. Problem: An Einstein solid consists of N=3 oscillators, each with energy spacing ℏω. How many microstates correspond to total energy E=2ℏω? Solution. This is the number of ways to distribute q=2 indistinguishable energy quanta among N=3 oscillators:
Ω=(qq+N−1)=(24)=6.
Entropy and temperature from counting. Problem: A system has Ω(E)=CE3N/2 with N=2 and C a constant. Find S(E) and T(E). Solution.S=kBln(CE3)=kBlnC+3kBlnE. Then
T1=(∂E∂S)V,N=E3kB⇒E=3kBT.
This is the equipartition result for N=2 structureless particles in 3D.
Chemical potential estimate. Problem: For a monatomic ideal gas, Ω(N,E,V)∝VNE3N/2/N!. Use Stirling’s approximation to estimate μ/T for large N. Solution. With lnN!≈NlnN−N,
S≈NkBln(NV)+23NkBlnE+const.
Keeping E fixed,
Tμ=−(∂N∂S)E,V≈−kBln(NVλT−3),
which is the familiar Sackur—Tetrode form.
Section summary.
Thermodynamics is the large-number limit of microscopic statistics.
An ensemble is a probability distribution over microstates representing given macroscopic information. Microcanonical, canonical, and grand canonical ensembles differ by what is held fixed and what can be exchanged with a reservoir.
For review, be able to choose the right ensemble, compute averages, relate fluctuations to response, and understand equivalence of ensembles in the thermodynamic limit. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Consider a 3-state system with energies E1=0, E2=ε, and E3=2ε, where ε=0.1eV. In the canonical ensemble at T=300K (kBT≈0.02585eV), the partition function is
Z=s=1∑3e−βEs=1+e−βε+e−2βε.
With βε≈3.87, we have e−3.87≈0.0209 and e−7.74≈4.36×10−4, giving
Z≈1.0213.
The probabilities are p1≈0.979, p2≈0.0205, p3≈4.3×10−4. The average energy is
Two-level system energy and heat capacity. Problem: A system has states with energies 0 and ε. Find ⟨E⟩ and the heat capacity C=∂⟨E⟩/∂T. Solution.Z=1+e−βε. Then
Evaluating the logarithms gives S≈0.104kB≈1.4×10−24J/K.
Energy fluctuations and response. Problem: Show that ⟨(ΔE)2⟩=−∂β⟨E⟩ and explain why this implies ⟨(ΔE)2⟩=kBT2CV. Solution. Start from ⟨E⟩=−∂βlnZ. Then
−∂β⟨E⟩=∂β2lnZ=Z∂β2Z−(Z∂βZ)2=⟨E2⟩−⟨E⟩2.
Since ∂β=−kBT2∂T, we have −∂β⟨E⟩=kBT2(∂⟨E⟩/∂T)V=kBT2CV.
Section summary.
Ensembles turn incomplete microscopic information into predictions.
The canonical ensemble describes systems exchanging energy with a heat bath at fixed temperature. The partition function normalizes probabilities and generates energy, entropy, heat capacity, and free energy.
For review, be able to compute Z, derive F, U, S, and heat capacity, and use factorization for independent degrees of freedom. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
A quantum harmonic oscillator of frequency ω=2π×1013s−1 (ℏω≈0.0414eV) is in thermal equilibrium at T=300K (kBT≈0.02585eV). Its canonical partition function is
Classical limit of oscillator heat capacity. Problem: Show that for kBT≫ℏω, the quantum oscillator heat capacity reduces to the classical equipartition value kB. Solution. Let x=βℏω≪1. Then ex−1≈x+x2/2, so
C≈kBx2x2(1+x/2)21+x≈kB.
N independent spins. Problem:N non-interacting spin-1/2 particles in a field B have energies ±μB. Find the total partition function ZN and the free energy F. Solution. The single-spin partition function is Z1=eβμB+e−βμB=2cosh(βμB). Since the spins are independent,
ZN=[2cosh(βμB)]N,F=−NkBTln[2cosh(βμB)].
Paramagnetic susceptibility. Problem: From the free energy of the N-spin system, derive the magnetization M=−∂F/∂B and the zero-field susceptibility χ=∂M/∂B∣B=0. Solution.M=Nμtanh(βμB). For small B, tanhx≈x, so
M≈kBTNμ2B,χ=kBTNμ2,
which is Curie’s law.
Section summary.
The canonical partition function is the engine of fixed-temperature statistical mechanics.
The grand canonical ensemble allows both energy and particles to fluctuate. It is natural for gases, quantum many-particle systems, adsorption, and reactions. The grand potential controls pressure and particle number.
For review, be able to compute Z, obtain ⟨N⟩, relate Ω to pressure, and use fugacity. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Consider a single lattice site that can be either empty (energy 0, particle number 0) or occupied by one particle (energy −ε, particle number 1). The site is in contact with a reservoir at T=500K and chemical potential μ=0.1eV, with binding energy ε=0.3eV.
The grand partition function is
Z=N=0,1∑e−β(EN−μN)=1+eβ(μ+ε).
Here β(μ+ε)=0.4eV/(8.617×10−5eV/K×500K)≈9.28.
Thus e9.28≈1.07×104 and
Ideal gas in the grand canonical ensemble. Problem: For an ideal gas, show that Z=exp(zV/λT3) where z=eβμ is the fugacity and λT the thermal wavelength. Solution. The canonical partition function for N indistinguishable particles is ZN=z1N/N! with z1=V/λT3. Summing over N,
Z=N=0∑∞N!(zz1)N=ezz1=exp(λT3zV).
Particle number and pressure. Problem: From the ideal-gas grand potential Ω=−kBTlnZ=−kBTzV/λT3, derive ⟨N⟩ and the equation of state. Solution. Using ⟨N⟩=kBT∂μlnZ=z∂zlnZ,
⟨N⟩=λT3zV.
Since Ω=−PV, we have PV=kBTzV/λT3=⟨N⟩kBT, the ideal gas law.
Lattice-gas variance. Problem: For the single-site example above, calculate the variance ⟨(ΔN)2⟩ and show it satisfies the fluctuation-response relation. Solution. For a two-state system, N2=N, so ⟨N2⟩=⟨N⟩. Thus
⟨(ΔN)2⟩=⟨N⟩(1−⟨N⟩).
Using ⟨N⟩=Z−1eβ(μ+ε), we find ∂⟨N⟩/∂μ=β⟨N⟩(1−⟨N⟩). The fluctuation-response relation ⟨(ΔN)2⟩=kBT(∂⟨N⟩/∂μ)T,V is therefore satisfied.
Section summary.
Grand canonical methods handle particle exchange cleanly.
Quantum statistics accounts for indistinguishable particles. Bosons occupy symmetric states and can pile up; fermions occupy antisymmetric states and obey Pauli exclusion. Occupation-number language replaces classical labeling of particles.
For review, be able to derive Bose-Einstein and Fermi-Dirac distributions, use density of states, and identify classical limits. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Consider a photon mode of angular frequency ω=3.0×1015s−1 (ℏω≈1.98eV) in a blackbody cavity at T=5000K (kBT≈0.431eV). Photons are bosons with μ=0. The average occupation number is
Classical limit. Problem: Show that when nˉ≪1, both the Bose—Einstein and Fermi—Dirac distributions reduce to the Maxwell—Boltzmann form nˉ≈e−β(ϵ−μ). Solution. If eβ(ϵ−μ)≫1, the ∓1 in the denominator is negligible:
Degenerate Fermi gas at T=0. Problem: At T=0, all states with ϵ<μ are occupied and all with ϵ>μ are empty. Show that the total number of electrons in volume V with spin degeneracy g=2 is N=gV(2mμ)3/2/(6π2ℏ3). Solution. Integrate the zero-temperature distribution:
Bose—Einstein condensation condition. Problem: For a 3D gas of bosons with fixed N, write the condition that the excited-state population equals N at T=Tc. Solution. Using the density of states g(ϵ)∝ϵ1/2,
Simple gases show how partition functions become equations of state. The ideal gas follows from translational states; corrections come from interactions, internal modes, and quantum degeneracy. Equipartition works only for quadratic classical modes.
For review, be able to derive ideal gas law, thermal wavelength, Sackur-Tetrode entropy, and limits of equipartition. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Calculate the Sackur—Tetrode entropy of 1mol of neon gas at standard temperature and pressure (T=273.15K, P=1atm=1.013×105Pa). The mass of a neon atom is m≈20.18u=3.35×10−26kg.
Thermal wavelength of an electron. Problem: Calculate the thermal de Broglie wavelength for a free electron at T=300K. Solution. Using me=9.11×10−31kg,
Quantum—classical crossover. Problem: The classical ideal-gas partition function ZN=(V/λT3)N/N! is valid when nλT3≪1. Evaluate this quantity for helium gas at T=5K and P=105Pa. Solution. Number density n=P/(kBT)≈105/(1.38×10−23×5)≈1.45×1027m−3.
For 4He, m≈6.64×10−27kg:
Ideal bosons can macroscopically occupy the ground state, producing Bose-Einstein condensation. Photons and phonons are bosonic gases with variable particle number and zero chemical potential in equilibrium.
For review, be able to compute critical temperature qualitatively, distinguish condensate and thermal cloud, and use Planck distribution. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Bose—Einstein condensation of 87Rb atoms. Consider N=104 atoms in a 3D harmonic trap with geometric mean frequency ωˉ=2π×104s−1. The atomic mass is m=1.44×10−25kg.
For a trapped gas, the critical temperature is
kBTc=ℏωˉ(ζ(3)N)1/3,ζ(3)≈1.202.
With ℏωˉ≈6.63×10−30J≈kB×0.48μK, and (104/1.202)1/3≈20.3, we obtain
Tc≈0.48μK×20.3≈9.7μK≈10μK.
At T=0.5Tc, the condensate fraction is
NN0=1−(TcT)3=1−(0.5)3=0.875.
So about 87.5% of the atoms are in the condensate.
Critical temperature in a box. Problem: Show that for a uniform 3D gas of bosons, Tc=mkB2πℏ2(ζ(3/2)n)2/3. Solution. The number of particles in excited states is Nex=VλT−3g3/2(z). At Tc, z→1 and Nex=N. Using g3/2(1)=ζ(3/2) and λT=h/2πmkBT, solving for Tc gives the result.
Photon gas energy density. Problem: Use the Planck distribution to write the energy density u(ω) of blackbody radiation at temperature T. Solution. With two polarization states, the density of photon states is g(ω)dω=Vω2/(π2c3)dω. Thus
u(ω)=π2c3ℏω3eβℏω−11.
Condensate fraction in a trap. Problem: For the trapped gas example, what fraction of atoms remains in the thermal cloud at T=0.8Tc? Solution. For a harmonic trap, Nex/N=(T/Tc)3. At T/Tc=0.8,
NNex=(0.8)3=0.512.
Thus 51.2% are still thermally distributed and 48.8% are in the condensate.
Section summary.
Bosons reveal collective occupation of single quantum states.
Fermions fill states up to the Fermi energy at low temperature. Degeneracy pressure, heat capacity linear in T, and Fermi surfaces explain electrons in metals, white dwarfs, and many quantum fluids.
For review, be able to compute Fermi energy, use density of states near the Fermi surface, and explain Pauli pressure. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Low-temperature heat capacity. Problem: Show that for a degenerate 3D Fermi gas, the electronic heat capacity is CV=2π2NkBTFT for T≪TF. Solution. At low T, only electrons within ∼kBT of EF are thermally excited. The Sommerfeld expansion gives
U≈U0+4π2NkBTFT2,
so CV=∂U/∂T=2π2NkB(T/TF).
White-dwarf estimate. Problem: A white dwarf has N∼1057 electrons and radius R∼107m. Estimate the electron degeneracy pressure. Solution. Number density n∼3N/(4πR3)∼2.4×1035m−3.
For non-relativistic electrons,
EF∼2meℏ2(3π2n)2/3∼3×10−14J∼0.2MeV,
so relativistic corrections are significant. The pressure is of order 1022Pa, balancing gravitational collapse.
Section summary.
Fermi systems are controlled by states near the Fermi surface.
Interactions correct ideal-gas behavior. Virial and cluster expansions organize dilute-gas corrections by density. Effective pseudopotentials replace complicated short-range interactions with low-energy scattering parameters.
For review, be able to interpret virial coefficients, know when dilute expansions work, and connect scattering length to effective interactions. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
The second virial coefficient for a gas of hard spheres of diameter σ is derived from the Mayer f-function. For hard spheres, the pair potential is u(r)=∞ for r<σ and 0 for r>σ. Then
B2(T)=−21∫d3rf(r)=−21∫0σ4πr2(−1)dr=32πσ3.
For argon-like atoms with effective hard-sphere diameter σ≈3.4A˚=3.4×10−10m,
B2=32π(3.4×10−10)3≈8.2×10−29m3.
At T=300K and number density n=2.5×1025m−3 (roughly 1 atm), the first correction to pressure is
PidealΔP=B2n≈(8.2×10−29)(2.5×1025)≈2.1×10−3.
So the hard-core correction is only about 0.2% at STP.
Square-well potential. Problem: A potential has u(r)=∞ for r<σ, u(r)=−ε for σ<r<λσ, and u(r)=0 for r>λσ. Find B2(T). Solution.
B2(T)=32πσ3[1−(λ3−1)(eβε−1)].
The first term is the hard-sphere repulsion; the second is the attractive contribution.
Pseudopotential strength. Problem: For 4He atoms with scattering length as≈7.5nm and mass m≈6.64×10−27kg, compute the effective interaction strength g=4πℏ2as/m. Solution.
Validity of virial expansion. Problem: Using the hard-sphere B2 above, estimate the density at which the second-order term B2n is 10% of the ideal pressure. Solution. Set B2n=0.1. Then
n10%=B20.1=8.2×10−290.1≈1.2×1027m−3.
This corresponds to roughly P≈nkBT∼5×107Pa∼500atm for argon at room temperature.
Section summary.
Interaction effects can be organized systematically at low density.
Phase transitions occur when free energies become nonanalytic in the thermodynamic limit. First-order transitions have latent heat; continuous transitions have diverging correlation length and universal critical exponents.
For review, be able to use order parameters, Landau free energy, susceptibility, correlation length, and scaling ideas. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
Critical exponent β. Problem: From the Landau result m∼(Tc−T)1/2, identify the critical exponent β and explain how mean-field theory gets it. Solution. By definition m∼∣T−Tc∣β, so β=1/2. Mean-field theory neglects fluctuations and assumes the free energy can be expanded analytically in m, which yields the square-root law. In reality, fluctuations change β (e.g., Ising 3D: β≈0.326).
Susceptibility divergence. Problem: Calculate the susceptibility exponent γ in Landau theory for T>Tc and T<Tc. Solution. For T>Tc, χ=[2a(T−Tc)]−1∼∣T−Tc∣−1, so γ=1. For T<Tc, at the minimum m2=a(Tc−T)/(2b), the curvature is
so χ=[4a(Tc−T)]−1∼∣T−Tc∣−1. Thus γ=1 on both sides in mean field.
First-order transition with cubic term. Problem: If F[m]=F0+α(T−Tc)m2−cm3+bm4 with α,b,c>0, show the transition becomes first order. Solution. The equation ∂F/∂m=2α(T−Tc)m−3cm2+4bm3=0 has solutions m=0 and
2α(T−Tc)−3cm+4bm2=0.
At a temperature T∗>Tc, the nonzero minimum appears with F[m∗]=F[0], indicating a discontinuous jump in m. A latent heat is associated with this first-order transition.
Section summary.
Critical behavior is governed by symmetry, dimension, and fluctuations.
Fluctuations are not noise to ignore; they determine response and reveal microscopic physics. Variances of energy, particle number, and order parameters connect to heat capacity, compressibility, and susceptibility.
For review, be able to derive fluctuation-response relations, estimate relative fluctuations, and explain why fluctuations grow near criticality. Keep the physical question visible: identify the degrees of freedom, the conserved quantities, the approximation being made, and the observable that would be measured.
**1/\sqrt{N** scaling.} Problem: Show that the relative energy fluctuation in the canonical ensemble scales as 1/N for an extensive system. Solution. Both U and CV are extensive, scaling as N. Thus
UΔErms=UkBT2CV∼NN=N1.
Particle-number fluctuations in a gas. Problem: For an ideal gas in the grand canonical ensemble, calculate the variance ⟨(ΔN)2⟩ in a volume V=1cm3 at STP. Solution. For an ideal gas, ⟨(ΔN)2⟩=⟨N⟩. At STP, n=P/(kBT)≈2.69×1025m−3. In V=10−6m3,
⟨N⟩≈2.69×1019,ΔNrms=⟨N⟩≈5.2×109.
The relative fluctuation is ΔNrms/⟨N⟩≈1/⟨N⟩≈1.9×10−10.
Critical fluctuations. Problem: Near a critical point the correlation length diverges as ξ∼∣T−Tc∣−ν and the susceptibility as χ∼∣T−Tc∣−γ. Use the fluctuation-dissipation relation χ∼ξ2−η to relate the critical exponents. Solution. Substituting the scaling forms,
∣T−Tc∣−γ∼(∣T−Tc∣−ν)2−η=∣T−Tc∣−ν(2−η).
Equating exponents gives the scaling law
γ=ν(2−η).
In mean field, ν=1/2 and η=0, so γ=1, consistent with Landau theory.
Section summary.
Fluctuations quantify stability and response.