A Methodological Shift in Monte Carlo Simulations

This is a Method paper that introduces a novel computational technique for Monte Carlo simulations. It presents Umbrella Sampling, an importance sampling approach that uses non-physical distributions to calculate free energy differences in molecular systems.

The Sampling Gap in Phase Transitions

The paper addresses the failure of conventional Boltzmann-weighted Monte Carlo to estimate free energy differences.

  • The Problem: Free energy depends on the integral of configurations that are rare in the reference system. In a standard simulation, the relevant probability density $f_0(\Delta U^*)$ is often too small (e.g., $< 10^{-8}$) to be sampled.
  • Phase Transitions: Conventional “thermodynamic integration” fails near phase transitions because it requires a path of integration where ensemble averages can be reliably measured, which is difficult in unstable regions.

Bridging States with Non-Physical Distributions

The authors introduce a non-physical distribution $\pi(q^N)$ to bridge the gap between a reference system (0) and a system of interest (1).

  • Arbitrary Weights: They sample from a distribution weighted by $w(q^N)$. In statistical mechanics terms, applying this weight is equivalent to introducing a biasing potential $V_w(q^N)$ to the original potential energy $U(q^N)$, such that $w(q^N) = \exp(-\beta V_w(q^N))$.
  • Reweighting Formula: The unbiased average of any property $\theta$ is recovered via the ratio of biased averages:

$$\langle\theta\rangle_{0}=\frac{\langle\theta/w\rangle_{w}}{\langle1/w\rangle_{w}}$$

  • Overlap: The method allows sampling a range of energy differences up to three times wider than conventional Monte Carlo. If a single weight function cannot span the entire gap, “multistage” (overlapping) umbrella sampling is used.

Validation on Lennard-Jones Fluids

The authors validated Umbrella Sampling using Monte Carlo simulations of model fluids.

Experimental Setup

  • System Specifications: The study used a Lennard-Jones (LJ) fluid and an inverse-12 “soft-sphere” fluid.
  • System Size: Simulations were primarily performed with $N=32$ particles, with some validation runs at $N=108$ particles to check for size dependence.
  • State Points: Calculations covered a wide range of densities ($N\sigma^3/V = 0.50$ to $0.85$) and temperatures ($kT/\epsilon = 0.7$ to $2.8$), including the gas-liquid coexistence region.

Baselines

  • Baselines: Results were compared to thermodynamic integration data from Hansen, Levesque, and Verlet.
  • Quantitative Success:
    • Agreement: The free energy estimates agreed with pressure integration results to within statistical uncertainties (e.g., at $kT/\epsilon=1.35$, Umbrella Sampling gave -3.236 vs. Conventional -3.25).
    • Precision: Free energy differences were obtained with high precision ($\pm 0.005 NkT$ for $N=108$).
    • Efficiency: A single umbrella run could replace the “numerous runs” required for conventional $1/T$ integrations.

Mapping the Liquid-Gas Free Energy Surface

  • Methodological Utility: The method successfully mapped the free energy of the LJ fluid across the liquid-gas transition, a region where conventional methods face convergence problems.
  • N-Dependence: Comparison between $N=32$ and $N=108$ showed no statistically significant size dependence for free energy differences, suggesting small systems are sufficient for these estimates.
  • Generality: While demonstrated on energy ($U$), the authors note the weighting function $w$ can be any function of the coordinates, generalizing the technique beyond simple free energy differences.

Reproducibility Details

Algorithms

To replicate this work, one must construct the weighting function $W$.

  • Constructing $W$: The paper does not derive $W$ analytically. It uses a trial-and-error procedure.
    • Start with a short Boltzmann-weighted experiment.
    • Broaden the distribution in stages through short test runs, adjusting weights to flatten the probability density $f_w(\Delta U^*)$.
  • Specific Weights: Table I provides the exact numerical weights used for the 32-particle soft-sphere experiment, ranging from $W=1,500,000$ to $W=1.0$.
  • Block Averaging: Errors were estimated by treating sequences of $m$ steps as independent samples, where $m$ is determined by increasing block size until systematic trends in the variance disappear.

Paper Information

Citation: Torrie, G. M., & Valleau, J. P. (1977). Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling. Journal of Computational Physics, 23(2), 187-199. https://doi.org/10.1016/0021-9991(77)90121-8

Publication: Journal of Computational Physics, 1977

@article{torrie1977nonphysical,
  title={Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling},
  author={Torrie, Glenn M and Valleau, John P},
  journal={Journal of Computational Physics},
  volume={23},
  number={2},
  pages={187--199},
  year={1977},
  publisher={Elsevier},
  doi={10.1016/0021-9991(77)90121-8}
}