This is a Method paper. Zhou and colleagues extend the MB-nrg (many-body energy) formalism to covalently bonded biomolecules and build the first coupled-cluster-accurate potential energy function (PEF) for polyalanine in the gas phase. The contribution has three parts: a generalization of the MB-nrg decomposition from whole-molecule 1-mers to functional-group “natural building blocks,” a DLPNO-CCSD(T)/aug-cc-pVTZ training protocol driven by parallel-bias metadynamics sampling, and a demonstration that the resulting PEF reproduces alanine dipeptide energetics and AceAla$_9$Nme secondary-structure dynamics more faithfully than the Amber ff14SB and ff19SB force fields.

Why Empirical Force Fields Fall Short for Protein Dynamics

Protein dynamics span femtosecond vibrations to millisecond conformational changes, and capturing them at atomic resolution is central to understanding catalysis, allostery, and ligand binding. Classical force fields such as CHARMM, OPLS, and Amber approximate the potential energy surface with pairwise-additive analytical terms. This functional form struggles with the many-body interactions that shape disordered regions of proteins, including exchange-repulsion, charge transfer, charge penetration, and cooperative hydrogen bonding. Polarizable force fields add induced dipoles but remain empirically parameterized and fail to capture short-range many-body effects from electron-density overlap.

Quantum-mechanical methods avoid this, but coupled cluster theory scales as $\mathcal{O}(N^7)$ in the number of electrons and even DFT remains $\mathcal{O}(N^3)$ to $\mathcal{O}(N^4)$, ruling out direct ab initio molecular dynamics for biomolecules. Fragmentation methods like molecular fractionation with conjugate caps (MFCC) mitigate the cost, but they truncate the many-body expansion at two bodies and miss long-range hydrogen bonding. Machine-learned force fields (MLFFs) reach near-QM accuracy at lower cost, yet they typically train on DFT data (inheriting delocalization errors and poor dispersion), struggle with interpretability, and extrapolate unreliably. Existing permutationally invariant polynomial (PIP) approaches scale factorially in the number of atoms, capping direct applicability at roughly ten to fifteen atoms per fragment.

MB-nrg PEFs based on the many-body expansion and PIPs have successfully modeled water, halides in water, carbon dioxide, methane, ammonia, nitrogen pentoxide, and N-methylacetamide. Extending them to covalently bonded biomolecules requires rethinking what counts as a “body.”

Building Polyalanine from Functional-Group n-mers

The MB-nrg formalism starts from the many-body expansion of the total energy,

$$ E_N(1, \dots, N) = \sum_{i=1}^{N} \varepsilon^{1\mathrm{B}}(i) + \sum_{i<j}^{N} \varepsilon^{2\mathrm{B}}(i,j) + \sum_{i<j<k}^{N} \varepsilon^{3\mathrm{B}}(i,j,k) + \dots + \varepsilon^{N\mathrm{B}}(1, \dots, N) $$

where each $n$-body contribution is defined recursively as the $n$-mer energy minus all lower-order terms. The full PEF combines physics-based and data-driven components,

$$ V_{\mathrm{MB\text{-}nrg}} = V_{\mathrm{ML}} + V_{\mathrm{phys}} $$

with $V_{\mathrm{ML}} = V_{\mathrm{ML}}^{1\mathrm{B}} + V_{\mathrm{ML}}^{2\mathrm{B}} + V_{\mathrm{ML}}^{3\mathrm{B}}$ capturing short-range quantum-mechanical interactions, and $V_{\mathrm{phys}} = V_{\mathrm{elec}} + V_{\mathrm{disp}} + V_{\mathrm{rep}}$ supplying electrostatics, dispersion, and repulsion. Dispersion follows a Tang-Toennies damped $C_6/R^6$ form with XDM-derived coefficients; electrostatics uses a Thole-modified self-consistent polarization model inherited from MB-pol; the repulsion term is a Lennard-Jones $R^{-12}$ contribution borrowed from Amber ff14SB, activated only for non-bonded atom pairs not covered by a PIP.

Each data-driven $n$-body term is expressed as

$$ V_{\mathrm{ML}}^{n\mathrm{B}} = \sum_{\mathrm{M}_1 < \dots < \mathrm{M}_n}^{N} s^{n\mathrm{B}}(\mathrm{M}_1, \dots, \mathrm{M}_n), V_{\mathrm{PIP}}^{n\mathrm{B}}(\mathrm{M}_1, \dots, \mathrm{M}_n) $$

where $V_{\mathrm{PIP}}^{n\mathrm{B}}$ is a permutationally invariant polynomial in Morse-like variables $\xi_{ij} = \exp(-k_{\tau(ij)} R_{ij})$ and $s^{n\mathrm{B}}$ is a switching function.

The key extension in this paper, building on earlier work on linear alkanes, is to treat functional groups (not whole molecules) as 1-mers. An Ace-capped, Nme-capped polyalanine chain decomposes into three distinct 1-mer types (-CH-, CH$_3$-, -CONH-), five distinct 2-mer types, and six distinct 3-mer types, for 14 unique PIPs that cover every $n$-mer appearing in any AceAla$_n$Nme chain. Cleaving covalent bonds between 1-mers would produce radicals, so the authors cap dangling valences with “ghost” hydrogen atoms at fixed C-H (1.14 Å) and N-H (1.09 Å) distances. Each $n$-mer energy is then referenced to its own optimized H-capped structure,

$$ E_n(1, \dots, n) = E_n^{\mathrm{H\text{-}capped}}(1, \dots, n) - E_n^{\mathrm{H\text{-}capped,opt}}(1, \dots, n). $$

In the current implementation, only covalently bonded $n$-mers receive PIPs, the 2-body contribution from a dimer with one intervening 1-mer is folded into the corresponding 3-body term, and non-bonded 1-mers interact through the Lennard-Jones repulsion alone. Crucially, no whole-chain polyalanine data enters any stage of training: every PIP is parameterized on isolated $n$-mer configurations, and the total energy is reconstructed through the many-body expansion.

Training on DLPNO-CCSD(T) with Metadynamics Sampling

Training sets are generated for each of the 14 $n$-mer types using parallel-bias metadynamics (PBMetaD) with partitioned families, biasing heavy-atom bonds, angles, and dihedrals across 300 K, 500 K, and 700 K in LAMMPS interfaced with PLUMED and modified OPLS/CM1A and Amber ff14SB force fields. For each $n$-mer, 200,000 candidate configurations are sampled, then reduced to roughly 10,000-20,000 training configurations (and about 1,000 test configurations) through Mini-batch K-means clustering on chemically equivalent pairwise distances. Reference energies are computed at the DLPNO-CCSD(T)/aug-cc-pVTZ level in ORCA.

Each PIP minimizes a weighted, ridge-regularized sum of squared errors,

$$ \chi^2 = \sum_{k \in \mathcal{S}} w_k \left[ V^{n\mathrm{B}}(k) - \varepsilon^{n\mathrm{B}}(k) \right]^2 + \Gamma^2 \sum_l c_l^2 $$

with $\Gamma = 0.0005$ throughout and low-energy bias weights

$$ w_k = \left( \frac{\delta E}{\varepsilon^{n\mathrm{B}}(k) - \varepsilon^{n\mathrm{B}}_{\min} + \delta E} \right)^2. $$

MB-Fit handles the fit, combining simplex optimization for non-linear parameters $k_{\tau(ij)}$ with ridge regression for the linear coefficients $c_l$.

Table 1 in the paper reports, for each of the 14 PIPs, the polynomial degree (5 for the smaller -CH- and CH$_3$- 1-mers, 3 for the larger -CONH- 1-mer and for all 2-mers and 3-mers), the number of symmetrized monomials (ranging from 635 for the -CH- and CH$_3$- 1-mers to 2871 for the -CONH-CH-CONH- 3-mer), the training-set size, and RMSDs for the train and test splits. All training RMSDs stay below 0.4 kcal/mol and all test RMSDs below 0.5 kcal/mol, with the smallest errors for the -CH- and CH$_3$- 1-mers (0.05 kcal/mol train, 0.14 kcal/mol test) and the largest test RMSD (0.47 kcal/mol) for the -CONH-CH- 2-mer.

MD validations run in LAMMPS interfaced with MBX and PLUMED. For alanine dipeptide metadynamics, bias potentials on the backbone $\varphi$ and $\psi$ angles are deposited every 500 steps with a 1.0 kJ/mol height and 11.46° width over 10 ns trajectories in the NVT ensemble, using the velocity-Verlet integrator with a 0.5 fs time step. Analogous MetaD runs with Amber ff14SB and ff19SB are performed in Amber23. The longer AceAla$_9$Nme trajectories start from fully extended structures and run in a 100 Å × 100 Å × 100 Å gas-phase box.

CCSD(T) Energy Landscapes, Free-Energy Surfaces, and Helix Dynamics

Alanine dipeptide 2D PES. Alanine dipeptide geometries are optimized on a Ramachandran grid with 10° spacing at the RI-MP2/def2-TZVP level and then evaluated at DLPNO-CCSD(T)/aug-cc-pVTZ. Despite never seeing whole alanine dipeptide in training, MB-nrg closely matches the reference locations and relative energies of four minima ($m_1$ to $m_4$), three maxima ($M_1$ to $M_3$), and one saddle point ($X$). Amber ff14SB and ff19SB capture the minima reasonably but badly overshoot the barriers: at $M_1$, MB-nrg misses the reference by only -2.41 kcal/mol, while ff14SB and ff19SB overshoot by +7.50 and +7.83 kcal/mol. The authors also note that ff19SB incorrectly orders the secondary minima by predicting $m_3$ lower than $m_2$.

The authors attribute MB-nrg’s residual high-energy error to terminal methyl groups approaching the backbone in conformations where non-bonded 1-mer interactions are modeled by the simple LJ repulsion rather than an explicit PIP.

Harmonic vibrations. Normal modes for the $m_1$ and $m_4$ alanine dipeptide conformers, computed by diagonalizing the Hessian, match RI-MP2/def2-TZVP references with mean deviations of 17.41 cm$^{-1}$ and 21.07 cm$^{-1}$ across all 60 modes. The authors acknowledge that some of this discrepancy reflects differences in theoretical levels (MB-nrg is trained to CCSD(T)/aug-cc-pVTZ, while the reference normal modes are computed at RI-MP2/def2-TZVP).

Free-energy surfaces. Well-tempered metadynamics at 300 K produces 2D free-energy surfaces over $(\varphi, \psi)$. MB-nrg yields a smoother FES whose extrema line up with the DLPNO-CCSD(T) reference PES. Amber ff14SB and ff19SB remain reasonable near the low-energy $m_1$ and $m_2$ minima but systematically overestimate the barriers near $M_1$, $M_2$, and $M_3$, which the authors argue artificially confines the dipeptide and suppresses conformational transitions.

Secondary structure in AceAla$_9$Nme. In 600 ps NVT MD starting from a fully extended structure, the STRIDE algorithm tracks residue-level secondary structures. Amber ff14SB and ff19SB collapse into $\alpha$-helices at roughly 40 ps and 80 ps, respectively, with ff19SB remaining especially rigid. MB-nrg takes about 100 ps before helices begin to form and then exhibits continuous oscillations between $3_{10}$- and $\alpha$-helical conformations. Ramachandran plots over the nine alanine residues show MB-nrg exploring the “bridge” region ($\varphi < 0°$, $-20° \leq \psi \leq 20°$) associated with $3_{10}$-helices and sampling the left-handed $\alpha_L$ region that Amber rarely visits. The authors tie this flexibility to experimental observations of alanine-rich peptides in the gas phase and to similar predictions from GEMS and MACE-OFF.

Transferability Without Whole-Chain Training Data

The paper demonstrates that a modular, bottom-up PEF built from functional-group $n$-mers can reach CCSD(T) accuracy for polyalanine in the gas phase without ever training on whole-chain data. Truncating explicit data-driven terms at the 3-body level appears to balance cost and fidelity, with long-range effects handled by many-body polarization in $V_{\mathrm{elec}}$ and by Amber-derived repulsion between distant 1-mers. The 2D PES, harmonic frequencies, free-energy surface, and secondary-structure dynamics each validate a different facet of the model.

The authors are explicit about limitations. The current PEF applies only to gas-phase polyalanine; solvent effects and other amino acids remain open. The Lennard-Jones repulsion for non-bonded 1-mers is a placeholder for eventual 2-body PIPs that should capture short-range interactions during folding. Long-range hydrogen bonding in compact secondary structures (π-helices, $3_{10}$-helices, $\alpha$-helices) may produce non-negligible higher-order many-body contributions that the current 3-body truncation omits. The 2-body contribution from a dimer with one intervening monomer is currently folded into the 3-body term because of steric conflicts between capping hydrogens, and a systematic fix is flagged for future work. The authors position this paper as the first in a series (the “I.” in the title refers to “Polyalanine in the Gas Phase”) that will extend MB-nrg to broader biomolecular systems under physiological conditions. The follow-up, MB-nrg in Solution: Polyalanine in Water with CCSD(T) PEFs, adds explicit 1-mer/water 2-body PIPs and benchmarks alanine dipeptide solvation.

Reproducibility Details

Data

Per the Data Availability statement, “any data generated and analyzed in this study are available from the authors upon request.” No public release is announced in the text.

Algorithms

• Many-body expansion of the energy with 1-, 2-, and 3-body data-driven terms.
• Permutationally invariant polynomials in Morse-exponential variables $\xi_{ij} = \exp(-k_{\tau(ij)} R_{ij})$, symmetrized over chemically equivalent atoms.
• “Ghost” H-capping at cleaved covalent bonds, with fixed C-H (1.14 Å) and N-H (1.09 Å) bond lengths and per-$n$-mer optimized-structure referencing.
• Non-linear parameters fit by simplex minimization, linear coefficients by ridge regression with $\Gamma = 0.0005$.
• Low-energy weighting in the loss through $w_k = (\delta E / (\varepsilon^{n\mathrm{B}}(k) - \varepsilon^{n\mathrm{B}}_{\min} + \delta E))^2$.
• Tang-Toennies damped dispersion with XDM-derived $C_6$ and damping parameters, Thole-modified many-body polarization, and LJ repulsion borrowed from Amber ff14SB.

Models

• 14 PIPs total covering three 1-mer types, five 2-mer types, and six 3-mer types. Polynomial degree is 5 for the -CH- and CH$_3$- 1-mers, and 3 for the -CONH- 1-mer together with all 2-mers and 3-mers. Term counts range from 635 (-CH-, CH$_3$-) to 2871 (-CONH-CH-CONH-).
• MB-nrg PEF implemented in the MBX code and exercised through LAMMPS and PLUMED.
• Training set sizes per $n$-mer range from roughly 12,000 to 47,000 configurations (the -CONH- 1-mer dataset is the largest at 47,438).

Evaluation

Hardware

Computational resources came from the Air Force Office of Scientific Research (FA9550-20-1-0351), NSF award 2311260, the DoD High Performance Computing Modernization Program, the San Diego Supercomputer Center via ACCESS allocation CHE240114, and NERSC (contract DE-AC02-05CH11231, award BES-ERCAP0030920). Specific wall-clock and node-hour figures are not reported in the main text.

Paper Information

Citation: Zhou, R., Bull-Vulpe, E. F., Pan, Y., & Paesani, F. (2025). Data-Driven Many-Body Simulations of Biomolecules with CCSD(T) Accuracy: I. Polyalanine in the Gas Phase. ChemRxiv. https://doi.org/10.26434/chemrxiv-2025-b05k5

Publication: ChemRxiv preprint, 25 March 2025.

Additional Resources:

• MBX software (Paesani group)
• MB-Fit (training pipeline)

@misc{zhou2025data,
  title={Data-Driven Many-Body Simulations of Biomolecules with CCSD(T) Accuracy: I. Polyalanine in the Gas Phase},
  author={Zhou, Ruihan and Bull-Vulpe, Ethan F. and Pan, Yuanhui and Paesani, Francesco},
  year={2025},
  doi={10.26434/chemrxiv-2025-b05k5},
  howpublished={\url{https://doi.org/10.26434/chemrxiv-2025-b05k5}}
}

This is a Method paper, the second installment in Zhou and Paesani’s MB-nrg-for-biomolecules series. Paper I (covered in MB-nrg: CCSD(T)-Accurate Potentials for Polyalanine) decomposed gas-phase polyalanine into functional-group $n$-mers and fit permutationally invariant polynomials (PIPs) to DLPNO-CCSD(T)/aug-cc-pVTZ reference data. This sequel adds the missing piece: explicit, machine-learned 2-body interactions between every polyalanine functional-group 1-mer and a water molecule, trained on the same coupled-cluster reference. The resulting PEF couples the gas-phase intramolecular MB-nrg term, the MB-pol water model, and a new MB-nrg ala-water cross term within a single modular many-body decomposition.

Why Empirical Force Fields Struggle with Hydrated Peptides

Biomolecular function in water emerges from a coupling of intramolecular flexibility with solvent-mediated interactions, including hydrogen-bond networks, cooperative polarization, dispersion, and short-range exchange-repulsion. Empirical force fields such as AMBER, CHARMM, and OPLS approximate the multidimensional PES with pairwise-additive analytical terms whose parameters are tuned to experimental observables or low-level quantum data. The authors note that this functional form leads to systematic errors in predicted conformational ensembles for short peptides and intrinsically disordered proteins (IDPs), with reported overpopulation of polyproline II (pPII) basins and antiparallel $\beta$ regions for alanine residues, plus underrepresentation of the transitional $\beta$ basin compared to experiment.

Polarizable force fields recover dielectric and hydration trends through induced dipoles, but still lean on empirical functional forms and miss short-range quantum effects (charge transfer, charge penetration, exchange-repulsion) that arise from electron-density overlap. Machine-learned force fields like MACE-OFF, GEMS, and FeNNix-Bio1 have improved bio-organic accuracy, but they still depend critically on the diversity and quality of training data, struggle to decompose energies into physically interpretable components, and most rely on DFT references that inherit delocalization errors and incomplete long-range correlation. Local descriptors common to MLFFs also limit treatment of long-range electrostatics and many-body correlations, both essential for biomolecular solvation.

The MB-nrg formalism, originally developed for water and small molecules and recently extended to alkanes and gas-phase polyalanine, offers an alternative: a rigorous many-body expansion (MBE) of the energy combined with both data-driven $n$-body PIPs and physics-based long-range terms. Paper II asks whether this modular gas-phase scaffold can be cleanly extended to aqueous environments by adding only short-range peptide-water 2-body PIPs.

A Modular MB-nrg PEF for Polyalanine in Water

The MBE writes the total energy of a system of $N$ 1-mers as

$$ E_N(1, \dots, N) = \sum_{i=1}^{N} \varepsilon^{1\mathrm{B}}(i) + \sum_{i<j}^{N} \varepsilon^{2\mathrm{B}}(i,j) + \sum_{i<j<k}^{N} \varepsilon^{3\mathrm{B}}(i,j,k) + \dots + \varepsilon^{N\mathrm{B}}(1, \dots, N) $$

with each $n$-body term defined recursively as the $n$-mer energy minus all lower-order contributions. The MBE converges quickly for insulating molecular systems with large electronic band gaps (such as water and peptides), so explicit PIP corrections are typically truncated at $n \leq 4$, with higher-order effects absorbed into many-body polarization.

For polyalanine in water, the total potential is partitioned into three modular blocks:

$$ V_{\mathrm{MB\text{-}nrg}}^{\mathrm{tot}} = V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala}} + V_{\mathrm{MB\text{-}pol}}^{\mathrm{wat}} + V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala\text{-}wat}} $$

where $V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala}}$ is the gas-phase intramolecular polyalanine PEF from Paper I, $V_{\mathrm{MB\text{-}pol}}^{\mathrm{wat}}$ is the MB-pol water model, and $V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala\text{-}wat}}$ is the new peptide-water cross term. The cross term itself follows the MB-nrg recipe of splitting machine-learned and physics-based contributions:

$$ V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala\text{-}wat}} = V_{\mathrm{ML}} + V_{\mathrm{phys}} $$

with $V_{\mathrm{ML}} = V_{\mathrm{ML}}^{2\mathrm{B}}$ (only 2-body PIPs in this implementation) and $V_{\mathrm{phys}} = V_{\mathrm{elec}} + V_{\mathrm{disp}}$. The 2-body machine-learned term sums switched PIPs over every (1-mer, water) dimer:

$$ V_{\mathrm{ML}}^{2\mathrm{B}} = \sum_{i=1}^{N} s^{2\mathrm{B}}(\mathrm{M}_i, \mathrm{WAT}), V_{\mathrm{PIP}}^{2\mathrm{B}}(\mathrm{M}_i, \mathrm{WAT}) $$

where $\mathrm{M}_i$ is the $i$-th polyalanine functional-group 1-mer (-CH-, CH$_3$-, or -CONH-), WAT is a water molecule, and $s^{2\mathrm{B}}$ is a cosine switching function

$$ s^{2\mathrm{B}}(x) = \begin{cases} 1 & x < 0 \\ (1 + \cos(x))/2 & 0 \leq x < 1 \\ 0 & 1 \leq x \end{cases}, \quad x = \frac{R - R_{\mathrm{in}}}{R_{\mathrm{out}} - R_{\mathrm{in}}} $$

that smoothly attenuates the short-range PIP beyond a defined distance to preserve energy conservation in MD. The physics-based block uses a Thole-modified self-consistent polarization model (inherited from MB-pol) for $V_{\mathrm{elec}}$ and a Tang-Toennies damped dispersion sum

$$ V_{\mathrm{disp}} = -\sum_{\substack{\alpha \in 1\text{-mers} \\ \beta \in \mathrm{water}}} f(\mathrm{b}_{\alpha\beta} R_{\alpha\beta}), \frac{C_{6, \alpha\beta}}{R_{\alpha\beta}^{6}} $$

with $C_{6, \alpha\beta}$ coefficients and atomic polarizabilities derived from the exchange-hole dipole moment (XDM) method, and atomic charges fit to reproduce the permanent multipole moments of each $n$-mer’s optimized structure.

The authors stress that explicit 3-body and higher peptide-water PIPs are deliberately omitted in this first implementation; their effects are absorbed into the classical polarization term. They flag that strongly hydrogen-bonded or cooperative configurations may benefit from adding higher-body corrections in future work, following the precedent of MB-pol(2023) for water.

Training Set Generation and DLPNO-CCSD(T) Reference Data

Training pools for the three 1-mer-water dimers (CH$_3$-H$_2$O, -CH–H$_2$O, -CONH–H$_2$O) extend the parallel-bias metadynamics with partitioned families (PBMetaD+PFs) protocol from Paper I. Covalent boundaries are capped with “ghost” hydrogens at fixed C-H (1.14 Å) and N-H (1.09 Å) distances to preserve closed-shell character; each 2-body energy is referenced to the corresponding optimized capped 1-mer-water geometry to remove constant offsets.

PBMetaD simulations are run in LAMMPS interfaced with PLUMED, using Amber ff14SB for the alanine 1-mers and TIP4P/2005f for water. Collective variables span all heavy-atom bonds, angles, and dihedrals in each dimer. To target distinct interaction regimes, three separate biased runs apply upper and lower walls on the 1-mer/water center-of-mass distance: 0-4 Å (short-range repulsion), 4-7 Å (mid-range attraction), and 7-10 Å (long-range orientation-dependent interactions). Each dimer yields about 600,000 configurations, reduced to roughly 40,000 training and 2,000 test configurations per type by K-means clustering.

Reference 2-body energies are computed at the DLPNO-CCSD(T)/aug-cc-pVTZ level in ORCA, using the aug-cc-pVTZ/C auxiliary basis, the RIJCOSX approximation, TightSCF, TightPNO, and the PModel pair-selection option. The counterpoise method corrects every 2-body energy for basis set superposition error.

Each PIP minimizes a weighted, ridge-regularized least-squares objective:

$$ \chi^2 = \sum_{k \in \mathcal{S}} w_k \left[ V^{2\mathrm{B}}(k) - \varepsilon^{2\mathrm{B}}(k) \right]^2 + \Gamma^2 \sum_l c_l^2 $$

with $\Gamma = 0.0005$ throughout. Training weights bias the fit toward low-energy configurations,

$$ w_k = \left( \frac{\delta E}{\varepsilon^{2\mathrm{B}}(k) - \varepsilon_{\mathrm{min}}^{2\mathrm{B}} + \delta E} \right)^2 $$

with $\delta E = 40$ kcal/mol for all 1-mer-water pairs. MB-Fit handles the optimization, combining simplex minimization for non-linear parameters (Morse decay constants) with ridge regression for the linear coefficients.

Table 1 reports the PIP specifications. All three PIPs use polynomial degree 3 with a complete, unscreened basis. The -CH- and CH$_3$- dimers each require 710 symmetrized terms; the chemically richer -CONH- dimer requires 1,267 terms to capture its dipolar character and directional hydrogen bonding. Training-set sizes range from 41,781 to 43,174 configurations.

All RMSDs sit below 0.20 kcal/mol on both train and test splits, well within sub-chemical accuracy.

Validation: Dimer Scans, Free-Energy Surfaces, and Hydration

The authors stage four validation studies of increasing complexity, each touching a distinct facet of the new PEF.

Alanine dipeptide-water dimer scans. One-dimensional scans probe the interaction energy along four hydrogen-bonding coordinates of an alanine dipeptide-water dimer: O$_1$-H$_w$, H$_1$-O$_w$, O$_2$-H$_w$, and H$_2$-O$_w$, where subscripts 1 and 2 mark the acetyl and N-methyl termini. The dipeptide is constrained to four representative Ramachandran conformations: C5 ($\varphi = -150°$, $\psi = 150°$), pPII ($\varphi = -80°$, $\psi = 150°$), C7$_{\mathrm{eq}}$ ($\varphi = -80°$, $\psi = 70°$), and right-handed $\alpha$-helix $\alpha_R$ ($\varphi = -80°$, $\psi = -30°$). MB-nrg closely tracks the DLPNO-CCSD(T)/aug-cc-pVTZ reference curves across all 16 (4 conformation $\times$ 4 site) scans, despite never seeing the full dipeptide-water surface during training. Amber ff14SB/TIP3P and ff19SB/OPC underestimate hydrogen-bond depths and miss curvature near equilibrium, with the ff14SB/TIP3P combination yielding slightly better overall agreement than ff19SB/OPC even though TIP3P is the less accurate water model.

Two specific failure modes of the empirical force fields stand out. In the pPII conformation, both ff14SB and ff19SB predict significantly deeper interaction wells than the reference, overstabilizing several hydrogen bonds. In the H$_2$-O$_w$ scan of the $\alpha_R$ conformation, both empirical FFs exhibit a spurious 2.5-4.0 Å energy barrier that the authors trace to the simple Lennard-Jones repulsion between the acetyl carbonyl oxygen and water; MB-nrg and DLPNO-CCSD(T) instead show a smoothly decaying profile. The one MB-nrg deviation noted is the C5 H$_1$-O$_w$ scan in the 1.5-2.5 Å range, where MB-nrg predicts a slightly more attractive interaction than the reference. Here the H$_1$-O$_2$ distance is 2.3 Å and water acts simultaneously as acceptor at H$_1$ and donor to O$_2$, a cooperative pattern the authors expect would require explicit 2-mer-water or 3-mer-water terms to fully reproduce.

Free-energy surface in explicit MB-pol water. Four-walker well-tempered metadynamics (WT-MetaD) simulations explore the conformational landscape of alanine dipeptide as a function of $(\varphi, \psi)$, biasing the central alanine residue’s backbone dihedrals every 500 steps with 1.0 kJ/mol Gaussians of 11.46° width. The free-energy section reports 2.5 ns per replica across four parallel walkers (10 ns aggregate, matching the Figure 6 caption); the methods section states 8 ns total, an internal inconsistency in the paper. The MB-nrg FES recovers all major low-energy conformers identified by NMR and prior MP2/DFT studies: a global minimum at $\alpha_R$, additional local minima in C5, $\beta_2$, and $\alpha_L$, and a metastable pPII basin. The C7$_{\mathrm{eq}}$ minimum that dominates the gas-phase Ramachandran surface in Paper I is significantly destabilized in solution, consistent with experiment.

Quantitatively, MB-nrg predicts $\alpha_R$ and $\beta_2$ as isoenergetic global minima, with C5 about 3 kcal/mol higher in free energy. Prior DFT-with-implicit-solvation studies (Mironov et al., Yang and Honig) report C5, $\alpha_R$, and $\beta_2$ as nearly isoenergetic, and the authors note that the discrepancy may reflect the explicit MB-pol water treatment, residual DFT errors in the reference, or both. They flag a planned systematic benchmarking of MB-nrg PEFs for diverse polypeptides against both DFT and DLPNO-CCSD(T) data in future work. The Amber FESs over-stabilize pPII relative to C5/$\alpha_R$, contradicting experimental and DFT benchmarks; ff19SB/OPC also exhibits a spurious C7$_{\mathrm{eq}}$ minimum that is absent from MB-nrg.

Hydration radial distribution functions. Site-site RDFs at 300 K for the same hydrogen-bond contacts (O$_1$-H$_w$, O$_2$-H$_w$, H$_1$-O$_w$, H$_2$-O$_w$) are computed from NVT MD trajectories. All three models reproduce well-defined first-shell peaks near 2.0 Å. For the O-H$_w$ pairs, MB-nrg shows a broader, slightly right-shifted second-shell peak, indicating less rigid water structure beyond the first shell. The amide-hydrogen RDFs are nearly identical between ff14SB/TIP3P and ff19SB/OPC, while MB-nrg reveals subtle first-shell shifts (shorter H$_1$-O$_w$, longer H$_2$-O$_w$) and weaker, less-defined second-shell features near 3.7-3.8 Å that are absent from the empirical force fields and consistent with prior ab initio MD on alanine dipeptide.

A Modular Path to Chemically Accurate Biomolecular Simulations

Across the four benchmarks, the same picture emerges: a modular, bottom-up MB-nrg PEF built from functional-group $n$-mers and trained only on isolated 1-mer-water dimers can reach DLPNO-CCSD(T) accuracy for both energetic and structural observables of alanine dipeptide in explicit water. The decomposition into a gas-phase intramolecular term, an MB-pol water model, and an MB-nrg cross term keeps each piece interpretable and individually replaceable; the gas-phase polyalanine PEF from Paper I drops in unchanged, and the new ala-water PIPs were fit without ever seeing the full alanine dipeptide-water PES.

The authors are explicit about limitations:

• The cross term currently includes only 2-body PIPs (one 1-mer with one water). Higher-body peptide-water terms ($n > 2$) are folded into the classical polarization, which the authors expect will be inadequate for strongly cooperative configurations such as the C5 H$_1$-O$_w$ scan where one water bridges H$_1$ and O$_2$.
• Quantitative differences between the MB-nrg FES and prior implicit-solvation DFT studies (relative depths of $\alpha_R$, $\beta_2$, and C5) remain to be reconciled through systematic benchmarking against higher-level reference data.
• Only polyalanine is considered. The framework is designed to generalize to other amino acids and side-chain-water interactions, but sequence- and side-chain-specific PIPs are still to be fit.
• No public release of the parameterized PEF or training data is announced; the data availability statement says “available from the authors upon request.”

The paper positions MB-nrg as a transferable, interpretable strategy for chemically accurate biomolecular simulations in solution, with future work aimed at heteropolypeptides and explicit higher-order many-body cross terms.

Reproducibility Details

Data

Per the data availability statement, “any data generated and analyzed in this study, including the MB-nrg PEF, are available from the authors upon request.” The MBX engine is publicly available on GitHub under a UC Regents custom license that grants free use for educational, research, and non-profit purposes but restricts commercial use. No public release of the new ala-water PIPs is announced in the text.

Artifacts table

Algorithms

• Many-body expansion of the energy partitioned into three modular blocks: $V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala}} + V_{\mathrm{MB\text{-}pol}}^{\mathrm{wat}} + V_{\mathrm{MB\text{-}nrg}}^{\mathrm{ala\text{-}wat}}$.
• Cross term split into $V_{\mathrm{ML}}^{2\mathrm{B}}$ (PIPs over every 1-mer-water dimer) and $V_{\mathrm{phys}} = V_{\mathrm{elec}} + V_{\mathrm{disp}}$.
• Permutationally invariant polynomials in Morse-exponential variables $\xi_{ij} = \exp(-k_{\tau(ij)} R_{ij})$, symmetrized over chemically equivalent atoms; same construction as the NMA-water PIPs.
• Cosine switching function $s^{2\mathrm{B}}$ smoothly attenuates short-range PIPs between user-defined inner and outer cutoffs.
• Dispersion: Tang-Toennies damped $C_6/R^6$ with XDM-derived coefficients and damping parameters.
• Electrostatics: modified Thole model with self-consistent induced dipoles for many-body polarization; per-atom charges fit to reproduce permanent multipole moments of each $n$-mer’s optimized structure.
• Ghost-H capping at cleaved covalent boundaries with fixed C-H (1.14 Å) and N-H (1.09 Å) distances; per-dimer optimized-structure referencing.
• Training with simplex minimization for non-linear parameters and ridge regression for linear coefficients via MB-Fit, with low-energy weighting and $\Gamma = 0.0005$, $\delta E = 40$ kcal/mol.
• WT-MetaD with four parallel walkers for the alanine dipeptide FES.

Models

• Three new 1-mer-water 2-body PIPs covering -CH-/H$_2$O, CH$_3$-/H$_2$O, and -CONH-/H$_2$O dimers.
• All three PIPs use polynomial degree 3 with a complete, unscreened basis (no term screening).
• Term counts: 710 for -CH-/H$_2$O and CH$_3$-/H$_2$O, 1,267 for -CONH-/H$_2$O.
• Combined with the gas-phase polyalanine MB-nrg PEF from Paper I and the MB-pol water model, exercised through MBX, LAMMPS, and PLUMED.

Evaluation

Quantitative RMSD or KL-divergence values for the FES and RDF benchmarks are not reported in the main text.

Hardware

The authors acknowledge support from the Air Force Office of Scientific Research (FA9550-20-1-0351, theoretical development) and NSF (award 2311260, MBX implementation). Computational resources came from the DoD High Performance Computing Modernization Program, the San Diego Supercomputer Center via ACCESS allocation CHE240114, and NERSC (contract DE-AC02-05CH11231, award BES-ERCAP0030920). Specific wall-clock and node-hour figures are not reported in the main text.

Paper Information

Citation: Zhou, R., & Paesani, F. (2025). Toward Chemical Accuracy in Biomolecular Simulations through Data-Driven Many-Body Potentials: II. Polyalanine in Water. ChemRxiv. https://doi.org/10.26434/chemrxiv-2025-j6cwv-v2

Publication: ChemRxiv preprint (version 2), 10 October 2025.

Additional Resources:

• MBX software (Paesani group)
• MB-Fit (training pipeline)
• Companion paper: MB-nrg: CCSD(T)-Accurate Potentials for Polyalanine (Paper I)

@article{zhou2025toward,
  title={Toward Chemical Accuracy in Biomolecular Simulations through Data-Driven Many-Body Potentials: II. Polyalanine in Water},
  author={Zhou, Ruihan and Paesani, Francesco},
  journal={ChemRxiv},
  year={2025},
  doi={10.26434/chemrxiv-2025-j6cwv-v2}
}

This is a Method paper that introduces Ewald message passing (Ewald MP), a general framework for incorporating long-range interactions into message passing neural networks (MPNNs) for molecular potential energy surface prediction. The key contribution is a nonlocal Fourier-space message passing scheme, grounded in the classical Ewald summation technique from computational physics, that complements the short-range message passing of existing GNN architectures.

The Long-Range Interaction Problem in Molecular GNNs

Standard MPNNs for molecular property prediction rely on a spatial distance cutoff to define atomic neighborhoods. While this locality assumption enables favorable scaling with system size and provides a useful inductive bias, it fundamentally limits the model’s ability to capture long-range interactions such as electrostatic forces and van der Waals (London dispersion) interactions. These interactions decay slowly with distance (e.g., electrostatic energy follows a $1/r$ power law), and truncating them with a distance cutoff can introduce severe artifacts in thermochemical predictions.

This problem is well-known in molecular dynamics, where empirical force fields explicitly separate bonded (short-range) and non-bonded (long-range) energy terms. The Ewald summation technique addresses this by decomposing interactions into a short-range part that converges quickly with a distance cutoff and a long-range part whose Fourier transform converges quickly with a frequency cutoff. The authors propose bringing this same strategy into the GNN paradigm.

From Ewald Summation to Learnable Fourier-Space Messages

The core insight is a formal analogy between the continuous-filter convolution used in MPNNs and the electrostatic potential computation in Ewald summation. In a standard continuous-filter convolution, the message sum for atom $i$ is:

$$ M_i^{(l+1)} = \sum_{j \in \mathcal{N}(i)} h_j^{(l)} \cdot \Phi^{(l)}(| \mathbf{x}_i - \mathbf{x}_j |) $$

where $h_j^{(l)}$ are atom embeddings and $\Phi^{(l)}$ is a learned radial filter. Comparing this to the electrostatic potential $V_i^{\text{es}}(\mathbf{x}_i) = \sum_{j \neq i} q_j \cdot \Phi^{\text{es}}(| \mathbf{x}_i - \mathbf{x}_j |)$ reveals a direct correspondence: atom embeddings play the role of partial charges, and learned filters replace the $1/r$ kernel.

Ewald MP decomposes the learned filter into short-range and long-range components. The short-range part is handled by any existing GNN architecture with a distance cutoff. The long-range part is computed as a sum over Fourier frequencies:

$$ M^{\text{lr}}(\mathbf{x}_i) = \sum_{\mathbf{k}} \exp(i \mathbf{k}^T \mathbf{x}_i) \cdot s_{\mathbf{k}} \cdot \hat{\Phi}^{\text{lr}}(| \mathbf{k} |) $$

where $s_{\mathbf{k}}$ are structure factor embeddings, computed as:

$$ s_{\mathbf{k}} = \sum_{j \in \mathcal{S}} h_j \exp(-i \mathbf{k}^T \mathbf{x}_j) $$

These structure factor embeddings are a Fourier-space representation of the atom embedding distribution, and truncating to low frequencies effectively coarse-grains the hidden model state while preserving long-range information. The frequency filters $\hat{\Phi}^{\text{lr}}$ are learned, making the entire scheme data-driven rather than tied to a fixed physical functional form.

The method handles both periodic systems (where the reciprocal lattice provides a natural frequency discretization) and aperiodic systems (where the Fourier domain is discretized using a cubic voxel grid with SVD-based rotation alignment to preserve rotation invariance). The combined embedding update becomes:

$$ h_i^{(l+1)} = \frac{1}{\sqrt{3}} \left[ h_i^{(l)} + f_{\text{upd}}^{\text{sr}}(M_i^{\text{sr}}) + f_{\text{upd}}^{\text{lr}}(M_i^{\text{lr}}) \right] $$

The computational complexity is $\mathcal{O}(N_{\text{at}} N_{\text{k}})$, and by fixing the number of frequency vectors $N_{\text{k}}$, linear scaling $\mathcal{O}(N_{\text{at}})$ is achievable.

Experiments Across Four GNN Architectures and Two Datasets

The authors test Ewald MP as an augmentation on four baseline architectures: SchNet, PaiNN, DimeNet++, and GemNet-T. Two datasets are used:

• OC20 (Chanussot et al., 2021): ~265M periodic structures of adsorbate-catalyst systems with DFT-computed energies and forces. The OC20-2M subsplit is used for training.
• OE62 (Stuke et al., 2020): ~62,000 large aperiodic organic molecules with DFT-computed energies that include a DFT-D3 dispersion correction for London dispersion interactions.

All baselines use a 6 Å distance cutoff and 50 maximum neighbors. The Ewald modification is minimal: the long-range message sum is added as an additional skip connection term in each interaction block. Comparison studies include: (1) increasing the distance cutoff to match the computational cost of Ewald MP, (2) replacing the Ewald block with a SchNet interaction block at increased cutoff, and (3) increasing atom embedding dimensions to match Ewald MP’s parameter count.

Key Energy MAE Results on OE62

Key Energy MAE Results on OC20 (Averaged Across Test Splits)

Robust Long-Range Improvements and Dispersion Recovery

Ewald MP achieves consistent improvements across all models and both datasets, averaging 16.1% on OE62 and 10.3% on OC20. Several findings stand out:

1. Robustness: Unlike the increased-cutoff and SchNet-LR alternatives, Ewald MP never produces detrimental effects in any tested configuration. The increased cutoff setting hurts SchNet and PaiNN on OE62, and the SchNet-LR block fails to improve DimeNet++ and GemNet-T.

2. Long-range specificity: A binning analysis on OE62 groups molecules by the magnitude of their DFT-D3 dispersion correction. Ewald MP shows an outsize improvement for structures with large long-range energy contributions. It recovers or surpasses a “cheating” baseline that receives the exact DFT-D3 ground truth as an additional input.

3. Efficiency on periodic systems: Ewald MP achieves similar relative improvements on OC20 at roughly half the relative computational cost compared to OE62, suggesting periodic structures as a particularly attractive application domain.

4. Force predictions: Improvements in force MAEs are consistent but small, which is expected since the frequency truncation removes high-frequency contributions to the potential energy surface.

5. Ablation studies: Results are robust across different frequency cutoffs, voxel resolutions, and filtering strategies, with the non-radial periodic filtering scheme outperforming radial alternatives on out-of-distribution generalization.

Limitations include the current focus on scalar (invariant) embeddings only (PaiNN’s equivariant vector embeddings are not augmented), and the potential for a “gap” of medium-range interactions when $N_{\text{k}}$ is fixed for linear scaling. The authors suggest adapting more efficient Ewald summation variants (e.g., particle mesh Ewald with $\mathcal{O}(N \log N)$ scaling) as future work.

Reproducibility Details

Data

Algorithms

• Ewald message passing is integrated as an additional skip connection term in each interaction block
• For periodic systems: non-radial filtering with fixed reciprocal lattice positions ($N_x, N_y, N_z$ hyperparameters)
• For aperiodic systems: radial Gaussian basis function filtering with frequency cutoff $c_k$ and voxel resolution $\Delta = 0.2$ Å$^{-1}$
• SVD-based coordinate alignment for rotation invariance in the aperiodic case
• Bottleneck dimension $N_\downarrow = 16$ (GemNet-T) or $N_\downarrow = 8$ (others)
• Update function: dense layer + $N_{\text{hidden}}$ residual layers ($N_{\text{hidden}} = 3$, except PaiNN with $N_{\text{hidden}} = 0$)

Models

Evaluation

• Primary metric: Energy mean absolute error (EMAE) in meV
• Secondary metric: Force MAE in meV/Å (OC20 only)
• Loss: Linear combination of energy and force MAEs (Eq. 15) with model-specific force multipliers
• Optimizer: Adam with weight decay ($\lambda = 0.01$)

Hardware

• All runtime measurements on NVIDIA A100 GPUs
• Runtimes measured after 50 warmup batches, averaged over 500 batches, minimum of 3 repetitions
• Code: EwaldMP (Hippocratic License 3.0)

Artifacts

Reproducibility status: Highly Reproducible. Source code, both datasets, and detailed hyperparameters (including per-model learning rates, batch sizes, and Ewald-specific settings) are all publicly available. Pre-trained model weights are not provided.

Paper Information

Citation: Kosmala, A., Gasteiger, J., Gao, N., & Günnemann, S. (2023). Ewald-based Long-Range Message Passing for Molecular Graphs. In Proceedings of the 40th International Conference on Machine Learning (ICML 2023).

Publication: ICML 2023

@inproceedings{kosmala2023ewald,
  title={Ewald-based Long-Range Message Passing for Molecular Graphs},
  author={Kosmala, Arthur and Gasteiger, Johannes and Gao, Nicholas and G{\"u}nnemann, Stephan},
  booktitle={Proceedings of the 40th International Conference on Machine Learning},
  year={2023},
  series={PMLR},
  volume={202}
}

Aligning two sets of corresponding points, finding the optimal rotation (and optionally translation and scale) that maps one onto the other, is a fundamental operation across scientific computing. It appears in molecular dynamics (superimposing protein conformations), robotics (sensor registration), and computer vision (shape matching). The two dominant algorithm families are the Kabsch (SVD-based) method and the Horn (quaternion-based) method.

The Kabsch-Horn Cookbook is a Python library that implements both algorithm families across five numerical frameworks: NumPy, PyTorch, JAX, TensorFlow, and MLX. Every backend shares the same API, supports N-dimensional point sets, per-point weights, and arbitrary batch dimensions. The PyTorch, JAX, TensorFlow, and MLX backends are fully differentiable, with custom autograd rules that bypass the numerically unstable gradient of the standard SVD near degenerate singular values.

Features

Algorithms

• Kabsch: SVD-based optimal rotation for rigid alignment
• Kabsch-Umeyama: Kabsch with an additional optimal scaling factor $c$, solving $Q \approx cRP + t$
• Horn: Quaternion-based optimal rotation via the eigendecomposition of a $4 \times 4$ key matrix
• Horn + Scale: Horn’s method extended with optimal isotropic scaling
• RMSD Wrappers: Convenience functions that return RMSD directly alongside the alignment parameters

Framework Support

torch.compile and jax.jit are the tested compile/JIT paths. MLX supports 3D inputs only; the Kabsch (SVD) path is N-dimensional on the other four backends.

Numerical Robustness

Standard SVD and eigendecomposition backward passes produce NaN gradients when singular values collide or are near-zero. The library provides custom autograd primitives to handle these cases:

• SafeSVD (PyTorch, JAX, TF, MLX): Custom backward pass that clamps the singular value gap, preventing division-by-zero in the gradient
• SafeEigh (PyTorch, JAX, TF, MLX): Analogous safe backward for the symmetric eigendecomposition used in Horn’s method
• Per-point weights: Weighted centroids and weighted cross-covariance for mass-weighted or confidence-weighted alignment
• Batch dimensions: All functions broadcast over leading batch dimensions without explicit loops
• Mixed-dtype promotion: Inputs are promoted to a common floating-point dtype automatically

Testing

The test suite uses Hypothesis-based property testing across 13 modules covering:

• Round-trip correctness (align then compare)
• Gradient finiteness and correctness (finite-difference checks)
• Reflection handling (proper vs. improper rotations)
• Weighted alignment consistency
• Batch broadcasting
• 4 differentiable backends $\times$ 4 precisions (float32, float64, and where supported, float16, bfloat16)

Usage

This is a reference cookbook, so you can copy the framework folder you need from src/kabsch_horn/<framework>/ directly into your project (the code has no runtime dependencies beyond the framework itself). To depend on it instead, install a pinned version from GitHub:

pip install "git+https://github.com/hunter-heidenreich/Kabsch-Cookbook.git@v0.4.1"

Basic alignment with NumPy:

import numpy as np
from kabsch_horn import numpy as kh

# Two sets of corresponding 3D points
P = np.random.randn(100, 3)
R_true = np.linalg.qr(np.random.randn(3, 3))[0]  # random rotation matrix
Q = (P @ R_true.T) + np.random.randn(1, 3)

R, t, rmsd = kh.kabsch(P, Q)
aligned = P @ R.T + t

RMSD loss for training in PyTorch:

import torch
from kabsch_horn import pytorch as kh

pred_coords = model(input_features)   # (B, N, 3), requires_grad=True
target_coords = batch["target"]       # (B, N, 3)

rmsd = kh.kabsch_rmsd(pred_coords, target_coords)  # (B,)
loss = rmsd.mean()
loss.backward()  # safe gradients via SafeSVD

For the full API reference and additional examples, see the documentation site.

Results

Gradient Stability

The standard SVD backward pass computes terms of the form $\frac{1}{\sigma_i^2 - \sigma_j^2}$, which diverges when two singular values are close. In molecular alignment this happens frequently: planar molecules, symmetric structures, and noisy coordinates can all produce near-degenerate singular values. The SafeSVD primitive floors the magnitude of that denominator at the dtype’s machine epsilon (finfo(dtype).eps), producing finite (if slightly biased) gradients in these edge cases. Property-based tests confirm that gradients remain finite across thousands of random rotations, scales, and noise levels for all four differentiable backends.

Framework Parity

All five backends produce numerically equivalent results (up to floating-point tolerance) on the same inputs. The shared API means switching from NumPy prototyping to PyTorch training requires changing only the import path.

Related Work

This project builds on the foundational alignment algorithms described in these papers:

• Kabsch (1976): the original SVD-based rotation alignment
• Arun et al. (1987): SVD formulation for 3D point set fitting
• Horn (1987): quaternion-based closed-form absolute orientation
• Horn et al. (1988): orthonormal matrix (polar decomposition) approach
• Umeyama (1991): extension to include optimal scaling

For a detailed walkthrough of the Kabsch algorithm with code examples, see the companion blog post: The Kabsch Algorithm.

This is a Method paper.

Its primary contribution is the formulation of the Stillinger-Weber potential, a non-additive potential energy function designed to model tetrahedral semiconductors. The paper also uses molecular dynamics simulation to explore physical properties of silicon in both crystalline and liquid phases, but the methodological contribution (the potential architecture) is what enabled subsequent research on covalent materials.

The Failure of Pair Potentials in Silicon

The authors aimed to simulate the melting and liquid properties of tetrahedral semiconductors (Silicon and Germanium).

• The Problem: Standard pair potentials (like Lennard-Jones) favor close-packed structures (12 nearest neighbors) and cannot stabilize the open diamond structure (4 nearest neighbors) of Silicon.
• The Gap: Earlier classical potentials lacked the flexibility to describe the profound structural change where Silicon shrinks upon melting (coordination number increases from 4 to >6) while remaining conductive.
• The Goal: To construct a potential that spans the entire configuration space, describing both the rigid crystal and the diffusive liquid, without requiring quantum mechanical calculations.

The Three-Body Interaction Novelty

The core novelty is the introduction of a stabilizing three-body interaction term ($v_3$) to the potential energy function.

• 3-Body Term: Explicitly penalizes deviations from the ideal tetrahedral angle ($\cos \theta_t = -1/3$).
• Unified Model: This potential handles bond breaking and reforming, allowing for the simulation of melting and liquid diffusion. Previous “Keating” potentials model only small elastic deformations.
• Mapping Technique: The application of “steepest-descent mapping” to quench dynamical configurations into their underlying “inherent structures” (local minima), revealing the fundamental topology of the liquid energy landscape.

Molecular Dynamics Validation

The authors performed Molecular Dynamics (MD) simulations using the proposed potential.

• System: 216 Silicon atoms in a cubic cell with periodic boundary conditions.
• State Points: Fixed density $\rho = 2.53 \text{ g/cm}^3$ (matching experimental liquid density at melting).
• Process:
  1. Start with diamond crystal at low temperature.
  2. Systematically heat to induce spontaneous nucleation and melting.
  3. Equilibrate the liquid.
  4. Periodically map configurations to potential minima (inherent structures) using steepest descent.

Phase Topology and Inverse Lindemann Criterion

• Validation: The potential successfully stabilizes the diamond structure as the global minimum at zero pressure.
• Liquid Structure: The simulated liquid pair-correlation function $g(r)$ and structure factor $S(k)$ qualitatively match experimental diffraction data, including the characteristic shoulder on the structure factor peak.
• Inherent Structure: The liquid possesses a temperature-independent inherent structure (amorphous network) hidden beneath thermal vibrations.
• Melting/Freezing Criteria: The study proposes an “Inverse Lindemann Criterion”: while crystals melt when vibration amplitude exceeds ~0.19 lattice spacings, liquids freeze when atom displacements from their inherent minima drop below ~0.30 neighbor spacings.

Limitations and Energy Scale Problem

The authors acknowledge a quantitative energy scale discrepancy. To match the observed melting temperature of Si ($1410°$C), $\epsilon$ would need to be approximately 42 kcal/mol, considerably less than the 50 kcal/mol required to reproduce the correct cohesive energy of the crystal. The authors suggest this could be resolved either by further optimization of $v_2$ and $v_3$, or by adding position-independent single-particle terms $v_1 \approx -16$ kcal/mol arising from the electronic structure. Adding $v_1$ terms only affects the temperature scale and has no influence on local structure at a given reduced temperature.

The simulated liquid coordination number (8.07) is also higher than the experimentally reported value of approximately 6.4, though the authors note that the experimental definition of “nearest neighbors” was not precisely stated.

Bonding Statistics in Inherent Structures

Analysis of potential-energy minima (inherent structures) using a bond cutoff of $r/\sigma = 1.40$ reveals the coordination distribution in the liquid:

Five-coordinate atoms dominate the liquid’s inherent structure, with four- and six-coordinate atoms each accounting for about 20% of the population. The three-body interactions prevent any occurrence of coordination numbers near 12 that would indicate local close packing.

Reproducibility Details

Algorithms

• Integration: Equations of motion integrated using a fifth-order Gear algorithm.
• Time Step: $\Delta t = 5 \times 10^{-3} \tau$ (approx $3.83 \times 10^{-16}$ s), where $\tau = \sigma(m/\epsilon)^{1/2} = 7.6634 \times 10^{-14}$ s.
• Minimization: Steepest-descent mapping utilized Newton’s method to find limiting solutions ($\nabla \Phi = 0$).

Models

To reproduce this work, one must implement the potential $\Phi = \sum v_2 + \sum v_3$ with the exact functional forms and parameters provided.

Reduced Units

• $\sigma = 0.20951 \text{ nm}$
• $\epsilon = 50 \text{ kcal/mol} = 3.4723 \times 10^{-12} \text{ erg}$

Two-Body Term ($v_2$)

$$ v_2(r_{ij}) = \epsilon A (B r_{ij}^{-p} - r_{ij}^{-q}) \exp[(r_{ij} - a)^{-1}] \quad \text{for } r_{ij} < a $$

(Vanishes for $r \geq a$)

Three-Body Term ($v_3$)

$$ v_3(r_i, r_j, r_k) = \epsilon [h(r_{ij}, r_{ik}, \theta_{jik}) + h(r_{ji}, r_{jk}, \theta_{ijk}) + h(r_{ki}, r_{kj}, \theta_{ikj})] $$

where:

$$ h(r_{ij}, r_{ik}, \theta_{jik}) = \lambda \exp[\gamma(r_{ij}-a)^{-1} + \gamma(r_{ik}-a)^{-1}] (\cos\theta_{jik} + \frac{1}{3})^2 $$

(Vanishes if distances $\geq a$)

Parameters

Evaluation

The paper evaluates the model against experimental diffraction data.

Paper Information

Citation: Stillinger, F. H., & Weber, T. A. (1985). Computer simulation of local order in condensed phases of silicon. Physical Review B, 31(8), 5262-5271. https://doi.org/10.1103/PhysRevB.31.5262

Publication: Physical Review B, 1985

@article{stillingerComputerSimulationLocal1985,
  title = {Computer Simulation of Local Order in Condensed Phases of Silicon},
  author = {Stillinger, Frank H. and Weber, Thomas A.},
  year = 1985,
  month = apr,
  journal = {Physical Review B},
  volume = {31},
  number = {8},
  pages = {5262--5271},
  publisher = {American Physical Society},
  doi = {10.1103/PhysRevB.31.5262}
}

This is a Methodological Paper ($\Psi_{\text{Method}}$). It proposes a novel stochastic algorithm, the Hyperbolic Algorithm (HA), and validates its superior efficiency against the existing Langevin Algorithm (LA) through formal error analysis and numerical simulation. It contains significant theoretical derivation (Liouville dynamics) that serves primarily to justify the algorithmic performance claims.

Motivation and Gaps in Prior Work

The standard Langevin Algorithm (LA) for numerical simulation of Euclidean field theories suffers from efficiency bottlenecks. The simplest Euler-discretization of the LA introduces systematic errors of $O(\epsilon)$ (where $\epsilon$ is the step size). To maintain accuracy, $\epsilon$ must be kept small, which increases the sweep-sweep correlation time (autocorrelation time), making simulations computationally expensive.

Core Novelty: Second-Order Dynamics

The core contribution is the introduction of a second-order derivative in fictitious time to the stochastic equation. This converts the parabolic Langevin equation into a hyperbolic equation:

$$ \begin{aligned} \frac{\partial^{2}\phi}{\partial t^{2}}+\gamma\frac{\partial\phi}{\partial t}=-\frac{\partial S}{\partial\phi}+\eta \end{aligned} $$

Equation Comparison

The key difference from the standard (first-order) Langevin equation:

The standard Langevin equation corresponds to the overdamped limit where the acceleration term is absent. Physically, the Hyperbolic equation can be viewed as microcanonical equations of motion with an added friction term.

Key Innovations

• Higher Order Accuracy: The simplest discretization of this equation leads to systematic errors of only $O(\epsilon^2)$ compared to $O(\epsilon)$ for LA.
• Tunable Damping: The addition of the damping parameter $\gamma$ allows tuning to minimize autocorrelation tails.
• Uniform Evolution: The method evolves structures of different wavelengths more uniformly than LA due to the specific dissipation structure.

Methodology and Experiments

The author validated the method using the XY Model on 2D lattices.

• System: Euclidean action $S = -\sum_{x,\mu} \cos(\theta_{x+\mu} - \theta_x)$.
• Setup:
  • Lattice sizes: $15^2$ (helical boundary conditions) and $30^2$.
  • $\beta$ range: 0.9 to 1.2 (crossing the critical point $\approx 1.0$).
  • Run length: >100,000 updates in equilibrium.
• Metrics:
  • Autocorrelation time ($\tau$): Defined as the number of updates for the time-correlation function to drop to 10% of its initial value.
  • Systematic Error: Measured via deviation of average action from Monte Carlo values.

Results and Conclusions

• Efficiency: The Hyperbolic Algorithm (HA) is far more efficient. For equal systematic errors, sweep-sweep correlation times are significantly lower than LA.
• Error Scaling: Numerical results confirmed that HA step size $\epsilon_H = 0.1$ yields systematic errors comparable to LA step size $\epsilon_L \approx 0.008$ ($O(\epsilon^2)$ vs $O(\epsilon)$ scaling).
• Speedup: In the disordered phase, HA is roughly $\epsilon_H / \epsilon_L$ times faster (approximately a factor of 12.5 for $\epsilon_H = 0.1$, $\epsilon_L = 0.008$). In the ordered phase, efficiency gains increase with distance scale, reaching factors of 20 or more for long-range correlations.
• Optimal Damping: For the XY model, the optimal damping parameter was found to be $\gamma \approx 0.4$.

Reproducibility Details

Algorithms

1. The Hyperbolic Algorithm (HA)

The discretized update equations for scalar fields are:

$$ \begin{aligned} \pi_{t+\epsilon} - \pi_{t} &= -\epsilon\gamma\pi_{t} - \epsilon\frac{\partial S}{\partial\phi_{t}} + \sqrt{2\epsilon\gamma/\beta}\xi_{t} \\ \phi_{t+\epsilon} - \phi_{t} &= \epsilon\pi_{t+\epsilon} \end{aligned} $$

• Variables: $\phi$ is the field, $\pi$ is the conjugate momentum ($\dot{\phi}$).
• Parameters: $\epsilon$ (step size), $\gamma$ (damping constant).
• Noise: $\xi$ is Gaussian noise with $\langle\xi_x \xi_y\rangle = \delta_{x,y}$.
• Storage: Requires storing both $\phi$ and $\pi$ vectors.

2. Non-Abelian Generalization

For Lie group elements $U$ with generators $T^a$:

$$ \begin{aligned} \pi_{t+\epsilon}^a - \pi_{t}^a &= -\epsilon\gamma\pi_{t}^a - \epsilon\delta^a S[U_t] + \sqrt{2\epsilon\gamma/\beta}\xi_{t}^a \\ U_{t+\epsilon} &= e^{i\epsilon\pi_{t+\epsilon}^a T^a} U_t \end{aligned} $$

Theoretical Proof of $O(\epsilon^2)$ Accuracy

The derivation relies on the generalized Liouville equation for the probability distribution $P[\phi, \pi; t]$.

1. Transition Probability: The transition $W$ for one iteration is defined.
2. Effective Liouville Operator: The evolution is written as $P(t+\epsilon) = \exp(\epsilon L_{\text{eff}}) P(t)$.
3. Baker-Hausdorff Expansion: Using normal ordering of operators, the equilibrium distribution $P_{\text{eq}}$ is derived through $O(\epsilon^2)$:

$$ \begin{aligned} P_{\text{eq}} &= \exp\left\lbrace-\frac{1}{2}\beta_{1}\sum_{x}\pi_{x}^{2} - \beta S[\phi] + \frac{1}{2}\epsilon\beta\sum_{x}\pi_{x}S_{x} + \epsilon^{2}G + O(\epsilon^3)\right\rbrace \end{aligned} $$

where $\beta_1 = \beta\left(1 - \frac{1}{2}\epsilon\gamma\right)$.

4. Effective Action: Integrating out $\pi$ yields the effective action for $\phi$:

$$ \begin{aligned} S_{\text{eff}}[\phi] &= S[\phi] - \frac{1}{8}\epsilon^2 \sum_x S_x^2 + \dots \end{aligned} $$

The absence of $O(\epsilon)$ terms proves the higher-order accuracy.

Evaluation

• Model: XY Model (2D)
• Hamiltonian: $H = \frac{1}{2}\sum \pi^2 + S[\phi]$ where $S = -\sum \cos(\Delta \theta)$.
• Observables:
  • $\Gamma_n = \cos(\theta_{m+n} - \theta_m)$ (averaged over lattice $m$).
• Comparisons:
  • LA Step: $\epsilon_L \approx 0.005 - 0.02$.
  • HA Step: $\epsilon_H \approx 0.1 - 0.2$.
  • Equivalence: $\epsilon_H = 0.1$ matches error of $\epsilon_L \approx 0.008$.

Terminology Note

The naming conventions in this paper differ from those commonly used in molecular dynamics (MD). The following table provides a cross-field mapping:

Key insight: The paper’s “Hyperbolic Algorithm” is mathematically equivalent to Langevin Dynamics with a Leapfrog/Verlet integrator, commonly used in MD. The baseline “Langevin Algorithm” corresponds to Brownian Dynamics. The term “Langevin equation” is overloaded: field theorists often use it for overdamped dynamics (no inertia), while chemists assume it includes momentum ($F=ma$).

Paper Information

Citation: Horowitz, A. M. (1987). The Second Order Langevin Equation and Numerical Simulations. Nuclear Physics B, 280, 510-522. https://doi.org/10.1016/0550-3213(87)90159-3

Publication: Nuclear Physics B 1987

@article{horowitzSecondOrderLangevin1987,
  title = {The Second Order {{Langevin}} Equation and Numerical Simulations},
  author = {Horowitz, Alan M.},
  year = 1987,
  month = jan,
  journal = {Nuclear Physics B},
  volume = {280},
  pages = {510--522},
  issn = {05503213},
  doi = {10.1016/0550-3213(87)90159-3}
}

This is primarily a Discovery ($\Psi_{\text{Discovery}}$) paper, with strong supporting contributions as a Method ($\Psi_{\text{Method}}$) evaluation. The primary contribution is the validation and mechanistic visualization of the “exchange mechanism” for surface diffusion using computational methods (Molecular Dynamics with many-body potentials). This physical phenomenon was previously observed in Field Ion Microscope (FIM) experiments but difficult to characterize dynamically. The paper focuses on determining how atoms move, specifically distinguishing between hopping and exchange mechanisms.

The Field Ion Microscope (FIM) Observation Gap

Surface diffusion is critical for understanding phenomena like crystal growth, epitaxy, and catalysis. Experimental evidence from FIM on fcc(001) surfaces (specifically Pt and Ir) suggested an “exchange mechanism” where an adatom replaces a substrate atom, challenging the conventional wisdom that adatoms migrate by hopping over potential barriers (bridge sites) between binding sites. The authors sought to:

1. Investigate whether this exchange mechanism could be reproduced dynamically in simulation.
2. Determine which interatomic potentials (EAM, Sutton-Chen, R-G-L) accurately describe these surface behaviors compared to bulk properties.

Dynamic Visualization of Atomic Exchange

The study provides a direct dynamic visualization of the “concerted motion” involved in exchange diffusion events, which happens on timescales too fast for experimental imaging. By comparing three different many-body potentials, the authors demonstrate that the choice of potential is critical for capturing surface phenomena; specifically, identifying that “bulk” derived potentials (like Sutton-Chen) may fail to capture specific surface exchange events that EAM and R-G-L potentials successfully model.

Simulation Protocol & Evaluated Potentials

The authors performed Molecular Dynamics (MD) simulations on Iridium (Ir) surfaces:

• Surfaces: Channeled (110), densely packed (111), and loosely packed (001).
• Potentials: Three many-body models were tested: Embedded Atom Method (EAM), Sutton-Chen (S-C), and Rosato-Guillope-Legrand (R-G-L).
• Conditions: Simulations were primarily run at $T=800$ K to ensure sufficient sampling of diffusion events.
• Cross-Validation: The study extended the analysis to Cu, Rh, and Pt systems to verify the universality of the exchange mechanism against experimental data.

Confirmation of Concerted Motion Mechanisms

• Mechanism Confirmation: The study confirmed that diffusion on Ir(001) proceeds via an atomic exchange mechanism (concerted motion). The activation energy for exchange ($0.77$ eV) was found to be significantly lower than for hopping over bridge sites ($1.57$ eV).
• Surface Structure Dependence:
  • Ir(111): Diffusion is rapid (activation energy $V_a = 0.17$ eV from R-G-L Arrhenius plot) and occurs exclusively via hopping; no exchange events were observed due to the close-packed nature of the surface.
  • Ir(110): Diffusion is anisotropic; atoms hop along channels but use the exchange mechanism to move across channels.
• Potential Validity: The R-G-L and EAM potentials successfully reproduced experimental exchange behaviors, whereas the Sutton-Chen potential failed to predict exchange on Ir(001). The authors attribute the S-C failure primarily to the use of “bulk” potential parameters to describe interactions at the surface.
• Cross-System Comparison: The study extended the analysis to Cu, Rh, and Pt systems. Both S-C and R-G-L potentials correctly predicted the absence of exchange on all three Rh surfaces and on (111) surfaces of Cu and Pt. Exchange events were correctly predicted on Cu(001), Cu(110), Pt(001), and Pt(110) by both potentials. The sole discrepancy was S-C failing to predict exchange on Ir(001), where R-G-L and EAM succeeded in agreement with experiment.

Reproducibility Details

Algorithms

• Integration: “Velocity” form of the Verlet algorithm.
• Time Step: $\Delta t = 0.01$ ps ($10^{-14}$ s).
• Simulation Protocol:
  1. Quenching: System relaxed to 0 K by zeroing velocities when $v \cdot F < 0$.
  2. Equilibration: 5 ps constant-temperature run (renormalizing velocities every step).
  3. Production: 15 ps constant-energy (microcanonical) run where trajectories are collected.

Models

The study relies on three specific many-body potential formulations:

1. Embedded Atom Method (EAM):
   • Total energy: $$U_{tot} = \sum_i F_i(\rho_i) + \frac{1}{2} \sum_{j \neq i} \phi_{ij}(r_{ij})$$
2. Sutton-Chen (S-C):
   • Uses a square root density dependence and power-law pair repulsion $(a/r)^{n}$: $$F(\rho) \propto \rho^{1/2}$$
3. Rosato-Guillope-Legrand (R-G-L):
   • Born-Mayer type repulsion: $$\phi_{ij}(r) = A \exp[-p(r/r_0 - 1)]$$
   • Attractive band energy: $$F_i(\rho) = -\left(\sum \xi^2 \exp[-2q(r/r_0 - 1)]\right)^{1/2}$$

Data

• System Size: 648 classical atoms.
• Geometry:
  • Cubic box with fixed volume.
  • Periodic boundary conditions in $x$ and $y$ (parallel to surface), free motion in $z$.
  • Substrate depth: 8, 12, or 9 atomic layers depending on orientation [(001), (110), (111)].
• Cutoff Radius: 14 bohr ($\sim 7.4$ Å).
• Initial Conditions: Velocities initialized from a Maxwellian distribution.

Evaluation

• Diffusion Constant ($D$): Calculated using the Einstein relation via Mean Square Displacement (MSD): $$D = \lim_{t \to \infty} \frac{\langle \Delta r^2(t) \rangle}{2td}$$ where $d=2$ for surface diffusion.
• Activation Energy ($V_a$): Extracted from the slope of Arrhenius plots ($\ln D$ vs $1/T$).
• Attempt Frequency ($\nu$): Estimated via harmonic approximation: $\nu = \frac{1}{2\pi}\sqrt{c/M}$.

Paper Information

Citation: Shiang, K.-D., Wei, C. M., & Tsong, T. T. (1994). A molecular dynamics study of self-diffusion on metal surfaces. Surface Science, 301(1-3), 136-150. https://doi.org/10.1016/0039-6028(94)91295-5

Publication: Surface Science 1994

@article{shiang1994molecular,
  title={A molecular dynamics study of self-diffusion on metal surfaces},
  author={Shiang, Keh-Dong and Wei, C.M. and Tsong, Tien T.},
  journal={Surface Science},
  volume={301},
  number={1-3},
  pages={136--150},
  year={1994},
  publisher={Elsevier},
  doi={10.1016/0039-6028(94)91295-5}
}

This is primarily a Methodological Paper ($\Psi_{\text{Method}}$), with a significant secondary component of Discovery ($\Psi_{\text{Discovery}}$).

It focuses on validating a specific algorithm (the “Evans method”) for Non-Equilibrium Molecular Dynamics (NEMD) by comparing its results against experimental benchmarks. However, it also uncovers physical anomalies, specifically “long-time tails” in the heat flux autocorrelation function that deviate significantly from theoretical predictions, marking a discovery about the physics of the Lennard-Jones fluid itself.

Flow Gradients and Boundary Limitations

The primary motivation is to overcome the limitations of simulating heat flow using physical boundaries (e.g., walls at different temperatures), which causes severe interpretive difficulties due to density and temperature gradients.

The “Evans method” uses a fictitious external field to induce heat flow in a periodic, homogeneous system. This paper serves to:

1. Validate this method across a wide range of state points (temperatures and densities) beyond the triple point.
2. Investigate the system’s behavior near the critical point, where transport properties are known to be anomalous.

Core Innovations of the Evans Algorithm

The core contribution is the rigorous stress-testing of the homogeneous heat flow algorithm (Evans method) combined with a Gaussian thermostat.

Specific novel insights include:

• Linearity Validation: Establishing that, away from phase boundaries, the effective thermal conductivity is a monotonic, virtually linear function of the external field, justifying the extrapolation to zero field.
• Critical Anomaly Detection: Finding that near the critical point, conductivity becomes a non-monotonic function of the field, challenging standard simulation approaches in this regime.
• Tail Amplitude Discovery: Demonstrating that the “long-time tails” of the heat flux autocorrelation function have amplitudes roughly 6 times larger than those predicted by mode-coupling theory.

NEMD Simulation Setup

The author performed Non-Equilibrium Molecular Dynamics (NEMD) simulations using the Lennard-Jones potential.

• System: Mostly $N=108$ particles, with some checks using $N=256$ to test size dependence.
• Thermostat: A Gaussian thermostat was used to keep the kinetic energy (temperature) constant.
• State Points:
  • Critical Isotherm: $T=1.35$, varying density.
  • Supercritical Isotherm: $T=2.0$.
  • Freezing Line: Two points ($T=2.74, \rho=1.113$ and $T=2.0, \rho=1.04$).
• Validation: Results were compared against experimental data for Argon (using standard LJ parameters).
• Ablation:
  • Field Strength ($F$): Varied to check for linearity/non-linearity.
  • System Size ($N$): Comparison between 108 and 256 particles to rule out finite-size artifacts.

Linearity Regimes and Long-Time Tail Anomalies

• Agreement with Experiment: The Evans method yields thermal conductivities in broad agreement with experimental Argon data for most state points.
• Linearity: Away from the critical point, conductivity is a virtually linear function of the field strength $F$, allowing for accurate zero-field extrapolation.
• Critical Region Failure: Near the critical point ($T=1.35, \rho=0.4$), the method struggles; the conductivity is non-monotonic with respect to $F$, and the zero-field extrapolation underestimates the experimental value by ~11%.
• Long-Time Tails: The decay of the heat flux autocorrelation function follows a $t^{-3/2}$ tail (consistent with mode-coupling theory), but the amplitude is ~6x larger than predicted.
• Phase Hysteresis: In high-density regions near the freezing line, the system exhibits hysteresis and bi-stability between solid and liquid phases depending on the field strength.

Reproducibility Details

Data

The simulation relies on the Lennard-Jones (LJ) potential to model Argon. No external training data is used; the “data” consists of the physical constants defining the system.

Algorithms

The core algorithm is the Evans Homogeneous Heat Flow method. To reproduce this, one must implement the specific Equations of Motion (EOM) derived from linear response theory.

Equations of Motion:

The trajectories are generated by: $$ \begin{aligned} \dot{q}_i &= \frac{p_i}{m} \\ \dot{p}_i &= F_i^{\text{inter}} + (E_i - \bar{E})F(t) - \sum_{j} F_{ij} q_{ij} \cdot F(t) + \frac{1}{2N} \sum_{j,k} F_{jk} q_{jk} \cdot F(t) - \alpha p_i \end{aligned} $$

Where:

• $F(t)$ is the fictitious external field driving heat flow.
• $E_i$ is the instantaneous energy of particle $i$.
• $\alpha$ is the Gaussian Thermostat multiplier (calculated at every step to strictly conserve kinetic energy/Temperature): $$\alpha = \frac{\sum_i [\dots]_{\text{force terms}} \cdot p_i}{\sum_i p_i \cdot p_i}$$

Conductivity Calculation:

The zero-frequency limit is extrapolated as: $$ \lambda = \lim_{F \to 0} \frac{J_Q}{FT} $$

The frequency-dependent conductivity relies on the heat-flux autocorrelation: $$ \lambda(\omega) = \frac{V}{3k_B T^2} \int_0^\infty dt , e^{i\omega t} \langle J_Q(t) \cdot J_Q(0) \rangle $$

Models

The “model” here is the physical simulation setup.

• Particle Count: $N = 108$ (primary), $N = 256$ (validation).
• Boundary Conditions: Periodic Boundary Conditions (PBC).
• Thermostat: Gaussian Isokinetic (Temperature is a constant of motion).

Evaluation

The primary metric is the Thermal Conductivity ($\lambda$).

Hardware

• Requirements: While 1986 hardware is obsolete, reproducing this requires a standard MD code capable of non-conservative forces (NEMD).
• Compute Cost: Low by modern standards. 108 particles for $\sim 10^5$ to $10^6$ steps is trivial on modern CPUs.

Paper Information

Citation: Evans, D. J. (1986). Thermal conductivity of the Lennard-Jones fluid. Physical Review A, 34(2), 1449-1453. https://doi.org/10.1103/PhysRevA.34.1449

Publication: Physical Review A, 1986

@article{PhysRevA.34.1449,
  title = {Thermal conductivity of the Lennard-Jones fluid},
  author = {Evans, Denis J.},
  journal = {Phys. Rev. A},
  volume = {34},
  number = {2},
  pages = {1449--1453},
  numpages = {0},
  year = {1986},
  month = {Aug},
  publisher = {American Physical Society},
  doi = {10.1103/PhysRevA.34.1449},
  url = {https://link.aps.org/doi/10.1103/PhysRevA.34.1449}
}

This is a Systematization (Review) paper. It consolidates the theoretical development, semi-empirical parameterization, and broad applications of the Embedded-Atom Method (EAM) into a unified framework. The paper systematizes the field by connecting the EAM to related theories (Effective Medium Theory, Finnis-Sinclair, “glue” models) and organizing phenomenological results across diverse physical regimes (bulk, surfaces, interfaces).

The authors explicitly frame the work as a survey, stating “We review here the history, development, and application of the EAM” and “This review emphasizes the physical insight that motivated the EAM.” The paper follows a classic survey structure, organizing the literature by application domains.

The Failure of Pair Potentials in Metallic Systems

The primary motivation is the failure of pair-potential models to accurately describe metallic bonding, particularly at defects and interfaces.

Physics Gap: Pair potentials assume bond strength is independent of environment, implying cohesive energy scales linearly with coordination ($Z$), whereas in reality it scales roughly as $\sqrt{Z}$.

Empirical Failures: Pair potentials incorrectly predict the “Cauchy relation” ($C_{12} = C_{44}$) and predict a vacancy formation energy equal to the cohesive energy, contradicting experimental data for fcc metals.

Practical Need: First-principles calculations (like DFT) were computationally too expensive for low-symmetry systems like grain boundaries and fracture tips, creating a need for an efficient, semi-empirical many-body potential.

Theoretical Unification & Core Innovations

The paper’s core contribution is the synthesis of the EAM as a practical computational tool that captures “coordination-dependent bond strength” without the cost of ab initio methods.

Theoretical Unification: It demonstrates that the EAM ansatz can be derived from Density Functional Theory (DFT) by assuming the total electron density is a superposition of atomic densities.

Environmental Dependence: It explicitly formulates how the “effective” pair interaction stiffens and shortens as coordination decreases (e.g., at surfaces), a feature naturally arising from the non-linearity of the embedding function.

Broad Validation: It provides a centralized evaluation of the method across a vast array of metallic properties, establishing it as the standard for atomistic simulations of face-centered cubic (fcc) metals.

Validating EAM Across Application Domains

The authors review computational experiments using Energy Minimization, Molecular Dynamics (MD), and Monte Carlo (MC) simulations across several domains:

Bulk Properties: Calculation of phonon spectra, liquid structure factors, thermal expansion coefficients, and melting points for fcc metals (Ni, Pd, Pt, Cu, Ag, Au).

Defects: Computation of vacancy formation/migration energies and self-interstitial geometries.

Grain Boundaries: Calculation of grain boundary structures, energies, and elastic properties for twist and tilt boundaries in Au and Al. Computed structures show good agreement with X-ray diffraction and HRTEM experiments. The many-body interactions in the EAM produce somewhat better agreement than pair potentials, which tend to overestimate boundary expansion.

Surfaces: Analysis of surface energies, relaxations, reconstructions (e.g., Au(110) missing row), and surface phonons.

Alloys: Investigation of heat of solution, surface segregation profiles (e.g., Ni-Cu), and order-disorder transitions.

Mechanical Properties: Simulation of dislocation mobility, pinning by defects (He bubbles), and crack tip plasticity (ductile vs. brittle fracture modes).

Key Outcomes and the Limits of EAM

Many-Body Success: The EAM successfully reproduces the breakdown of the Cauchy relation and the correct ratio of vacancy formation energy to cohesive energy (~0.35) for fcc metals.

Surface Accuracy: It correctly predicts that surface bonds are shorter and stiffer than bulk bonds due to lower coordination. It accurately predicts surface reconstructions (e.g., Au(110) $(1 \times 2)$).

Alloy Behavior: The method naturally captures segregation phenomena, including oscillating concentration profiles in Ni-Cu, driven by the embedding energy.

Limitations: The method is less accurate for systems with strong directional bonding (covalent materials) or significant Fermi-surface effects, as it assumes spherically averaged electron densities.

Reproducibility Details

Data

Fitting Data: The semi-empirical functions are fitted to basic bulk properties: lattice constants, cohesive energy, elastic constants ($C_{11}$, $C_{12}$, $C_{44}$), and vacancy formation energy.

Universal Binding Curve: The cohesive energy as a function of lattice constant is constrained to follow the “universal binding curve” of Rose et al. to ensure accurate anharmonic behavior.

Alloy Data: For binary alloys, dilute heats of alloying are used for fitting cross-interactions.

Algorithms

Core Ansatz: The total energy is defined as:

$$E_{coh} = \sum_{i} G_i\left( \sum_{j \neq i} \rho_j^a(R_{ij}) \right) + \frac{1}{2} \sum_{i, j (j \neq i)} U_{ij}(R_{ij})$$

where $G$ is the embedding energy (function of local electron density $\rho$), and $U$ is a pair interaction.

Simulation Techniques:

• Molecular Dynamics (MD): Used for liquids, phonons, and fracture simulations.
• Monte Carlo (MC): Used for phase diagrams and segregation profiles (e.g., approximately $10^5$ iterations per atom).
• Phonons: Calculated via the dynamical matrix derived from the force-constant tensor $K_{ij}$.
• Normal-Mode Analysis: Vibrational normal modes obtained by diagonalizing the dynamical matrix, feasible for unit cells of up to about 260 atoms.

Models

Parameterizations: The review lists several specific function sets developed by the authors (Table 2), including:

• Daw and Baskes: For Ni, Pd, H (elemental metals and H in solution/on surfaces)
• Foiles: For Cu, Ag, Au, Ni, Pd, Pt (elemental metals)
• Foiles: For Cu, Ni (tailored for the Ni-Cu alloy system)
• Foiles, Baskes and Daw: For Cu, Ag, Au, Ni, Pd, Pt (dilute alloys)
• Daw, Baskes, Bisson and Wolfer: For Ni, H (fracture, dislocations, H embrittlement)
• Foiles and Daw: For Ni, Al (Ni-rich end of the Ni-Al alloy system)
• Daw: For Ni (calculated from first principles, not semi-empirical)
• Hoagland, Daw, Foiles and Baskes: For Al (elemental Al)

Many of these historical parameterizations are directly downloadable in machine-readable formats from the NIST Interatomic Potentials Repository (linked in the resources below).

Transferability: EAM functions are generally not transferable between different parameterization sets; mixing functions from different sets (e.g., Daw-Baskes Ni with Foiles Pd) is invalid.

Evaluation

Bulk Validation: Phonon dispersion curves for Cu show excellent agreement with experiment across the full Brillouin zone.

Thermal Properties: Linear thermal expansion coefficients match experiment well (e.g., Cu calculated: $16.4 \times 10^{-6}/K$ vs experimental: $16.7 \times 10^{-6}/K$).

Defect Energetics: Vacancy migration energies and divacancy binding energies (~0.1-0.2 eV) align with experimental data.

Surface Segregation: Correctly predicts segregation species for 18 distinct dilute alloy cases (e.g., Cu segregating in Ni).

Hardware

Compute Scale: At the time of publication (1993), Molecular Dynamics simulations of up to 35,000 atoms were possible.

Platforms: Calculations were performed on supercomputers like the CRAY-XMP, though smaller calculations were noted as feasible on high-performance workstations.

Paper Information

Citation: Daw, M. S., Foiles, S. M., & Baskes, M. I. (1993). The embedded-atom method: a review of theory and applications. Materials Science Reports, 9(7-8), 251-310. https://doi.org/10.1016/0920-2307(93)90001-U

Publication: Materials Science Reports 1993

@article{dawEmbeddedatomMethodReview1993,
  title = {The embedded-atom method: a review of theory and applications},
  shorttitle = {The Embedded-Atom Method},
  author = {Daw, Murray S. and Foiles, Stephen M. and Baskes, Michael I.},
  year = 1993,
  month = mar,
  journal = {Materials Science Reports},
  volume = {9},
  number = {7-8},
  pages = {251--310},
  issn = {0920-2307},
  doi = {10.1016/0920-2307(93)90001-U}
}

Additional Resources:

• Original EAM Paper (1984)
• EAM User Guide (1994)
• NIST Interatomic Potentials Repository

This is a Systematization paper (specifically a handbook chapter) with a strong secondary Method projection.

Its primary goal is to serve as a “users’ guide” to the Embedded-Atom Method (EAM). The text organizes existing knowledge:

• It traces the physical origins of EAM from Density Functional Theory (DFT) and Effective Medium Theory.
• It synthesizes “closely related methods” (Second Moment Approximation, Glue Model), showing they are mathematically equivalent or very similar to EAM.
• It provides a pedagogical, step-by-step methodology for fitting potentials to experimental data.

Motivation: Bridging the Gap Between DFT and Pair Potentials

The primary motivation is to bridge the gap between accurate, expensive electronic structure calculations and fast, inaccurate pair potentials.

• Computational Efficiency: First-principles methods scale as $O(N^3)$ or worse, limiting simulations to $<100$ atoms (in 1994). Pair potentials scale as $O(N)$ and fail to capture essential many-body physics of metals.
• Physical Accuracy: Simple pair potentials cannot accurately model metallic defects; they predict zero Cauchy pressure ($C_{12} - C_{44} = 0$) and equate vacancy formation energy to cohesive energy, both of which are incorrect for transition metals.
• Practical Utility: There was a need for a clear guide on how to construct and apply these potentials for large-scale simulations ($10^6+$ atoms) of fracture and defects.

Novelty: A Unified Framework and Robust Fitting Recipe

As a review chapter, the novelty lies in the synthesis and the specific, reproducible recipe for potential construction. Central to this synthesis is the core EAM energy functional:

$$E_{\text{tot}} = \sum_i \left( F(\bar{\rho}_i) + \frac{1}{2} \sum_{j \neq i} \phi(r_{ij}) \right)$$

where the total energy $E_{\text{tot}}$ depends on embedding an atom $i$ into a local background electron density $\bar{\rho}_i = \sum_{j \neq i} \rho(r_{ij})$, plus a repulsive pair interaction $\phi(r_{ij})$.

• Unified Framework: It explicitly maps the “Second Moment Approximation” (Tight Binding) and the “Glue Model” onto the fundamental EAM framework above, clarifying that they differ primarily in terminology or specific functional choices (e.g., square root embedding functions).
• Cross-Potential Fitting Recipe: It details a robust method for fitting alloy potentials (specifically Ni-Al-B) by using “transformation invariance”, scaling the density and shifting the embedding function to fit alloy properties without disturbing pure element fits.
• Specific Parameters: It publishes optimized potential parameters for Ni, Al, and B that accurately reproduce properties like the Boron interstitial preference in $\text{Ni}_3\text{Al}$.

Validation: Computational Benchmarks and Simulations

The “experiments” described are computational validations and simulations using the fitted Ni-Al-B potential:

1. Potential Fitting:

   • Pure elements (Ni, Al) were fitted to elastic constants, vacancy formation energies, and diatomic data. The Ni fit achieved $\chi_{\text{rms}} = 0.75%$ and Al achieved $\chi_{\text{rms}} = 3.85%$.
   • Boron was fitted using hypothetical crystal structures (fcc, bcc) calculated via LMTO (Linear Muffin-Tin Orbital) since experimental data for fcc B does not exist.

2. Molecular Statics (Validation):

   • Surface Relaxation: Demonstrated that EAM captures the oscillatory relaxation of atomic layers near a free surface, a many-body effect that pair potentials fail to capture.
   • Defect Energetics: Calculated formation energies for Boron interstitials in $\text{Ni}_3\text{Al}$. Found the 6Ni-octahedral site is most stable ($-4.59$ eV relative to an isolated B atom and unperturbed crystal), followed by the 4Ni-2Al octahedral site ($-3.65$ eV) and the 3Ni-1Al tetrahedral site ($-2.99$ eV), consistent with channeling experiments.

3. Molecular Dynamics (Application):

   • Grain Boundary (GB) Cleavage: Simulated the fracture of a (210) tilt grain boundary in $\text{Ni}_3\text{Al}$ at a strain rate of $5 \times 10^{10}$ s$^{-1}$.
   • Comparison: Compared pure $\text{Ni}_3\text{Al}$ boundaries vs. those doped with Boron and substitutional Nickel.

Key Outcomes: EAM Efficiency and Boron Strengthening

• EAM Efficiency: Confirmed that EAM scales linearly with atom count ($N$), requiring only 2-5 times the computational work of pair potentials.
• Boron Strengthening Mechanism: The simulations suggested that Boron segregates to grain boundaries and, specifically when co-segregated with Ni, significantly increases cohesion.
  • The maximum stress for the enriched boundary was approximately 22 GPa, compared to approximately 19 GPa for the clean boundary.
  • The B-doped boundary required approximately 44% more work to cleave than the undoped boundary.
  • The fracture mode shifted from cleaving along the GB to failure in the bulk.
• Grain Boundary Segregation: Molecular statics calculations found B interstitial energies at the GB as low as $-6.9$ eV, compared to $-4.59$ eV in the bulk, consistent with experimental observations of boron segregation to grain boundaries.
• Limitations: The author concludes that while EAM is excellent for metals, it lacks the angular dependence required for strongly covalent materials (like $\text{MoSi}_2$) or directional bonding.

Reproducibility Details

The chapter provides nearly all details required to implement the described potential from scratch.

Data

• Experimental/Reference Data: Used for fitting the cost function $\chi_{\text{rms}}$.
  • Pure Elements: Lattice constants ($a_0$), cohesive energy ($E_{\text{coh}}$), bulk modulus ($B$), elastic constants ($C_{11}, C_{12}, C_{44}$), vacancy formation energy ($E_{\text{vac}}^f$), and diatomic bond length/strength ($R_e, D_e$).
  • Alloys: Heat of solution and defect energies (APB, SISF) for $\text{Ni}_3\text{Al}$.
  • Hypothetical Data: LMTO first-principles data used for unobserved phases (e.g., fcc Boron, B2 NiB) to constrain the fit.

Algorithms

• Component Functions:
  • Pair Potential $\phi(r)$: Morse potential form: $$\phi(r) = D_M {1 - \exp[-\alpha_M(r - R_M)]}^2 - D_M$$
  • Density Function $\rho(r)$: Modified hydrogenic 4s orbital: $$\rho(r) = r^6(e^{-\beta r} + 2^9 e^{-2\beta r})$$
  • Embedding Function $F(\bar{\rho})$: Derived numerically to force the crystal energy to match the “Universal Energy Relation” (Rose et al.) as a function of lattice constant.
• Fitting Strategy:
  • Smooth Cutoff: A polynomial smoothing function ($h_{\text{smooth}}$) applied at $r_{\text{cut}}$ to ensure continuous derivatives.
  • Simplex Algorithm: Used to optimize parameters ($D_M, R_M, \alpha_M, \beta, r_{\text{cut}}$).
  • Alloy Invariance: Used transformations $F’(\rho) = F(\rho) + g\rho$ and $\rho’(r) = s\rho(r)$ to fit cross-potentials without altering pure-element properties.

Models

• Parameters: The text provides the exact optimized parameters for the Ni-Al-B potential in Table 2 (Pure elements) and Table 5 (Cross-potentials).
  • Example Ni parameters: $D_M=1.5335$ eV, $\alpha_M=1.7728$ Å$^{-1}$, $r_{\text{cut}}=4.7895$ Å.

Hardware

• 1994 Context: Mentions that simulations of $10^6$ atoms were possible on the “fastest computers available”.
• Scaling: Explicitly notes computational work scales as $O(N)$, roughly 2-5x slower than pair potentials.

Paper Information

Citation: Voter, A. F. (1994). Chapter 4: The Embedded-Atom Method. In Intermetallic Compounds: Vol. 1, Principles, edited by J. H. Westbrook and R. L. Fleischer. John Wiley & Sons Ltd.

Publication: Intermetallic Compounds: Vol. 1, Principles (1994)

@incollection{voterEmbeddedAtomMethod1994,
  title = {The Embedded-Atom Method},
  author = {Voter, Arthur F.},
  booktitle = {Intermetallic Compounds: Vol. 1, Principles},
  editor = {Westbrook, J. H. and Fleischer, R. L.},
  year = {1994},
  publisher = {John Wiley & Sons Ltd},
  pages = {77--90},
  chapter = {4}
}

Additional Resources:

• NIST Interatomic Potentials Repository (Modern repository often hosting EAM files)
• Original EAM Paper (1984)
• EAM Review (1993)

This is primarily a Methodological Paper with a secondary contribution in Discovery.

The authors’ primary goal is to demonstrate the validity of the “dynamical corrections formalism” for calculating diffusion constants. They validate this by reproducing Molecular Dynamics (MD) results at high temperatures and then extending the method into low-temperature regimes where MD is infeasible.

By applying this method, they uncover a specific physical phenomenon, “bounce-back recrossings”, that causes a dip in the diffusion coefficient at low temperatures, a detail previously unobserved.

Timescale Limits in Molecular Dynamics

The authors aim to solve the timescale problem in simulating surface diffusion.

Limit of MD: Molecular Dynamics (MD) is effective at high temperatures but becomes computationally infeasible at low temperatures because the time between diffusive hops increases drastically.

Limit of TST: Standard Transition State Theory (TST) can handle long timescales but assumes all barrier crossings are successful, ignoring correlated dynamical events like immediate recrossings or multiple jumps.

Goal: They seek to apply a formalism that corrects TST using short-time trajectory data, allowing for accurate calculation of diffusion constants across the entire temperature range.

The Bounce-Back Mechanism

The core novelty is the rigorous application of the dynamical corrections formalism to a multi-site system (fcc/hcp sites) to characterize non-Arrhenius behavior at low temperatures.

Unified Approach: They demonstrate that this method works for all temperatures, bridging the gap between the “rare-event regime” and the high-temperature regime dominated by fluid-like motion.

Bounce-back Mechanism: They identify a specific “dip” in the dynamical correction factor ($f_d < 1$) at low temperatures ($T \approx 0.038$), attributed to trajectories where the adatom collides with a substrate atom on the far side of the binding site and immediately recrosses the dividing surface.

Simulating the Lennard-Jones fcc(111) Surface

The authors performed computational experiments on a Lennard-Jones fcc(111) surface cluster.

System Setup: A single adatom on a 3-layer substrate (30 atoms/layer) with periodic boundary conditions.

Baselines: They compared their high-temperature results against standard Molecular Dynamics simulations to validate the method.

Ablation of Substrate Freedom: They ran a control experiment with a 6-layer substrate (top 3 free, 800 trajectories) to confirm the bounce-back effect persisted independently of the fixed deep layers, obtaining $D/D^{TST} = 0.75 \pm 0.06$, consistent with the original result.

Trajectory Analysis: They analyzed the angular distribution of initial momenta to characterize the specific geometry of the bounce-back trajectories. Bounce-back trajectories were more strongly peaked at $\phi = 90°$ (perpendicular to the TST gate), confirming the effect arises from interaction with the substrate atom directly across the binding site.

Temperature Range: The full calculation spanned $0.013 \leq T \leq 0.383$ in reduced units, bridging the rare-event regime and the high-temperature fluid-like regime.

Resolving Non-Arrhenius Behavior

Arrhenius Behavior of TST: The uncorrected TST diffusion constant ($D^{TST}$) followed a near-perfect Arrhenius law, with a linear least-squares fit of $\ln(D^{TST}) = -1.8 - 0.30/T$.

High-Temperature Correction: At high T, the dynamical correction factor $D/D^{TST} > 1$, indicating correlated multiple forward jumps (long flights).

Low-Temperature Dip: At low T, $D/D^{TST} < 1$ for $T = 0.013, 0.026, 0.038, 0.051$ (minimum at $T = 0.038$), caused by the bounce-back mechanism.

Validation: The method successfully reproduced high-T literature values while providing access to low-T dynamics inaccessible to direct MD.

Reproducibility Details

Data

The paper does not use external datasets but generates simulation data based on the Lennard-Jones potential.

Algorithms

The diffusion constant $D$ is calculated as $D = D^{TST} \times (D/D^{TST})$.

1. TST Rate Calculation ($D^{TST}$)

• Method: Monte Carlo integration of the flux through the dividing surface.
• Technique: Calculate free energy difference between the entire binding site and the TST dividing region.
• Dividing Surface: Defined geometrically with respect to equilibrium substrate positions (honeycomb boundaries around fcc/hcp sites).

2. Dynamical Correction Factor ($D/D^{TST}$)

The method relies on evaluating the dynamical correction factor $f_d$, initialized via a Metropolis walk restricted to the TST boundary region, computed as:

$$ \begin{aligned} f_d(i\rightarrow j) = \frac{2}{N}\sum_{I=1}^{N}\eta_{ij}(I) \end{aligned} $$

• Initialization:
  • Position: Sampled via Metropolis walk restricted to the TST boundary region.
  • Momentum: Maxwellian distribution for parallel components; Maxwellian-flux distribution for normal component.
  • Symmetry: Trajectories entering hcp sites are generated by reversing momenta of those entering fcc sites.
• Integration:
  • Integrator: Adams-Bashforth-Moulton predictor-corrector formulas of orders 1 through 12.
  • Duration: Integrated until time $t > \tau_{corr}$ (approximately $\tau_{corr} \approx 13$ reduced time units).
  • Sample Size: 1400 trajectories per temperature point (700 initially entering each type of site).

Models

• System: Single component Lennard-Jones solid (Argon-like).
• Adsorbate: Single adatom on fcc(111) surface.
• Substrate Flexibility: Adatom plus top layer atoms are free to move. Layers 2 and 3 are fixed. (Validation run used 6 layers with top 3 free).

Evaluation

The primary metric is the Diffusion Constant $D$, analyzed via the Dynamical Correction Factor.

Hardware

Specific hardware configurations (e.g., node architectures, supercomputers) or training times were not specified in the original publication, which is typical for 1989 literature. Modern open-source MD engines (e.g., LAMMPS, ASE) could perform identical Lennard-Jones molecular dynamics integrations in negligible time on any consumer workstation.

Paper Information

Citation: Cohen, J. M., & Voter, A. F. (1989). Self-diffusion on the Lennard-Jones fcc(111) surface: Effects of temperature on dynamical corrections. The Journal of Chemical Physics, 91(8), 5082-5086. https://doi.org/10.1063/1.457599

Publication: The Journal of Chemical Physics 1989

@article{cohenSelfDiffusionLennard1989,
  title = {Self-diffusion on the {{Lennard}}-{{Jones}} Fcc(111) Surface: {{Effects}} of Temperature on Dynamical Corrections},
  shorttitle = {Self-diffusion on the {{Lennard}}-{{Jones}} Fcc(111) Surface},
  author = {Cohen, J. M. and Voter, A. F.},
  year = {1989},
  month = oct,
  journal = {The Journal of Chemical Physics},
  volume = {91},
  number = {8},
  pages = {5082--5086},
  issn = {0021-9606, 1089-7690},
  doi = {10.1063/1.457599},
  langid = {english}
}

This is the archetypal Method paper (dominant classification with secondary Theory contribution). It establishes the architectural validity of Molecular Dynamics (MD) as a scientific tool. Rahman answers the question: “Can a digital computer solving classical difference equations faithfully represent a physical liquid?”

The paper utilizes specific rhetorical indicators of a methodological contribution:

• Algorithmic Explication: A dedicated Appendix details the predictor-corrector difference equations.
• Validation against Ground Truth: Extensive comparison of calculated diffusion constants and pair-correlation functions against experimental neutron and X-ray scattering data.
• Robustness Checks: Ablation studies on the numerical integration stability (one vs. two corrector cycles).

Motivation: Bridging Neutron Scattering and Many-Body Theory

In the early 1960s, neutron scattering data provided insights into the dynamic structure of liquids, but theorists lacked concrete models to explain the observed two-body dynamical correlations. Analytic theories were limited by the difficulty of the many-body problem.

Rahman sought to bypass these analytical bottlenecks by assuming that classical dynamics with a simple 2-body potential (Lennard-Jones) could sufficiently describe the motion of atoms in liquid argon. The goal was to generate “experimental” data via simulation to test theoretical models (like the Vineyard convolution approximation) and provide a microscopic understanding of diffusion.

Core Innovation: System Stability and the Cage Effect

This paper is widely considered the birth of modern molecular dynamics for continuous potentials. Its key novelties include:

1. System Size & Stability: Successfully simulating 864 particles interacting via a continuous Lennard-Jones potential with stable temperature over the full simulation duration (approximately $10^{-11}$ sec, as confirmed by Table I in the paper).
2. The “Cage Effect”: The discovery that the velocity autocorrelation function becomes negative after a short time: $$ \langle \textbf{v}(0) \cdot \textbf{v}(t) \rangle < 0 \quad \text{for } t > 0.33 \times 10^{-12} \text{ s} $$ This proved that atoms in a liquid “rattle” against the cage of their nearest neighbors.
3. Delayed Convolution: Proposing an improvement to the Vineyard approximation for the distinct Van Hove function $G_d(r,t)$ by introducing a time-delayed convolution to account for the persistence of local structure. Instead of convolving $g(r)$ with $G_s(r,t)$ at the same time $t$, Rahman convolves at a delayed time $t’ < t$, using a one-parameter function with $\tau = 1.0 \times 10^{-12}$ sec. This makes $G_d(r,t)$ decay as $t^4$ at short times (instead of $t^2$ in the Vineyard approximation) and as $t$ at long times.

Methodology: Simulating 864 Argon Atoms

Rahman performed a “computer experiment” (simulation) of Liquid Argon:

• System: 864 particles in a cubic box of side $L=10.229\sigma$.
• Conditions: Temperature $94.4^\circ$K, Density $1.374 \text{ g cm}^{-3}$.
• Interaction: Lennard-Jones potential, truncated at $R=2.25\sigma$.
• Time Step: $\Delta t = 10^{-14}$ s (780 steps total, covering approximately $7.8 \times 10^{-12}$ s).
• Output Analysis:
  • Radial distribution function $g(r)$.
  • Mean square displacement $\langle r^2 \rangle$.
  • Velocity autocorrelation function $\langle v(0)\cdot v(t) \rangle$.
  • Van Hove space-time correlation functions $G_s(r,t)$ and $G_d(r,t)$.

Results: Validation and Non-Gaussian Diffusion Analysis

• Validation: The calculated pair-distribution function $g(r)$ agreed well with X-ray scattering data from Eisenstein and Gingrich (at $91.8^\circ$K). The self-diffusion constant $D = 2.43 \times 10^{-5} \text{ cm}^2 \text{ sec}^{-1}$ at $94.4^\circ$K matched the experimental value from Naghizadeh and Rice at $90^\circ$K and the same density ($1.374 \text{ g cm}^{-3}$).
• Dynamics: The velocity autocorrelation has a negative region, contradicting simple exponential decay models (Langevin). Its frequency spectrum $f(\omega)$ shows a broad maximum at $\omega \approx 0.25 (k_BT/\hbar)$, reminiscent of solid-like behavior.
• Non-Gaussian Behavior: The self-diffusion function $G_s(r,t)$ attains its maximum departure from a Gaussian shape at about $t \approx 3.0 \times 10^{-12}$ s (with $\langle r^4 \rangle$ departing from its Gaussian value by about 13%), returning to Gaussian form by $\sim 10^{-11}$ s. At that time, the rms displacement ($3.8$ Angstrom) is close to the first-neighbor distance ($3.7$ Angstrom). This indicates that Fickian diffusion is an asymptotic limit and does not apply at short times.
• Fourier Transform Validation: The Fourier transform of $g(r)$ has peaks at $\kappa\sigma = 6.8$, 12.5, 18.5, 24.8, closely matching the X-ray scattering peaks at $\kappa\sigma = 6.8$, 12.3, 18.4, 24.4.
• Temperature Dependence: A second simulation at $130^\circ$K and $1.16 \text{ g cm}^{-3}$ yielded $D = 5.67 \times 10^{-5} \text{ cm}^2 \text{ sec}^{-1}$, compared to the experimental value of $6.06 \times 10^{-5} \text{ cm}^2 \text{ sec}^{-1}$ from Naghizadeh and Rice at $120^\circ$K and $1.16 \text{ g cm}^{-3}$. The paper notes that both calculated values are lower than experiment by about 20%, and suggests that allowing for a softer repulsive part in the interaction potential might reduce this discrepancy.
• Vineyard Approximation: The standard Vineyard convolution approximation ($G_d \approx g * G_s$) produces a too-rapid decay of $G_d(r,t)$ with time. The delayed convolution, matching pairs of $(t’, t)$ in units of $10^{-12}$ sec as (0.2, 0.4), (0.5, 0.8), (1.0, 1.6), (1.5, 2.3), (2.0, 2.9), (2.5, 3.5), provides a substantially better fit.
• Conclusion: Classical N-body dynamics with a truncated pair potential is a sufficient model to reproduce both the structural and dynamical properties of simple liquids.

Reproducibility Details

Data

The simulation uses physical constants for Argon:

Algorithms

Rahman utilized a Predictor-Corrector scheme for solving the second-order differential equations of motion.

Step Size: $\Delta t = 10^{-14}$ sec.

The Algorithm:

1. Predict positions $\bar{\xi}$ at $t + \Delta t$ based on previous steps: $$\bar{\xi}_i^{(n+1)} = \xi_i^{(n-1)} + 2\Delta u \eta_i^{(n)}$$
2. Calculate Forces (Accelerations $\alpha$) using predicted positions.
3. Correct positions and velocities using the trapezoidal rule: $$ \begin{aligned} \eta_i^{(n+1)} &= \eta_i^{(n)} + \frac{1}{2}\Delta u (\alpha_i^{(n+1)} + \alpha_i^{(n)}) \\ \xi_i^{(n+1)} &= \xi_i^{(n)} + \frac{1}{2}\Delta u (\eta_i^{(n+1)} + \eta_i^{(n)}) \end{aligned} $$

Note: The paper compared one vs. two repetitions of the corrector step, finding that two passes improved precision slightly. The results presented in the paper were obtained using two passes.

Models

Interaction Potential: Lennard-Jones 12-6 $$V(r_{ij}) = 4\epsilon \left[ \left(\frac{\sigma}{r_{ij}}\right)^{12} - \left(\frac{\sigma}{r_{ij}}\right)^6 \right]$$

Boundary Conditions: Periodic Boundary Conditions (PBC) in 3 dimensions. When a particle moves out of the box ($x > L$), it re-enters at $x - L$.

Hardware

This is a historical benchmark for computational capability in 1964:

Modern Context: Rahman’s system (864 Argon atoms, LJ-potential) is highly reproducible today and serves as a classic pedagogical exercise. It can be simulated in standard MD frameworks (LAMMPS, OpenMM) in fractions of a second on consumer hardware.

Paper Information

Citation: Rahman, A. (1964). Correlations in the Motion of Atoms in Liquid Argon. Physical Review, 136(2A), A405-A411. https://doi.org/10.1103/PhysRev.136.A405

Publication: Physical Review 1964

@article{rahman1964correlations,
  title={Correlations in the motion of atoms in liquid argon},
  author={Rahman, A.},
  journal={Physical Review},
  volume={136},
  number={2A},
  pages={A405--A411},
  year={1964},
  publisher={APS},
  doi={10.1103/PhysRev.136.A405}
}

Additional Resources:

• Aneesur Rahman - Wikipedia

Discovery (Translational Basis)

This paper applies a computational method (Molecular Dynamics) to observe and characterize a physical phenomenon: the specific diffusion mechanisms of adatom dimers on a crystal surface. It focuses on the “what was found” (simultaneous multiple jumps).

Based on the AI for Physical Sciences Paper Taxonomy, this is best classified as $\Psi_{\text{Discovery}}$ with a minor superposition of $\Psi_{\text{Method}}$ (approximately 80% Discovery, 20% Method). The dominant contribution is the application of computational tools to observe physical phenomena, while secondarily demonstrating MD’s capability for surface diffusion problems in an era when the technique was still developing.

Bridging the Intermediate Temperature Data Gap

The study aims to investigate the behavior of adatom dimers in an intermediate temperature range ($0.3T_m$ to $0.6T_m$). At the time, Field Ion Microscopy (FIM) provided data at low temperatures ($T \le 0.2T_m$), and previous simulations had studied single adatoms on various surfaces including (111), (110), and (100), but not dimers on (111). The authors sought to compare dimer mobility with single adatom mobility on the (111) surface, where single adatoms move almost like free particles.

Observation of Simultaneous Multiple Jumps

The core contribution is the observation of simultaneous multiple jumps for dimers on the (111) surface at intermediate temperatures. The study reveals that:

1. Dimers migrate as a whole entity, with both atoms jumping simultaneously
2. The mobility of dimers (center of mass) is very close to that of single adatoms in this regime.

Molecular Dynamics Simulation Design

The authors performed Molecular Dynamics (MD) simulations of a face-centred cubic (fcc) crystallite:

• System: A single crystallite of 192 atoms bounded by two free (111) surfaces
• Temperature Range: $0.22 \epsilon/k$ to $0.40 \epsilon/k$ (approximately $0.3T_m$ to $0.6T_m$)
• Duration: Integration over 50,000 time steps
• Comparison: Results were compared against single adatom diffusion data and Einstein’s diffusion relation

Outcomes on Mobility and Migration Dynamics

• Mechanism Transition: At low temperatures ($T^\ast=0.22$), diffusion occurs via discrete single jumps where adatoms rotate or extend bonds. At higher temperatures, the “multiple jump” mechanism becomes preponderant.
• Migration Style: The dimer migrates essentially by extending its bond along the $\langle 110 \rangle$ direction.
• Mobility: The diffusion coefficient of dimers is quantitatively similar to single adatoms.
• Qualitative Support: The results support Bonzel’s hypothesis of delocalized diffusion involving energy transfer between translation and rotation. The authors attempted to quantify the coupling using the cross-correlation function:

$$g(t) = C \langle E_T(t) , E_R(t + t’) \rangle$$

where $C$ is a normalization constant, $E_T$ is the translational energy of the center of mass, and $E_R$ is the rotational energy of the dimer. However, the average lifetime of a dimer (2% to 15% of the total calculation time in the studied temperature range) was too short to allow a statistically significant study of this coupling.

• Dimer Concentration: The contribution of dimers to mass transport depends on their concentration. As a first approximation, the dimer concentration is expressed as:

$$C = C_0 \exp\left[\frac{-2E_f - E_d}{k_B T}\right]$$

where $E_f$ is the formation energy of adatoms and $E_d$ is the binding energy of a dimer. If the binding energy is sufficiently strong, dimer contributions should be accounted for even in the intermediate temperature range ($0.3T_m$ to $0.6T_m$).

Reproducibility Details

Data (Simulation Setup)

Because this is an early computational study, “data” refers to the initial structural configuration. The simulation begins with an algorithmically generated generic fcc(111) lattice containing two adatoms as the initial state.

Algorithms

The simulation relies on standard Molecular Dynamics integration techniques. Historical source code is absent. Complete reproducibility is achievable today utilizing modern open-source tools like LAMMPS with standard lj/cut pair styles and NVE/NVT ensembles.

• Integration Scheme: Central difference algorithm (Verlet algorithm)
• Time Step: $\Delta t^\ast = 0.01$ (reduced units)
• Total Steps: 50,000 integration steps
• Dimer Definition: Two adatoms are considered a dimer if their distance $r \le r_c = 2\sigma$

Models (Analytic Potential)

The physics are modeled using a classic Lennard-Jones potential.

Potential Form: (12, 6) Lennard-Jones $$ V(r) = 4\epsilon \left[ \left(\frac{\sigma}{r}\right)^{12} - \left(\frac{\sigma}{r}\right)^6 \right] $$

Parameters (Argon-like):

• $\epsilon/k = 119.5$ K
• $\sigma = 3.4478$ Å
• $m = 39.948$ a.u.
• Cut-off radius: $2\sigma$

Evaluation

Metrics used to quantify the diffusion behavior:

Hardware

• Specifics: Unspecified in the original text.
• Scale: 192 particles simulated for 50,000 steps is extremely lightweight by modern standards. A standard laptop CPU executes this workload in under a second, providing a strong contrast to the mainframe computing resources required in 1984.

Paper Information

Citation: Ghaleb, D. (1984). Diffusion of adatom dimers on (111) surface of face centred crystals: A molecular dynamics study. Surface Science, 137(2-3), L103-L108. https://doi.org/10.1016/0039-6028(84)90515-6

Publication: Surface Science 1984

@article{ghalebDiffusionAdatomDimers1984,
  title = {Diffusion of Adatom Dimers on (111) Surface of Face Centred Crystals: A Molecular Dynamics Study},
  author = {Ghaleb, Dominique},
  year = {1984},
  journal = {Surface Science},
  volume = {137},
  number = {2-3},
  pages = {L103-L108},
  doi = {10.1016/0039-6028(84)90515-6}
}

This video shows an extended Langevin dynamics simulation demonstrating transitions between different basins of the Müller-Brown potential. The trajectory illustrates the particle’s movement between energy minima, highlighting the energy barriers and pathways involved in reactive processes.

Details on the simulation and implementation can be found in the Implementing the Müller-Brown Potential in PyTorch post.

This project implements the classic 2D Müller-Brown potential in PyTorch as a ground-truth testbed for machine-learning-in-molecular-dynamics (ML-MD) work. The potential is a torch.nn.Module that computes forces two ways: a hand-derived analytical gradient (the default, compiled with torch.compile) and torch.autograd.grad (a reference the analytical path is checked against). On an Apple M1 Max, the analytical kernel runs about 4x faster than autograd (3-7x depending on batch size; 100 warm-up iterations, then the median of 5 runs of 1000), because it skips autograd’s graph construction inside the force loop.

The energy is deliberately left uncompiled so that second derivatives (the Hessian via autograd) keep working, since torch.compile does not support double-backward; the force, the hot path, is the compiled function.

Features

• Dual force kernels: a hand-derived analytical gradient (compiled) for fast simulation, and an autograd mode for differentiation and as the correctness reference the analytical path is tested against.
• BAOAB Langevin integrator: the BAOAB splitting scheme (Leimkuhler & Matthews, 2013), which solves the friction-plus-noise step exactly and samples the canonical distribution accurately (exactly so for a harmonic oscillator).
• Device-agnostic: potential, forces, and simulation are plain PyTorch tensor operations that run on CPU or CUDA; the included benchmark measures CPU.
• Modular architecture: physics (MuellerBrownPotential), numerics (LangevinSimulator), visualization, and HDF5 I/O are separated, with a CLI orchestrating demo, single-run, batch, and plot-regeneration modes.

Usage

The package installs editable with uv sync and imports as a normal package:

from muller_brown import MuellerBrownPotential, LangevinSimulator

It provides a fast, differentiable Müller-Brown potential and a Langevin sampler for testing ML-MD algorithms against a known-exact surface.

Results

Architecture

• Physics module: the energy surface is a torch.nn.Module with the potential parameters held as registered buffers, so device and dtype move with the module.
• Analytical force kernel: the analytical Jacobian is implemented directly and compiled with torch.compile(dynamic=True), bypassing autograd-graph construction during long simulations.
• Vectorized execution: kernel operations are vectorized over particles, so an ensemble runs in roughly the same wall time as a single particle (the per-step cost is dominated by the fixed force call and noise draw).
• Device-agnostic: all operations move to CUDA via native tensor handling; the benchmark and tests run on CPU.

Performance

A force-throughput benchmark (analytical vs autograd) across batch sizes from 2 to roughly 50,000 particles, on an Apple M1 Max:

• The analytical kernel is about 4x faster than autograd (3-7x across batch sizes).
• Per-particle force time drops below 1 microsecond at large batch sizes.
• Throughput rises with batch size and saturates for large ensembles.

Validation

The sampler is checked against statistical mechanics, not just run:

• Deterministic tests: the documented minima and saddles have the correct Hessian signatures; the analytical force matches torch.autograd.grad; energy is conserved in the frictionless (NVE) limit; float32 matches float64; and HDF5 round-trips preserve the data.
• Statistical tests: the sampler reproduces equipartition, the harmonic-oscillator distributions, and the Müller-Brown Boltzmann mean energy against a grid-integrated reference; a separate convergence study confirms the integrator’s kinetic-temperature bias vanishes as the timestep squared.

Molecular Dynamics

Langevin simulations on the surface show particle motion within energy basins, thermal fluctuations around the minima, and barrier-crossing transitions between wells, visualized as trajectories on the potential surface.

Simulation Videos

These videos demonstrate Langevin dynamics simulations on the Müller-Brown potential surface:

Related Work

This implementation is documented in detail in:

• Implementing the Müller-Brown Potential in PyTorch
• Basin A Simulation
• Basin B Simulation
• Transition Path Simulation

This video shows Langevin dynamics simulation in Basin MB, the product minimum of the Müller-Brown potential. The particle shows moderate thermal motion around (0.623, 0.028) with intermediate behavior between the deep reactant well and shallow intermediate basin (-108.17 in reduced units).

Details on the simulation and implementation can be found in the Implementing the Müller-Brown Potential in PyTorch post.

This video shows Langevin dynamics simulation in Basin MA, the deep reactant minimum of the Müller-Brown potential. The particle remains tightly confined around (-0.558, 1.442) due to the deep potential well (-146.70 in reduced units) and steep energy barriers.

Details on the simulation and implementation can be found in the Implementing the Müller-Brown Potential in PyTorch post.

This is a method paper with a supporting theoretical component. It introduces a new pre-training framework, DenoiseVAE, that challenges the standard practice of using fixed, hand-crafted noise distributions in denoising-based molecular representation learning.

Motivation: The Inter- and Intra-molecular Variations Problem

The motivation is to create a more physically principled denoising pre-training task for 3D molecules. The core idea of denoising is to learn molecular force fields by corrupting an equilibrium conformation with noise and then learning to recover it. However, existing methods use a single, hand-crafted noise strategy (e.g., Gaussian noise of a fixed scale) for all atoms across all molecules. This is physically unrealistic for two main reasons:

1. Inter-molecular differences: Different molecules have unique Potential Energy Surfaces (PES), meaning the space of low-energy (i.e., physically plausible) conformations is highly molecule-specific.
2. Intra-molecular differences (Anisotropy): Within a single molecule, different atoms have different degrees of freedom. For instance, an atom in a rigid functional group can move much less than one connected by a single, rotatable bond.

The authors argue that this “one-size-fits-all” noise approach leads to inaccurate force field learning because it samples many physically improbable conformations.

Novelty: A Learnable, Atom-Specific Noise Generator

The core novelty is a framework that learns to generate noise tailored to each specific molecule and atom. This is achieved through three key innovations:

1. Learnable Noise Generator: The authors introduce a Noise Generator module (a 4-layer Equivariant Graph Neural Network) that takes a molecule’s equilibrium conformation $X$ as input and outputs a unique, atom-specific Gaussian noise distribution (i.e., a different variance $\sigma_i^2$ for each atom $i$). This directly addresses the issues of PES specificity and force field anisotropy.
2. Variational Autoencoder (VAE) Framework: The Noise Generator (encoder) and a Denoising Module (a 7-layer EGNN decoder) are trained jointly within a VAE paradigm. The noisy conformation is sampled using the reparameterization trick: $$ \begin{aligned} \tilde{x}_i &= x_i + \epsilon \sigma_i \end{aligned} $$
3. Principled Optimization Objective: The training loss balances two competing goals: $$ \begin{aligned} \mathcal{L}_{DenoiseVAE} &= \mathcal{L}_{Denoise} + \lambda \mathcal{L}_{KL} \end{aligned} $$
   • A denoising reconstruction loss ($\mathcal{L}_{Denoise}$) encourages the Noise Generator to produce physically plausible perturbations from which the original conformation can be recovered. This implicitly constrains the noise to respect the molecule’s underlying force fields.
   • A KL divergence regularization term ($\mathcal{L}_{KL}$) pushes the generated noise distributions towards a predefined prior. This prevents the trivial solution of generating zero noise and encourages the model to explore a diverse set of low-energy conformations.

The authors also provide a theoretical analysis showing that optimizing their objective is equivalent to maximizing the Evidence Lower Bound (ELBO) on the log-likelihood of observing physically realistic conformations.

Methodology & Experimental Baselines

The model was pretrained on the PCQM4Mv2 dataset (approximately 3.4 million organic molecules) and then evaluated on a comprehensive suite of downstream tasks to test the quality of the learned representations:

1. Molecular Property Prediction (QM9): The model was evaluated on 12 quantum chemical property prediction tasks for small molecules (134k molecules; 100k train, 18k val, 13k test split). DenoiseVAE achieved state-of-the-art or second-best performance on 11 of the 12 tasks, with particularly significant gains on $C_v$ (heat capacity), indicating better capture of vibrational modes.
2. Force Prediction (MD17): The task was to predict atomic forces from molecular dynamics trajectories for 8 different small molecules (9,500 train, 500 val split). DenoiseVAE was the top performer on 5 of the 8 molecules (Aspirin, Benzene, Ethanol, Naphthalene, Toluene), though it underperformed Frad on Malonaldehyde, Salicylic Acid, and Uracil by significant margins.
3. Ligand Binding Affinity (PDBBind v2019): On the PDBBind dataset with 30% and 60% protein sequence identity splits, the model showed strong generalization, outperforming baselines like Uni-Mol particularly on the more stringent 30% split across RMSE, Pearson correlation, and Spearman correlation.
4. PCQM4Mv2 Validation: DenoiseVAE achieved a validation MAE of 0.0777 on the PCQM4Mv2 HOMO-LUMO gap prediction task with only 1.44M parameters, competitive with models 10-40x larger (e.g., GPS++ at 44.3M params achieves 0.0778).
5. Ablation Studies: The authors analyzed the sensitivity to key hyperparameters, namely the prior’s standard deviation ($\sigma$) and the KL-divergence weight ($\lambda$), confirming that $\lambda=1$ and $\sigma=0.1$ are optimal. Removing the KL term leads to trivial solutions (near-zero noise). An additional ablation on the Noise Generator depth found 4 EGNN layers optimal over 2 layers. A comparison of independent (diagonal) versus non-independent (full covariance) noise sampling showed comparable results, suggesting the EGNN already captures inter-atomic dependencies implicitly.
6. Case Studies: Visualizations of the learned noise variances for different molecules confirmed that the model learns chemically intuitive noise patterns. For example, it applies smaller perturbations to atoms in a rigid bicyclic norcamphor derivative and larger ones to atoms in flexible functional groups of a cyclopropane derivative. Even identical functional groups (e.g., hydroxyl) receive different noise scales in different molecular contexts.

Key Findings on Force Field Learning

• Primary Conclusion: Learning a molecule-adaptive and atom-specific noise distribution is a superior strategy for denoising-based pre-training compared to using fixed, hand-crafted heuristics. This more physically-grounded approach leads to representations that better capture molecular force fields.
• Strong Benchmark Performance: DenoiseVAE achieves best or second-best results on 11 of 12 QM9 tasks, 5 of 8 MD17 molecules, and leads on the stringent 30% LBA split. Performance is mixed on some MD17 molecules (Malonaldehyde, Salicylic Acid, Uracil), where it trails Frad.
• Effective Framework: The proposed VAE-based framework, which jointly trains a Noise Generator and a Denoising Module, is an effective and theoretically sound method for implementing this adaptive noise strategy. The interplay between the reconstruction loss and the KL-divergence regularization is key to its success.
• Limitation and Future Direction: The method is based on classical force field assumptions. The authors note that integrating more accurate force fields represents a promising direction for future work.

Reproducibility Details

Artifacts

Reproducibility Status

• Source Code: The authors have released their code at Serendipity-r/DenoiseVAE on GitHub. No license is specified in the repository.
• Implementation: Hyperparameters and architectures are detailed in the paper’s appendix (A.14), and the repository provides reference implementations.

Data

• Pre-training Dataset: PCQM4Mv2 (approximately 3.4 million organic molecules)
• Property Prediction: QM9 dataset (134k molecules; 100k train, 18k val, 13k test split) for 12 quantum chemical properties
• Force Prediction: MD17 dataset (9,500 train, 500 val split) for 8 different small molecules
• Ligand Binding Affinity: PDBBind v2019 (4,463 protein-ligand complexes) with 30% and 60% sequence identity splits

Algorithms

• Noise Generator: 4-layer Equivariant Graph Neural Network (EGNN) that outputs atom-specific Gaussian noise distributions
• Denoising Module: 7-layer EGNN decoder
• Training Objective: $\mathcal{L}_{DenoiseVAE} = \mathcal{L}_{Denoise} + \lambda \mathcal{L}_{KL}$ with $\lambda=1$
• Noise Sampling: Reparameterization trick with $\tilde{x}_i = x_i + \epsilon \sigma_i$
• Prior Distribution: Standard deviation $\sigma=0.1$

Models

• Model Size: 1.44M parameters total
• Fine-tuning Protocol: Noise Generator discarded after pre-training; only the pre-trained Denoising Module (7-layer EGNN) is retained for downstream fine-tuning
• Optimizer: AdamW with cosine learning rate decay (max LR of 0.0005)
• Batch Size: 128
• System Training: Fine-tuned end-to-end for specific tasks; force prediction involves computing the gradient of the predicted energy

Evaluation

• Ablation Studies: Sensitivity analysis confirmed $\lambda=1$ and $\sigma=0.1$ as optimal hyperparameters; removing the KL term leads to trivial solutions (near-zero noise)
• Noise Generator Depth: 4 EGNN layers outperformed 2 layers across both QM9 and MD17 benchmarks
• Covariance Structure: Full covariance matrix (non-independent noise sampling) yielded comparable results to diagonal variance (independent sampling), likely because the EGNN already integrates neighboring atom information
• O(3) Invariance: The method satisfies O(3) probabilistic invariance, meaning the noise distribution is unchanged under rotations and reflections

Hardware

• GPU Configuration: Experiments conducted on a single RTX A3090 GPU; 6 GPUs with 144GB total memory sufficient for full reproduction
• CPU: Intel Xeon Gold 5318Y @ 2.10GHz

Paper Information

Citation: Liu, Y., Chen, J., Jiao, R., Li, J., Huang, W., & Su, B. (2025). DenoiseVAE: Learning Molecule-Adaptive Noise Distributions for Denoising-based 3D Molecular Pre-training. The Thirteenth International Conference on Learning Representations (ICLR).

Publication: ICLR 2025

@inproceedings{liu2025denoisevae,
  title={DenoiseVAE: Learning Molecule-Adaptive Noise Distributions for Denoising-based 3D Molecular Pre-training},
  author={Yurou Liu and Jiahao Chen and Rui Jiao and Jiangmeng Li and Wenbing Huang and Bing Su},
  booktitle={The Thirteenth International Conference on Learning Representations},
  year={2025},
  url={https://openreview.net/forum?id=ym7pr83XQr}
}

Additional Resources:

• ICLR 2025 poster page
• OpenReview forum
• PDF on OpenReview

The physics of liquid argon is a solved problem. We know the answer.

So, why replicate it in 2025? To apply modern engineering standards to legacy science.

This project served as an exercise in software archaeology: taking a vintage scientific workflow and rebuilding it with a modular Python analysis pipeline. I wanted to see if I could replace Rahman’s “write-once” Fortran mentality with modern reproducibility, type safety, and intelligent caching.

The full source code is available on GitHub. The complete project overview, including analysis results and pipeline architecture, is on the Rahman 1964 Replication project page.

Engineering the Pipeline

The most interesting part of this project isn’t the simulation engine (LAMMPS handles that); it’s the architecture of the analysis suite. MD analysis is computationally expensive ($O(N^2)$), and iterating on plots can be painfully slow if you re-compute trajectory data every time.

Why bother? Don’t modern MD packages come with analysis tools? Well, some say that writing is thinking. Sometimes getting into the weeds of how an algorithm works or an analysis is performed, you gain insights and a deeper understanding that might be obscured by a plug-and-play tool.

Intelligent Caching

I built the argon_sim package with a decorator-based caching layer. The system hashes the source file’s modification time and the function’s arguments to avoid re-calculating the Radial Distribution Function (RDF) or Van Hove correlations on every script run.

@cached_computation("gr")
def compute_radial_distribution(filename: str, dr: float = 0.05):
    # ... expensive O(N^2) distance calculations ...
    return r_values, g_r, density

If I tweak a plot axis, the script runs instantly, loading pre-computed arrays from disk instead of re-running the $O(N^2)$ computation. If I change the simulation trajectory, the cache invalidates automatically.

Vectorization & Memory Management

Rahman likely relied on nested loops. Python is too slow for that. I utilized NumPy broadcasting to vectorize the calculation of atomic displacements.

However, calculating an $864 \times 864$ distance matrix for 5,000 frames consumes significant RAM. I implemented a chunked MSD (Mean Square Displacement) algorithm that processes the trajectory in blocks, balancing vectorization speed with memory constraints. The chunking trades some vectorization speed for a bounded memory footprint, so the analysis is not capped by holding the full distance matrix in RAM.

Reproducibility as a Feature

Academic code is notorious for “it works on my machine.” To combat this, I used uv for dependency management, locking the exact environment state. The entire workflow (from simulation to final figure generation) is abstracted into a Makefile.

# One command to run the physics, analyze data, and generate plots
make workflow

The Simulation: 1964 vs. 2025

I preserved Rahman’s physical parameters exactly to ensure a fair comparison:

• System: 864 Argon atoms
• Potential: Lennard-Jones ($\sigma = 3.4$ Å, $\epsilon/k_B = 120$ K)
• Target: 94.4 K, 1.374 g/cm³

However, I modernized the numerical methods to ensure stability:

The production run lasted 10 ps in the NVE ensemble, generating 5,001 frames. Temperature remained within 1% of target with an RMS fluctuation of 0.0165.

Validation Results

The replication was quantitatively successful. The analysis pipeline faithfully reproduced every key signature of liquid argon.

The Cage Effect

This is the paper’s crown jewel. In a gas, velocity correlations decay exponentially. In a liquid, Rahman discovered that atoms get trapped by their neighbors and bounce back, causing the correlation to go negative.

My simulation captures this minimum at -0.083, matching Rahman’s observation. The Fourier transform of this data (the frequency spectrum) reveals a peak at $\beta \approx 0.25$, physically representing the frequency of atomic collisions within the cage.

Structural Fingerprints

The Radial Distribution Function $g(r)$ and its Fourier transform, the Structure Factor $S(k)$, are the “fingerprints” of a liquid’s structure.

The agreement here is striking. My first peak appeared at 3.82 Å (Rahman: 3.7 Å). The slight discrepancy is likely due to my improved equilibration method, which allowed the system to relax into a more natural liquid state than Rahman’s 1960s hardware allowed.

Diffusion and Non-Gaussian Behavior

By calculating the Mean Square Displacement (MSD), I derived a diffusion coefficient of $D = 2.47 \times 10^{-5}$ cm²/s, which deviates only 2% from Rahman’s reported $2.43 \times 10^{-5}$.

More interestingly, I reproduced the “Non-Gaussian” parameters. Standard diffusion assumes a Gaussian distribution of displacements. Rahman found (and I confirmed) that liquid atoms deviate from this. They exhibit “jump” and “wait” dynamics, a behavior that standard Brownian motion models fail to capture.

Advanced Analysis: Van Hove Functions

Rahman also explored advanced properties like the Van Hove correlation function $G(r,t)$, which describes how liquid structure evolves over time.

At 1.0 ps, the structure remains well-defined with clear shells. By 2.5 ps, it becomes increasingly diffuse. Rahman compared this evolution to theoretical predictions (the Vineyard approximation) and found that theory predicted overly rapid structural decay. My results confirm this finding.

System Validation

Before analyzing physics, basic sanity checks confirmed proper thermal equilibrium.

Mean temperature was 94.73 K (0.33 K off target) with a standard deviation of 1.56 K.

The velocity distribution from 12.9 million velocity components produces a clean Maxwell-Boltzmann distribution, as expected for thermal equilibrium. The distribution widths at various heights closely match Rahman’s results: 1.77, 2.48, and 3.56 compared to his 1.77, 2.52, and 3.52.

Conclusion

Replicating a 60-year-old paper might seem like a solved puzzle, but it teaches a valuable lesson in computational science. Rahman relied on brilliance and raw mathematical intuition because he lacked compute power. Today, pairing modern compute with disciplined software practices makes the same result reproducible and auditable.

Applying modern software engineering (modular architecture, caching, and automated workflows) to classical physics reproduces the past and builds a foundation that makes the next discovery easier, faster, and more reliable.

The quantitative agreement is striking: diffusion coefficients within 2%, structural peaks within 0.1 Å, velocity distributions matching to three significant figures. This level of reproducibility, achieved with completely different hardware and software, validates something fundamental: Rahman’s physical model was remarkably sound, and his computational methodology was scientifically rigorous despite 1960s constraints.

The cage effect, velocity correlations, and structural evolution are fundamental characteristics of how matter behaves at the atomic scale, as relevant today as they were six decades ago.

This project is a “digital restoration” of Aneesur Rahman’s seminal 1964 paper, Correlations in the Motion of Atoms in Liquid Argon. While the physics of liquid argon is a solved problem, the challenge lies in bridging the gap between 1960s mainframe constraints and 2025 software architecture.

I replicated the simulation using LAMMPS and built a Python analysis pipeline to process the trajectory data. The project demonstrates how modern tooling (uv, type hinting, vectorized NumPy) can transform academic “write-once” scripts into a reproducible research toolkit.

Features

The Analysis Pipeline

I architected a modular Python package (argon_sim) designed for performance and maintainability.

• Intelligent Caching System: MD analysis is compute-intensive ($O(N^2)$). I implemented a decorator-based caching layer (@cached_computation) that hashes source file modification times and function arguments. This ensures expensive calculations (like RDF or Van Hove correlations) are only re-run when the underlying trajectory or parameters actually change.
• Vectorization & Optimization: To handle the $N^2$ complexity of pair-wise interactions without C++ extensions, I utilized NumPy broadcasting. For example, the Mean Square Displacement (MSD) calculation is fully vectorized, with a fallback “chunked” implementation to handle memory overflows on smaller machines.
• Modern Python Tooling:
  • Dependency Management: Used uv for deterministic environment locking (sub-second resolution).
  • Type Safety: Fully type-hinted codebase for static analysis compliance.
  • Automation: A Makefile abstracts the workflow (simulation → analysis → figure generation) into single commands (e.g., make figure-5).

The Simulation Strategy

I used LAMMPS for the MD engine but strictly adhered to Rahman’s physical parameters while modernizing the stability mechanisms.

• Integration: Replaced Rahman’s predictor-corrector method with the modern standard Velocity Verlet algorithm (2 fs timestep).
• Equilibration: I implemented a 1 ns NVT equilibration phase (500,000 steps at the 2 fs timestep) to properly melt the FCC crystal structure before the NVE production run.
• Intellectual Honesty: The in.argon script explicitly documents every deviation from the original methodology (e.g., energy minimization) and the justification for ensuring numerical stability.

Usage

The project uses a Makefile to automate the workflow. Run make all to execute the LAMMPS simulation and generate all analysis figures.

Results

The replication achieved high quantitative agreement with the historical data, validating both the simulation parameters and the custom analysis code.

Visual Replication

I used Matplotlib to digitally recreate Rahman’s hand-drawn plots, confirming signatures like the negative region in the Velocity Autocorrelation Function (VACF), which provided the first evidence of the “cage effect” in simple liquids.

Challenges & Learnings

• Unit Hell: Rahman’s paper uses a mix of reduced units and CGS. Mapping these to LAMMPS’s real units required a dedicated constants.py module and rigorous unit testing to prevent dimensional errors.
• Fourier Transforms: Calculating the Structure Factor $S(k)$ from $g(r)$ required implementing a manual 3D Fourier transform for spherical symmetry, as standard FFT packages do not account for the radial shell integration implicit in liquid structure analysis.
• Code as a Liability: Early in the project, I realized that re-running analysis scripts was becoming a bottleneck. This drove the decision to build the caching infrastructure, reinforcing the lesson that investing in developer tooling pays off even in small-scale scientific projects.

Related Work

The full methodology and physics are documented in the companion blog post:

• Replicating Rahman’s 1964 Liquid Argon Simulation

Details on the simulation can be found in the Liquid Argon: LAMMPS Simulation post.

This is a method paper. It addresses a critical disconnect in the evaluation of Machine Learning Interatomic Potentials (MLIPs) and introduces a novel architecture, eSEN, designed based on insights from this analysis. The paper proposes a new standard for evaluating MLIPs beyond simple test-set errors.

The Energy Conservation Gap in MLIP Evaluation

The motivation addresses a well-known but under-addressed problem in the field: improvements in standard MLIP metrics (lower energy/force MAE on static test sets) do not reliably translate to better performance on complex downstream tasks like molecular dynamics (MD) simulations, materials stability prediction, or phonon calculations. The authors seek to understand why this gap exists and how to design models that are both accurate on test sets and physically reliable in practical scientific workflows.

The eSEN Architecture and Continuous Representation

The novelty is twofold, spanning both a conceptual framework for evaluation and a new model architecture:

1. Energy Conservation as a Diagnostic Test: The core conceptual contribution is using an MLIP’s ability to conserve energy in out-of-distribution MD simulations as a crucial diagnostic test. The authors demonstrate that for models passing this test, a strong correlation between test-set error and downstream task performance is restored.

2. The eSEN Architecture: The paper introduces the equivariant Smooth Energy Network (eSEN), designed with specific choices to ensure a smooth and well-behaved Potential Energy Surface (PES):

   • Strictly Conservative Forces: Forces are computed exclusively as the negative gradient of energy ($F = -\nabla E$), using conservative force prediction instead of faster direct-force prediction heads.
   • Continuous Representations: Maintains strict equivariance and smoothness by using equivariant gated non-linearities instead of discretizing spherical harmonic representations during nodewise processing.
   • Smooth PES Construction: Critical design choices include using distance cutoffs, polynomial envelope functions ensuring derivatives go to zero at cutoffs, and limited radial basis functions to avoid overly sensitive PES.

3. Efficient Training Strategy: A two-stage training regimen with fast pre-training using a non-conservative direct-force model, followed by fine-tuning to enforce energy conservation. This captures the efficiency of direct-force training while ensuring physical robustness.

Evaluating OOD Energy Conservation and Physical Properties

The paper presents a comprehensive experimental validation:

1. Ablation Studies on Energy Conservation: MD simulations on out-of-distribution systems (TM23 and MD22 datasets) systematically tested key design choices (direct-force vs. conservative, representation discretization, neighbor limits, envelope functions). This empirically demonstrated which choices lead to energy drift despite negligible impact on test-set MAE.

2. Physical Property Prediction Benchmarks: The eSEN model was evaluated on challenging downstream tasks:

   • Matbench-Discovery: Materials stability and thermal conductivity prediction, where eSEN achieved the highest F1 score among compliant models and excelled at both metrics simultaneously.
   • MDR Phonon Benchmark: Predicting phonon properties that test accurate second and third-order derivatives of the PES. eSEN achieved state-of-the-art results, particularly outperforming direct-force models.
   • SPICE-MACE-OFF: Standard energy and force prediction on organic molecules, demonstrating that physical plausibility design choices enhanced raw accuracy.

3. Correlation Analysis: Explicit plots of test-set energy MAE versus performance on downstream benchmarks showed weak overall correlation that becomes strong and predictive when restricted to models passing the energy conservation test.

Outcomes and Conclusions

• Primary Conclusion: Energy conservation is a critical, practical property for MLIPs. Using it as a filter re-establishes test-set error as a reliable proxy for model development, dramatically accelerating the innovation cycle. Models that are not conservative, even with low test error, are unreliable for many critical scientific applications.

• Model Performance: The eSEN architecture outperforms base models across diverse tasks, from energy/force prediction to geometry optimization, phonon calculations, and thermal conductivity prediction.

• Actionable Design Principles: The paper provides experimentally-validated architectural choices that promote physical plausibility. Seemingly minor details, like how atomic neighbors are selected, can have profound impacts on a model’s utility in simulations.

• Efficient Path to Robust Models: The direct-force pre-training plus conservative fine-tuning strategy offers a practical method for developing physically robust models without incurring the full computational cost of conservative training from scratch.

Reproducibility

Artifacts

Models

The eSEN architecture builds on components from eSCN (Equivariant Spherical Channel Network) and Equiformer, combining them with design choices that prioritize smoothness and energy conservation. The implementation integrates into the standard fairchem Open Catalyst experimental framework.

Layer Structure

• Edgewise Convolution: Uses SO2 convolution layers (from eSCN) with an envelope function applied. Source and target embeddings are concatenated before convolution.
• Nodewise Feed-Forward: Two equivariant linear layers with an intermediate SiLU-based gated non-linearity (from Equiformer).
• Normalization: Equivariant Layer Normalization (from Equiformer).

Smoothness Design Choices

Several architectural decisions distinguish eSEN from prior work:

• No Grid Projection: eSEN performs operations directly in the spherical harmonic space to maintain equivariance and energy conservation, bypassing the projection of spherical harmonics to spatial grids for non-linearity.
• Distance Cutoff for Graph Construction: Uses a strict distance cutoff (6 Å for MPTrj models, 5 Å for SPICE models). Neighbor limits introduce discontinuities that break energy conservation.
• Polynomial Envelope Functions: Ensures derivatives go to zero smoothly at the cutoff radius.

Algorithms

Two-Stage Training (eSEN-30M-MP)

1. Direct-Force Pre-training (60 epochs): Uses DeNS (Denoising Non-equilibrium Structures) to reduce overfitting. This stage is fast because it does not require backpropagation through energy gradients.
2. Conservative Fine-tuning (40 epochs): The direct-force head is removed, and forces are calculated via gradients ($F = -\nabla E$). This enforces energy conservation.

Important: DeNS is used exclusively during the direct-force pre-training stage, with a noising probability of 0.5, a standard deviation of 0.1 Å for the added Gaussian noise, and a DeNS loss coefficient of 10. The fine-tuning strategy reduces the wall-clock time for model training by 40%.

Optimization

• Optimizer: AdamW with cosine learning rate scheduler
• Max Learning Rate: $4 \times 10^{-4}$
• Batch Size: 512 (for MPTrj models)
• Weight Decay: $1 \times 10^{-3}$
• Gradient Clipping: Norm of 100
• Warmup: 0.1 epochs with a factor of 0.2

Loss Function

A composite loss combining per-atom energy MAE, force $L_2$ loss, and stress MAE:

$$ \begin{aligned} \mathcal{L} = \lambda_{\text{e}} \frac{1}{N} \sum_{i=1}^N \lvert E_{i} - \hat{E}_{i} \rvert + \lambda_{\text{f}} \frac{1}{3N} \sum_{i=1}^N \lVert \mathbf{F}_{i} - \hat{\mathbf{F}}_{i} \rVert_2^2 + \lambda_{\text{s}} \lVert \mathbf{S} - \hat{\mathbf{S}} \rVert_1 \end{aligned} $$

For MPTrj-30M, the weighting coefficients are set to $\lambda_{\text{e}} = 20$, $\lambda_{\text{f}} = 20$, and $\lambda_{\text{s}} = 5$.

Data

Training Data

• Inorganic: MPTrj (Materials Project Trajectory) dataset
• Organic: SPICE-MACE-OFF dataset

Test Data Construction

• MPTrj Testing: Since MPTrj lacks an official test split, the authors created a test set using 5,000 random samples from the subsampled Alexandria (sAlex) dataset to ensure fair comparison.
• Out-of-Distribution Conservation Testing:
  • Inorganic: TM23 dataset (transition metal defects). Simulation: 100 ps, 5 fs timestep.
  • Organic: MD22 dataset (large molecules). Simulation: 100 ps, 1 fs timestep.

Hardware

Compute for training operations predominantly utilizes 80GB NVIDIA A100 GPUs.

Inference Efficiency

For a periodic system of 216 atoms on a single A100 (PyTorch 2.4.0, CUDA 12.1, no compile/torchscript), the 2-layer eSEN models achieve approximately 0.4 million steps per day (3.2M parameters) and 0.8 million steps per day (6.5M parameters), comparable to MACE-OFF-L at 0.7 million steps per day.

Evaluation

The paper evaluated eSEN across three major benchmark tasks. Key evaluation metrics included energy MAE (meV/atom), force MAE (meV/Å), stress MAE (meV/Å/atom), F1 score for stability prediction, $\kappa_{\text{SRME}}$ for thermal conductivity, and phonon frequency accuracy.

Ablation Test-Set MAE (Table 1)

Design choices that dramatically affect energy conservation have negligible impact on static test-set MAE, which is precisely why test-set error alone is misleading. All models are 2-layer with 3.2M parameters, $L_{\text{max}} = 2$, $M_{\text{max}} = 2$:

Energy MAE in meV/atom. Force MAE in meV/Å. Stress MAE in meV/Å/atom.

Matbench-Discovery (Tables 2 and 3)

Compliant models (trained only on MPTrj or its subset), unique prototype split:

eSEN-30M-MP excels at both F1 and $\kappa_{\text{SRME}}$ simultaneously, while all previous models only achieve SOTA on one or the other.

Non-compliant models (trained on additional datasets):

The eSEN-30M-OAM model is pre-trained on the OMat24 dataset, then fine-tuned on the subsampled Alexandria (sAlex) dataset and MPTrj dataset.

MDR Phonon Benchmark (Table 4)

Metrics: maximum phonon frequency MAE($\omega_{\text{max}}$) in K, vibrational entropy MAE($S$) in J/K/mol, Helmholtz free energy MAE($F$) in kJ/mol, heat capacity MAE($C_V$) in J/K/mol.

Direct-force models show dramatically worse performance at the standard 0.01 Å displacement (e.g., eqV2-S-DeNS: 280/224/54/94) but improve at larger displacements (0.2 Å: 58/26/8/8), revealing that their PES is rough near energy minima.

SPICE-MACE-OFF (Table 5)

Test set MAE for organic molecule energy/force prediction. Energy MAE in meV/atom, force MAE in meV/Å:

*EscAIP-45M is a direct-force model. eSEN-6.5M outperforms MACE-OFF-L and EscAIP on all test splits. The smaller eSEN-3.2M has inference efficiency comparable to MACE-4.7M while achieving lower MAE.

Why These Design Choices Matter

Bounded Energy Derivatives and the Verlet Integrator

The theoretical foundation for why smoothness matters comes from Theorem 5.1 of Hairer et al. (2003). For the Verlet integrator (the standard NVE integrator), the total energy drift satisfies:

$$ |E(\mathbf{r}_T, \mathbf{a}) - E(\mathbf{r}_0, \mathbf{a})| \leq C \Delta t^2 + C_N \Delta t^N T $$

where $T$ is the total simulation time ($T \leq \Delta t^{-N}$), $N$ is the highest order for which the $N$th derivative of $E$ is continuously differentiable with bounded derivative, and $C$, $C_N$ are constants independent of $T$ and $\Delta t$. The first term is a time-independent fluctuation of $O(\Delta t^2)$; the second term governs long-term conservation. This means the PES must be continuously differentiable to high order, with bounded derivatives, for energy conservation in long-time simulations.

Architectural Choices That Break Conservation

The authors provide theoretical justification for why specific architectural choices break energy conservation:

• Max Neighbor Limit (KNN): Introduces discontinuity in the PES. If a neighbor at distance $r$ moves to $r + \epsilon$ and drops out of the top-$K$, the energy changes discontinuously.
• Grid Discretization: Projecting spherical harmonics to a spatial grid introduces discretization errors in energy gradients that break conservation. This can be mitigated with higher-resolution grids but not eliminated.
• Direct-Force Prediction: Imposes no mathematical constraint that forces must be the gradient of an energy scalar field. In other words, $\nabla \times \mathbf{F} \neq 0$ is permitted, violating the requirement for a conservative force field.

Displacement Sensitivity in Phonon Calculations

An important empirical finding concerns how displacement values affect phonon predictions. Conservative models (eSEN, MACE) show convergent phonon band structures as displacement decreases toward zero. In contrast, direct-force models (eqV2-S-DeNS) fail to converge, exhibiting missing acoustic branches and spurious imaginary frequencies at small displacements. While direct-force models achieve competitive thermodynamic property accuracy at large displacements (0.2 Å), this is deceptive: the underlying phonon band structures remain inaccurate, and the apparent accuracy comes from Boltzmann-weighted integrals smoothing over errors.

Paper Information

Citation: Fu, X., Wood, B. M., Barroso-Luque, L., Levine, D. S., Gao, M., Dzamba, M., & Zitnick, C. L. (2025). Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction. Proceedings of the 42nd International Conference on Machine Learning (ICML), PMLR 267:17875–17893.

Publication: ICML 2025 (Spotlight)

@inproceedings{fu2025learning,
  title={Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction},
  author={Fu, Xiang and Wood, Brandon M. and Barroso-Luque, Luis and Levine, Daniel S. and Gao, Meng and Dzamba, Misko and Zitnick, C. Lawrence},
  booktitle={Proceedings of the 42nd International Conference on Machine Learning},
  series={Proceedings of Machine Learning Research},
  volume={267},
  pages={17875--17893},
  publisher={PMLR},
  year={2025}
}

Additional Resources:

• ICML 2025 poster page
• OpenReview forum
• PDF on OpenReview
• OMAT24 model on Hugging Face
• Code on GitHub (fairchem)

This is a Systematization paper. It systematically catalogs the exact failure modes of existing non-conservative force approaches, quantifies them with a new diagnostic metric, and proposes a hybrid Multiple Time-Stepping solution combining the speed benefits of direct force prediction with the physical correctness of conservative models.

Motivation: The Speed-Accuracy Trade-off in ML Force Fields

Many recent machine learning interatomic potential (MLIP) architectures predict forces directly ($F_\theta(r)$). This “non-conservative” approach avoids the computational overhead of automatic differentiation, yielding faster inference (typically 2-3x speedup) and faster training (up to 3x). However, it sacrifices energy conservation and rotational constraints, potentially destabilizing molecular dynamics simulations. The field lacks rigorous quantification of when this trade-off breaks down and how to mitigate the failures.

Novelty: Jacobian Asymmetry and Hybrid Architectures

Four key contributions:

1. Jacobian Asymmetry Metric ($\lambda$): A quantitative diagnostic for non-conservation. Since conservative forces derive from a scalar field, their Jacobian (the Hessian of energy) must be symmetric. The normalized norm of the antisymmetric part quantifies the degree of violation: $$ \lambda = \frac{|| \mathbf{J}_{\text{anti}} ||_F}{|| \mathbf{J} ||_F} $$ where $\mathbf{J}_{\text{anti}} = (\mathbf{J} - \mathbf{J}^\top)/2$. Measured values range from $\lambda \approx 0.004$ (PET-NC) to $\lambda \approx 0.032$ (SOAP-BPNN-NC), with ORB at 0.015 and EquiformerV2 at 0.017. Notably, the pairwise $\lambda_{ij}$ approaches 1 at large interatomic distances, meaning non-conservative artifacts disproportionately affect long-range and collective interactions.

2. Systematic Failure Mode Catalog: First comprehensive demonstration that non-conservative models cause runaway heating in NVE ensembles (temperature drifts of ~7,000 billion K/s for PET-NC and ~10x larger for ORB) and equipartition violations in NVT ensembles where different atom types equilibrate to different temperatures, a physical impossibility.

3. Theoretical Analysis of Force vs. Energy Training: Force-only training overemphasizes high-frequency vibrational modes because force labels carry per-atom gradients that are dominated by stiff, short-range interactions. Energy labels provide a more balanced representation across the frequency spectrum. Additionally, conservative models benefit from backpropagation extending the effective receptive field to approximately 2x the interaction cutoff, while direct-force models are limited to the nominal cutoff radius.

4. Hybrid Training and Inference Protocol: A practical workflow that combines fast direct-force prediction with conservative corrections:

   • Training: Pre-train on direct forces, then fine-tune on energy gradients (2-4x faster than training conservative models from scratch)
   • Inference: Multiple Time-Stepping (MTS) where fast non-conservative forces are periodically corrected by slower conservative forces

Methodology: Systematic Failure Mode Analysis

The evaluation systematically tests multiple state-of-the-art models across diverse simulation scenarios:

Models tested:

• PET-C/PET-NC (Point Edge Transformer, conservative and non-conservative variants)
• PET-M (hybrid variant jointly predicting both conservative and non-conservative forces)
• ORB-v2 (non-conservative, trained on Alexandria/MPtrj)
• EquiformerV2 (non-conservative equivariant Transformer)
• MACE-MP-0 (conservative message-passing)
• SevenNet (conservative message-passing)
• SOAP-BPNN-C/SOAP-BPNN-NC (descriptor-based baseline, both conservative and non-conservative variants)

Test scenarios:

1. NVE stability tests on bulk liquid water, graphene, amorphous carbon, and FCC aluminum
2. Thermostat artifact analysis with Langevin and GLE thermostats
3. Geometry optimization on water snapshots and QM9 molecules using FIRE and L-BFGS
4. MTS validation on OC20 catalysis dataset
5. Species-resolved temperature measurements for equipartition testing

Key metrics:

• Jacobian asymmetry ($\lambda$)
• Kinetic temperature drift in NVE
• Velocity-velocity correlations
• Radial distribution functions
• Species-resolved temperatures
• Inference speed benchmarks

Results: Simulation Instability and Hybrid Solutions

Purely non-conservative models are unsuitable for production simulations due to uncontrollable unphysical artifacts that no thermostat can correct. Key findings:

Performance failures:

• Non-conservative models exhibited catastrophic temperature drift in NVE simulations: ~7,000 billion K/s for PET-NC and ~70,000 billion K/s for ORB, with EquiformerV2 comparable to PET-NC
• Strong Langevin thermostats ($\tau=10$ fs) damped diffusion by ~5x, negating the speed benefits of non-conservative models
• Advanced GLE thermostats also failed to control non-conservative drift (ORB reached 1181 K vs. 300 K target)
• Equipartition violations: under stochastic velocity rescaling, O and H atoms equilibrated at different temperatures. For ORB, H atoms reached 336 K and O atoms 230 K against a 300 K target. For PET-NC, deviations were smaller but still significant (H at 296 K, O at 310 K).
• Geometry optimization was more fragile with non-conservative forces: inaccurate NC models (SOAP-BPNN-NC) failed catastrophically, while more accurate ones (PET-NC) could converge with FIRE but showed large force fluctuations with L-BFGS. Non-conservative models consistently had lower success rates across water and QM9 benchmarks.

Hybrid solution success:

• MTS with non-conservative forces corrected every 8 steps ($M=8$) achieved conservative stability with only ~20% overhead compared to a purely non-conservative trajectory. Results were essentially indistinguishable from fully conservative simulations. Higher stride values ($M=16$) became unstable due to resonances between fast degrees of freedom and integration errors.
• Conservative fine-tuning achieved the accuracy of from-scratch training in about 1/3 the total training time (2-4x resource reduction)
• Validated on OC20 catalysis benchmark

Scaling caveat: The authors note that as training datasets grow and models become more expressive, non-conservative artifacts should diminish because accurate models naturally exhibit less non-conservative behavior. However, they argue the best path forward is hybrid approaches rather than waiting for scale to solve the problem.

Recommendation: The optimal production path is hybrid architectures using direct forces for acceleration (via MTS and pre-training) while anchoring models in conservative energy surfaces. This captures computational benefits without sacrificing physical reliability.

Reproducibility Details

Data

Primary training/evaluation:

• Bulk Liquid Water (Cheng et al., 2019): revPBE0-D3 calculations with over 250,000 force/energy targets, chosen for rigorous thermodynamic testing

Generalization tests:

• Graphene, amorphous carbon, FCC aluminum (tested with general-purpose foundation models)

Benchmarks:

• QM9: Geometry optimization tests
• OC20 (Open Catalyst): Oxygen on alloy surfaces for MTS validation

All datasets publicly available through cited sources.

Models

Point Edge Transformer (PET) variants:

• PET-C (Conservative): Forces via energy backpropagation
• PET-NC (Non-Conservative): Direct force prediction head, slightly higher parameter count
• PET-M (Hybrid): Jointly predicts both conservative and non-conservative forces, accuracy within ~10% of the best single-task models

Baseline comparisons:

Training details:

• Loss functions: PET-C uses joint Energy + Force $L^2$ loss; PET-NC uses Force-only $L^2$ loss
• Fine-tuning protocol: PET-NC converted to conservative via energy head fine-tuning
• MTS configuration: Non-conservative forces with conservative corrections every 8 steps ($M=8$)

Evaluation

Metrics & Software: Molecular dynamics evaluations were performed using i-PI, while geometry optimizations used ASE (Atomic Simulation Environment). Note that primary code reproducibility is provided via an archived Zenodo snapshot; the authors did not link a live, public GitHub repository.

1. Jacobian asymmetry ($\lambda$): Quantifies non-conservation via antisymmetric component
2. Temperature drift: NVE ensemble stability
3. Velocity-velocity correlation ($\hat{c}_{vv}(\omega)$): Thermostat artifact detection
4. Radial distribution functions ($g(r)$): Structural accuracy
5. Species-resolved temperature: Equipartition testing
6. Inference speed: Wall-clock time per MD step

Key results:

Thermostat artifacts:

• Langevin ($\tau=10$ fs) dampened diffusion by ~5x (weaker coupling at $\tau=100$ fs reduced diffusion by ~1.5x)
• GLE thermostats also failed to control non-conservative drift
• Equipartition violations under SVR: ORB showed H at 336 K and O at 230 K (target 300 K); PET-NC showed smaller but significant species-resolved deviations

Optimization failures:

• Non-conservative models showed lower geometry optimization success rates across water and QM9 benchmarks, with inaccurate NC models failing catastrophically

Hardware

Compute resources:

• Training: From-scratch baseline models were trained using 4x Nvidia H100 GPUs (over a duration of around two days).
• Fine-Tuning: Conservative fine-tuning was performed using a single (1x) Nvidia H100 GPU for a duration of one day.
• This hybrid fine-tuning approach achieved a 2-4x reduction in computational resources compared to training conservative models from scratch.

Reproduction resources:

Paper Information

Citation: Bigi, F., Langer, M. F., & Ceriotti, M. (2025). The dark side of the forces: assessing non-conservative force models for atomistic machine learning. Proceedings of the 42nd International Conference on Machine Learning, PMLR 267.

Publication: ICML 2025

@inproceedings{bigi2025dark,
  title={The dark side of the forces: assessing non-conservative force models for atomistic machine learning},
  author={Bigi, Filippo and Langer, Marcel F and Ceriotti, Michele},
  booktitle={Proceedings of the 42nd International Conference on Machine Learning},
  series={Proceedings of Machine Learning Research},
  volume={267},
  address={Vancouver, Canada},
  year={2025}
}

Additional Resources:

• ICML 2025 poster page
• PDF on OpenReview
• Zenodo repository
• MTS Inference Tutorial
• Conservative Fine-Tuning Tutorial

This is a foundational method paper that introduces a new class of semi-empirical, many-body interatomic potential: the Embedded-Atom Method (EAM). It is designed for large-scale atomistic simulations of metallic systems, bridging the gap between computationally cheap (but physically limited) pair potentials and accurate (but expensive) quantum mechanical methods. The EAM achieves pair-potential speed while incorporating many-body physics inspired by density functional theory.

Motivation: The Geometric Limits of Pair Potentials

The authors sought to overcome the limitations of pair potentials (the dominant method of the time), which failed in three key areas:

• Elastic Anisotropy: Pair potentials enforce the Cauchy relation ($C_{12} = C_{44}$), which is violated by most transition metals.
• Volume Ambiguity: Pair potentials require a volume-dependent energy term, making them impossible to use accurately on surfaces or cracks where local volume is undefined.
• Chemical Incompatibility: Pair potentials cannot model chemically active impurities like Hydrogen.

First-principles quantum mechanical methods (e.g., band theory) are limited by basis-set size and periodicity requirements, making them impractical for the large systems (thousands of atoms) needed to study defects, surfaces, and mechanical properties.

The goal was to create a new model that bridges this gap in accuracy and computational cost.

Core Innovation: The Embedding Energy Function

The EAM postulates that the energy of an atom is determined by the local electron density of its neighbors. The total energy is:

$$E_{tot} = \sum_{i} F_i(\rho_{h,i}) + \frac{1}{2}\sum_{i \neq j} \phi_{ij}(R_{ij})$$

• $F_i(\rho_{h,i})$ (Embedding Energy): The energy required to embed atom $i$ into the background electron density $\rho$ provided by its neighbors. This term is non-linear and captures many-body effects.
• $\phi_{ij}$ (Pair Potential): A short-range electrostatic repulsion between cores.
• $\rho_{h,i}$ (Host Density): Approximated as a linear superposition of atomic densities: $\rho_{h,i} = \sum_{j \neq i} \rho^a_j(R_{ij})$.

The key innovations are:

1. The Embedding Energy: Each atom $i$ contributes an energy $F_i$ which is a non-linear function of the local electron density $\rho_{h,i}$ it is embedded in. This density is approximated as a simple linear superposition of the atomic electron densities of all its neighbors. This term captures the crucial many-body effects of metallic bonding.
2. A Redefined Pair Potential: A short-range, two-body potential $\phi_{ij}$ is retained, but it primarily models the electrostatic core-core repulsion.
3. Elimination of the “Volume” Problem: Because the embedding energy depends on the local electron density (a quantity that is always well-defined, even at a surface or a crack tip), the method circumvents the ambiguities of volume-dependent pair potentials.
4. Intrinsic Many-Body Nature: The non-linearity of the embedding function $F(\rho)$ naturally accounts for why chemically active impurities (like hydrogen) cannot be described by pair potentials and correctly breaks the Cauchy relation for elastic constants.

Experimental Design: Robust Parameter Validation

The authors validated EAM through a rigorous split between parameterization data and prediction tasks:

Fitting Data (Bulk Properties Only):

The model parameters were fitted exclusively to these experimental values for Ni and Pd:

• Lattice constant ($a_0$)
• Elastic constants ($C_{11}, C_{12}, C_{44}$)
• Sublimation energy ($E_s$)
• Vacancy-formation energy ($E^F_{1V}$)
• Hydrogen heat of solution (for fitting H parameters)

Validation Tests (No Further Fitting):

The model was then evaluated on its ability to predict these properties without any additional parameter adjustments:

• Surface Relaxations: Ni(110) surface contraction
• Surface Energy: Ni(100) surface energy
• Hydrogen Migration: H migration energy in Pd
• Fracture Mechanics: Hydrogen embrittlement in Ni slabs

Results: Extending Predictive Power to Surfaces and Defects

1. Many-Body Physics: The embedding function $F(\rho)$ successfully captures the volume-dependence of metallic cohesion, fixing the “Cauchy discrepancy” inherent in pair potentials.
2. Surface Properties: A single set of functions, fitted only to bulk data, correctly reproduces surface relaxations within 0.1 Å of experiment across three faces (100), (110), and (111) for Ni. The Ni(100) surface energy (1550 erg/cm²) compares well with the measured crystal-vapor average (1725 erg/cm²).
3. Hydrogen in Bulk: The method predicts H migration energy in Pd as 0.26 eV, matching experiment exactly. Hydride lattice expansions are also well reproduced: 4.5% for NiH (experiment: 5%) and 4% for PdH (experiment: 3.5% for PdH$_{0.6}$).
4. Hydrogen on Surfaces: Calculated adsorption sites on all three Ni and Pd faces agree with experimentally determined sites. Adsorption energies on Ni surfaces are systematically about 0.25 eV too low, while on Pd surfaces the error is much smaller (about 0.05 eV too high on average).
5. Fracture Mechanics: Static fracture calculations on Ni slabs demonstrate brittle fracture behavior and show that hydrogen lowers the fracture stress, providing a qualitative model of hydrogen embrittlement.

Limitations

The authors acknowledge several limitations:

• The functions $F$ and $\phi$ are not uniquely determined by the empirical fitting procedure. The short-range pair potential (restricted to first neighbors in fcc metals) may not be the best choice for all crystal structures.
• The choice of hydrogen embedding function (Puska et al. vs. Norskov’s corrected function) remains undecided and may affect hydrogen binding energies.
• The fracture calculations are static, and dynamical effects and plasticity play important roles in real fracture that are not captured.
• The method has only been demonstrated for fcc metals (Ni and Pd). Extension to bcc metals and other crystal structures requires further investigation.

Reproducibility Details

Algorithms

To replicate the method, three specific algorithmic definitions are needed:

1. Atomic Density Construction: The electron density $\rho^a(r)$ is a weighted sum of Hartree-Fock $s$ and $d$ orbital densities (from Clementi & Roetti tables), controlled by a parameter $N_s$ (the number of s-like electrons): $$\rho^a(r) = N_s\rho_s^a(r) + (N-N_s)\rho_d^a(r)$$ For Ni, $N_s = 0.85$; for Pd, $N_s = 0.65$ (fitted to H solution heat).

2. Pair Potential Form: The short-range pair interaction derives from an effective charge function $Z(r)$ to handle core repulsion: $$\phi_{ij}(r) = \frac{Z_i(r)Z_j(r)}{r}$$ Splines for $Z(r)$ are provided in Table II.

3. Analytic Forces: Because embedding energy depends on neighbor density, the force calculation is many-body: $$\vec{f}_{k} = -\sum_{j(\neq k)} (F’_{k} \rho’_{j} + F’_{j} \rho’_{k} + \phi’_{jk}) \vec{r}_{jk}$$

Models

The functions $F(\rho)$ and $\phi(r)$ are modeled using cubic splines, with parameters fitted to reproduce bulk experimental constants. The embedding function $F(\rho)$ is constrained to have a single minimum and to be linear at high densities, matching the qualitative form of the first-principles calculations by Puska et al. Energy minimization uses the conjugate gradients technique. The paper explicitly lists spline knots, coefficients, and cutoffs in Tables II and IV, making the method fully reproducible.

Evaluation

Fitting Data (Used for Parameterization):

Bulk experimental properties for Ni and Pd only:

• Lattice constant ($a_0$)
• Elastic constants ($C_{11}, C_{12}, C_{44}$)
• Sublimation energy ($E_s$)
• Vacancy-formation energy ($E^F_{1V}$)
• Hydrogen heat of solution (for fitting H parameters)

Validation Results (Predictions Without Further Fitting):

Paper Information

Citation: Daw, M. S., & Baskes, M. I. (1984). Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals. Physical Review B, 29(12), 6443-6453. https://doi.org/10.1103/PhysRevB.29.6443

Publication: Physical Review B, 1984

@article{daw1984embedded,
  title={Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals},
  author={Daw, Murray S and Baskes, Mike I},
  journal={Physical Review B},
  volume={29},
  number={12},
  pages={6443--6453},
  year={1984},
  publisher={APS},
  doi={10.1103/PhysRevB.29.6443}
}

Additional Resources:

• EAM Review (1993)
• EAM User Guide (1994)
• NIST Interatomic Potentials Repository

This is a Method paper that introduces a novel computational technique for Monte Carlo simulations. It presents Umbrella Sampling, an importance sampling approach that uses non-physical distributions to calculate free energy differences in molecular systems.

The Sampling Gap in Phase Transitions

The paper addresses the failure of conventional Boltzmann-weighted Monte Carlo to estimate free energy differences.

• The Problem: Free energy depends on the integral of configurations that are rare in the reference system. In a standard simulation, the relevant probability density $f_0(\Delta U^*)$ is too small to be sampled accurately by conventional Boltzmann-weighted Monte Carlo.
• Phase Transitions: Conventional “thermodynamic integration” fails near phase transitions because it requires a path of integration where ensemble averages can be reliably measured, which is difficult in unstable regions.

Bridging States with Non-Physical Distributions

The authors introduce a non-physical distribution $\pi(q^N)$ to bridge the gap between a reference system (0) and a system of interest (1).

• Arbitrary Weights: They generate a Markov chain with a limiting distribution $\pi(q^N)$ that differs from the Boltzmann distribution of either system. This distribution is written as $\pi(q’^N) = w(q’^N) \exp(-U_0(q’^N)/kT_0) / Z$, where $w(q^N) = W(\Delta U^*)$ is a weighting function chosen to favor configurations with values of $\Delta U^*$ important to the free-energy integral.
• Reweighting Formula: The unbiased average of any property $\theta$ is recovered via the ratio of biased averages:

$$\langle\theta\rangle_{0}=\frac{\langle\theta/w\rangle_{w}}{\langle1/w\rangle_{w}}$$

• Overlap: The method allows sampling a range of $\Delta U^*$ up to three times that of a conventional Monte Carlo experiment, enabling accurate determination of values of $f_0(\Delta U^*)$ as small as $10^{-8}$. If a single weight function cannot span the entire gap, additional overlapping umbrella-sampling experiments are carried out with different weighting functions exploring successively overlapping ranges of $\Delta U^*$.

Validation on Lennard-Jones Fluids

The authors validated Umbrella Sampling using Monte Carlo simulations of model fluids.

Experimental Setup

• System Specifications: The study used a Lennard-Jones (LJ) fluid and an inverse-12 “soft-sphere” fluid.
• System Size: Simulations were primarily performed with $N=32$ particles, with some validation runs at $N=108$ particles to check for size dependence.
• State Points: Calculations covered a wide range of densities ($N\sigma^3/V = 0.50$ to $0.85$) and temperatures ($kT/\epsilon = 0.7$ to $2.8$), including the gas-liquid coexistence region.

Baselines

• Baselines: Results were compared to thermodynamic integration data from Hansen, Levesque, and Verlet.
• Quantitative Success:
  • Agreement: The free energy estimates agreed with pressure integration results to within statistical uncertainties (e.g., at $kT/\epsilon=1.35$, Umbrella Sampling gave -3.236 vs. Conventional -3.25).
  • Precision: Free energy differences were obtained with high precision ($\pm 0.005 NkT$ for $N=108$).
  • Efficiency: A single umbrella run could replace the “numerous runs” required for conventional $1/T$ integrations.

Temperature Scaling via Reweighting

When the reference system has the same internal energy function as the system of interest (i.e., the same fluid at a different temperature), the free-energy expression simplifies to:

$$\frac{A(T)}{kT} = \frac{A(T_0)}{kT_0} - \ln \int f_0(U) \exp\left[-U\left(\frac{1}{kT} - \frac{1}{kT_0}\right)\right] dU$$

This is especially useful because a single determination of $f_0(U)$ over a wide energy range gives the free energy over a whole range of temperatures simultaneously. For 32 Lennard-Jones particles, only two umbrella-sampling experiments are needed to span the temperature range from the triple point ($kT/\epsilon = 0.7$) to twice the critical temperature ($kT/\epsilon = 2.8$). For 108 particles, four experiments suffice.

Mapping the Liquid-Gas Free Energy Surface

• Methodological Utility: The method successfully mapped the free energy of the LJ fluid across the liquid-gas transition, a region where conventional methods face convergence problems.
• N-Dependence: Comparison between $N=32$ and $N=108$ showed no statistically significant size dependence for free energy differences, suggesting small systems are sufficient for these estimates.
• Comparison with Gosling-Singer Method: The paper contrasts its results with free energies derived from Gosling and Singer’s entropy estimation technique, finding discrepancies as large as $0.4N\epsilon$ (a 20% error in the nonideal entropy), equivalent to overestimating the configurational integral of a 108-particle system by a factor of $10^{16}$.
• Generality: While demonstrated on energy ($U$), the authors note the weighting function $w$ can be any function of the coordinates, generalizing the technique beyond simple free energy differences.

Reproducibility

This 1977 paper predates modern code-sharing practices, and no source code or data files are publicly available. However, the paper provides sufficient algorithmic detail for reimplementation:

• Constructing $W$: The paper does not derive $W$ analytically. It uses a trial-and-error procedure: start with a short Boltzmann-weighted experiment, then broaden the distribution in stages through short test runs, adjusting weights to flatten the probability density $f_w(\Delta U^*)$. The paper acknowledges this requires “interaction between the trial computer results and human judgment.”
• Specific Weights: Table I provides the exact numerical weights used for the 32-particle soft-sphere experiment at $N\sigma^3/V = 0.85$, $kT/\epsilon = 2.74$, with values spanning from $W=1{,}500{,}000$ at the lowest energies down to $W=1.0$ at the center and back up to $W=16.0$ at the highest energies.
• Potentials: The Lennard-Jones and inverse-twelve potentials are fully specified (Eqs. 8 and 9).
• State Points: Densities and temperatures are enumerated in Tables II and III.
• Block Averaging: Errors were estimated by treating sequences of $m$ steps as independent samples, where $m$ is determined by increasing block size until no systematic trends can be detected in either the average or the standard deviation of the mean.

Paper Information

Citation: Torrie, G. M., & Valleau, J. P. (1977). Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling. Journal of Computational Physics, 23(2), 187-199. https://doi.org/10.1016/0021-9991(77)90121-8

Publication: Journal of Computational Physics, 1977

@article{torrie1977nonphysical,
  title={Nonphysical sampling distributions in Monte Carlo free-energy estimation: Umbrella sampling},
  author={Torrie, Glenn M and Valleau, John P},
  journal={Journal of Computational Physics},
  volume={23},
  number={2},
  pages={187--199},
  year={1977},
  publisher={Elsevier},
  doi={10.1016/0021-9991(77)90121-8}
}

In computer vision or scientific computing, a common problem frequently arises: given two sets of points, what is the optimal rigid body transformation for their alignment? The Kabsch algorithm provides a nice solution.

What are some concrete situations where this crops up?

• Molecular Dynamics: Your points are a set of atoms (with physically relevant types), and you want to compare two molecular conformations. Are they the same structure with minor noise or rotation? Or are they different conformations, like a different folding of a protein? This is especially helpful when applying generative models to chemical structures. For example, if you are building a 3D Molecular VAE in PyTorch or working with Flow Matching models, Kabsch alignment ensures your generative loss function remains rotationally invariant.
• Computer Vision: You have two point clouds from 3D scans of an object taken from different angles. You want to align them to reconstruct the full shape. Or perhaps you’re generating 3D shapes from 2D images and need to compare the generated shape to a ground truth scan. Anytime a 3D system is represented as a point cloud, the Kabsch algorithm can help with alignment.

Of course, existing libraries implement this algorithm. However, often I find it beneficial to implement algorithms from scratch to build intuition. Furthermore, modern machine learning applications require automatic differentiation, so we will implement the algorithm in PyTorch, TensorFlow, and JAX.

Below, we’ll cover the math behind the Kabsch algorithm (and its scaling variant, the Kabsch-Umeyama algorithm) and provide complete, differentiable implementations in NumPy, PyTorch, TensorFlow, and JAX, demonstrating both single-pair and batched computations for ML applications.

The Math

Let’s say we have two sets of paired points, $P={\mathbf{p}_i} \in \mathbb{R}^{N \times D}$ and $Q={\mathbf{q}_i} \in \mathbb{R}^{N \times D}$, for $i = 1, \dots, N$ (where $D$ is the dimensionality and $N$ is the number of points). We want to find a translation vector $\mathbf{t}$ and rotation matrix $R$ to transform $P$ to align with $Q$.

The optimization problem is:

$$ \min_{\mathbf{t}, \ R} \mathcal{L}(\mathbf{t}, R) = \frac{1}{2} \sum_{i=1}^N | \mathbf{q}_i - (R\mathbf{p}_i + \mathbf{t}) |^2 $$

where $\mathbf{t}^\ast \in \mathbb{R}^D$ and $R^\ast \in \mathbb{R}^{D \times D}$ are the optimal translation and rotation.

Often we use a weighted version with weights $w_i$ (e.g., atomic masses in molecular dynamics):

$$ \min_{\mathbf{t}, \ R} \mathcal{L}(\mathbf{t}, R) = \frac{1}{2} \sum_{i=1}^N w_i | \mathbf{q}_i - (R\mathbf{p}_i + \mathbf{t}) |^2 $$

The Translation

The translation and rotation are coupled, but they separate cleanly once we work in centroid-centered coordinates. Compute the centroids (averages) of both point sets:

$$ \bar{\mathbf{p}} = \frac{1}{N} \sum_{i=1}^N \mathbf{p}_i \quad \text{and} \quad \bar{\mathbf{q}} = \frac{1}{N} \sum_{i=1}^N \mathbf{q}_i $$

For any fixed rotation $R$, the translation that minimizes $\mathcal{L}$ is found by setting $\partial \mathcal{L} / \partial \mathbf{t} = 0$. It maps the rotated source centroid onto the target centroid:

$$ \mathbf{t} = \bar{\mathbf{q}} - R\bar{\mathbf{p}} $$

A tempting shortcut is to write $\mathbf{t} = \bar{\mathbf{q}} - \bar{\mathbf{p}}$, but that is only correct when $R = I$. In general the translation depends on the rotation, so we compute it after solving for $R$. Substituting this optimal $\mathbf{t}$ back into the objective cancels the centroids and leaves a rotation-only problem in the centered coordinates $\mathbf{p}_i^\prime = \mathbf{p}_i - \bar{\mathbf{p}}$ and $\mathbf{q}_i^\prime = \mathbf{q}_i - \bar{\mathbf{q}}$:

$$ \mathcal{L}(R) = \frac{1}{2} \sum_{i=1}^N | \mathbf{q}_i^\prime - R\mathbf{p}_i^\prime |^2 $$

which is what the next section solves.

The Rotation Matrix

We now minimize $\mathcal{L}(R)$ over rotations, using the centered points $\mathbf{p}_i^\prime$ and $\mathbf{q}_i^\prime$ from above. Compute the cross-covariance matrix between the centered sets:

$$ C = P^{\prime T} Q^\prime = \sum_{i=1}^N \mathbf{p}_i^{\prime T} \mathbf{q}_i^{\prime} \in \mathbb{R}^{D \times D} $$

This is a fairly lightweight operation since $D$ is typically small (e.g., 3 for 3D points), even if $N$ is large.

With $C$ in hand, we want to compute its Singular Value Decomposition (SVD):

$$ C = U \Sigma V^T $$

This operation is computationally expensive. It scales cubically with $D$ (i.e., $O(D^3)$). However, since we’re often interested in cases where $D$ is small (e.g., 2D or 3D points), this is manageable.

Next, we check for improper rotations (i.e., reflections) and correct for them where necessary:

$$ d = \text{sign}(\det(V U^T)) $$

If $d = -1$, we need to flip the last column of $V$ in the final rotation matrix.

Let $B = \text{diag}(1, 1, d)$. The optimal rotation matrix comes out:

$$ R^\ast = V B U^T $$

Summary

In a nutshell, the Kabsch algorithm boils down to:

1. Compute centroids of $P$ and $Q$ ($\bar{\mathbf{p}}$ and $\bar{\mathbf{q}}$)
2. Center both point sets by subtracting centroids: $P^\prime$ and $Q^\prime$
3. Compute cross-covariance matrix $C = P^{\prime T} Q^\prime$
4. Compute SVD: $C = U \Sigma V^T$ (expensive step)
5. Compute $d = \text{sign}(\det(V U^T))$ and $B = \text{diag}(1, 1, d)$
6. Optimal rotation: $R^\ast = V B U^T$
7. Optimal translation (using the rotation from step 6): $\mathbf{t}^\ast = \bar{\mathbf{q}} - R^\ast\bar{\mathbf{p}}$

The resulting root-mean-square deviation (RMSD) between aligned point sets is

$$ \text{RMSD} = \sqrt{\frac{1}{N} \sum_{i=1}^N | \mathbf{q}_i - (R^\ast\mathbf{p}_i + \mathbf{t}^\ast) |^2} $$

which is frequently used as a measure of similarity between molecular structures or as a metric in loss functions for ML applications.

The Kabsch-Umeyama Algorithm (Scaling)

While the standard Kabsch algorithm solves for optimal rotation and translation, the Kabsch-Umeyama algorithm extends this by also finding an optimal scaling factor $c$. This is essential when aligning structures of different scales, such as a 3D scan versus a ground truth model.

(Note: This is sometimes searched for as the “Absch-Umeyama algorithm” due to typos, but the correct attribution is to Shinji Umeyama based on Wolfgang Kabsch’s work.)

The method estimates the transformation $\mathbf{q}_i \approx c R \mathbf{p}_i + \mathbf{t}$. The optimal scale is the trace of the (reflection-corrected) singular values of the cross-covariance divided by the variance of the source points about their centroid. See the Umeyama paper notes for the full derivation.

A Note on SVD and Automatic Differentiation

While modern frameworks allow us to backpropagate through the Singular Value Decomposition (SVD), it comes with a known stability issue: if the cross-covariance matrix has identical (degenerate) singular values (which can occur if the point clouds are perfectly aligned or have certain symmetries), the gradient of the SVD approaches infinity, causing NaN values during backpropagation. If you plan to use this algorithm as a loss function for a neural network, it is often necessary to add a tiny epsilon to the matrix before computing the SVD, or to utilize an SVD gradient patch. The Kabsch-Horn Cookbook library provides a SafeSVD primitive that floors the singular-value-gap denominator at machine epsilon in the backward pass, producing finite gradients at degenerate inputs across PyTorch, JAX, TensorFlow, and MLX.

Implementation

Let’s implement the algorithm in different frameworks. Note that for simplicity, the following implementations cover the unweighted Kabsch algorithm. If your application (like molecular dynamics) requires weights (e.g., atomic masses), the Kabsch-Horn Cookbook library provides per-point weighted alignment out of the box.

NumPy

import numpy as np


def kabsch_numpy(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.

    :param P: A Nx3 matrix of points
    :param Q: A Nx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = np.mean(P, axis=0)
    centroid_Q = np.mean(Q, axis=0)

    # Center the points
    p = P - centroid_P
    q = Q - centroid_Q

    # Compute the covariance matrix
    H = np.dot(p.T, q)

    # SVD
    U, S, Vt = np.linalg.svd(H)

    # Validate right-handed coordinate system
    if np.linalg.det(np.dot(Vt.T, U.T)) < 0.0:
        Vt[-1, :] *= -1.0

    # Optimal rotation
    R = np.dot(Vt.T, U.T)

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q - np.dot(R, centroid_P)

    # RMSD
    rmsd = np.sqrt(np.sum(np.square(np.dot(p, R.T) - q)) / P.shape[0])

    return R, t, rmsd

Here’s a quick test to verify correctness:

def test_numpy():
    np.random.seed(12345)

    P = np.random.randn(100, 3)

    alpha = np.random.rand() * 2 * np.pi
    R = np.array([[np.cos(alpha), -np.sin(alpha), 0],
                    [np.sin(alpha), np.cos(alpha), 0],
                    [0, 0, 1]])
    t = np.random.randn(3) * 10

    Q = np.dot(P, R.T) + t

    R_opt, t_opt, rmsd = kabsch_numpy(P, Q)

    print('RMSD: {}'.format(rmsd))
    print('R:\n{}'.format(R))
    print('R_opt:\n{}'.format(R_opt))
    print('t:\n{}'.format(t))
    print('t_opt:\n{}'.format(t_opt))

    l2_t = np.linalg.norm(t - t_opt)
    l2_R = np.linalg.norm(R - R_opt)
    print('l2_t: {}'.format(l2_t))
    print('l2_R: {}'.format(l2_R))

Running this test shows the algorithm correctly recovers the rotation and translation:

RMSD: 3.2111501877699246e-15
R:
[[-0.8475392 -0.5307328  0.       ]
 [ 0.5307328 -0.8475392  0.       ]
 [ 0.         0.         1.       ]]
R_opt:
[[-8.47539198e-01 -5.30732803e-01 -2.95434260e-16]
 [ 5.30732803e-01 -8.47539198e-01  2.92859649e-16]
 [ 0.00000000e+00 -2.77555756e-16  1.00000000e+00]]
t:
[ 5.99726796  1.50078468 -3.34633977]
t_opt:
[ 5.99726796  1.50078468 -3.34633977]
l2_t: 2.7012892057857038e-15
l2_R: 8.028174304721057e-16

Both the rotation and the translation are recovered to within floating-point precision (the residuals l2_t and l2_R are on the order of 1e-15).

For batch processing:

def kabsch_numpy_batched(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.

    :param P: A BxNx3 matrix of points
    :param Q: A BxNx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = np.mean(P, axis=1, keepdims=True)  # Bx1x3
    centroid_Q = np.mean(Q, axis=1, keepdims=True)  # Bx1x3

    # Center the points
    p = P - centroid_P  # BxNx3
    q = Q - centroid_Q  # BxNx3

    # Compute the covariance matrix
    H = np.matmul(p.transpose(0, 2, 1), q)  # Bx3x3

    # SVD
    U, S, Vt = np.linalg.svd(H)  # Bx3x3

    # Validate right-handed coordinate system
    d = np.linalg.det(np.matmul(Vt.transpose(0, 2, 1), U.transpose(0, 2, 1)))
    flip = d < 0.0
    if flip.any():
        Vt[flip, -1, :] *= -1.0

    # Optimal rotation
    R = np.matmul(Vt.transpose(0, 2, 1), U.transpose(0, 2, 1))  # Bx3x3

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q.squeeze(1) - np.matmul(centroid_P, R.transpose(0, 2, 1)).squeeze(1)  # Bx3

    # RMSD
    rmsd = np.sqrt(np.sum(np.square(np.matmul(p, R.transpose(0, 2, 1)) - q), axis=(1, 2)) / P.shape[1])

    return R, t, rmsd

PyTorch

The PyTorch implementation now uses broadcasting to ensure differentiability:

import torch


def kabsch_torch(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.
    :param P: A Nx3 matrix of points
    :param Q: A Nx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = torch.mean(P, dim=0)
    centroid_Q = torch.mean(Q, dim=0)

    # Center the points
    p = P - centroid_P
    q = Q - centroid_Q

    # Compute the covariance matrix
    H = torch.matmul(p.transpose(0, 1), q)

    # SVD
    U, S, Vt = torch.linalg.svd(H)

    # 1. Calculate determinant
    d = torch.det(torch.matmul(Vt.transpose(0, 1), U.transpose(0, 1)))

    # 2. Build diagonal B tensor without in-place mutation
    # We use stack to preserve gradients and graph connections
    B_diag = torch.stack([torch.tensor(1.0, device=d.device, dtype=d.dtype),
                          torch.tensor(1.0, device=d.device, dtype=d.dtype),
                          torch.sign(d)])

    # 3. Scale columns of Vt.T via broadcasting, then multiply by U^T
    # Vt.T: (3, 3). B_diag: (3) -> B_diag[None, :]: (1, 3)
    R = torch.matmul(Vt.transpose(0, 1) * B_diag[None, :], U.transpose(0, 1))

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q - centroid_P @ R.transpose(0, 1)

    # RMSD
    rmsd = torch.sqrt(torch.sum(torch.square(torch.matmul(p, R.transpose(0, 1)) - q)) / P.shape[0])

    return R, t, rmsd

And our batched version:

def kabsch_torch_batched(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD, in a batched manner.
    :param P: A BxNx3 matrix of points
    :param Q: A BxNx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = torch.mean(P, dim=1, keepdims=True)  # Bx1x3
    centroid_Q = torch.mean(Q, dim=1, keepdims=True)  # Bx1x3

    # Center the points
    p = P - centroid_P  # BxNx3
    q = Q - centroid_Q  # BxNx3

    # Compute the covariance matrix
    H = torch.matmul(p.transpose(1, 2), q)  # Bx3x3

    # SVD
    U, S, Vt = torch.linalg.svd(H)  # Bx3x3

    # 1. Calculate batched determinant
    d = torch.det(torch.matmul(Vt.transpose(1, 2), U.transpose(1, 2)))  # B

    # 2. Build batched B_diag without in-place mutation or control flow
    ones = torch.ones_like(d)
    B_diag = torch.stack([ones, ones, torch.sign(d)], dim=-1) # Bx3

    # 3. Scale columns of Vt.T and multiply
    # Vt.T: (B, 3, 3). B_diag: (B, 3). B_diag[:, None, :]: (B, 1, 3).
    R = torch.matmul(Vt.transpose(1, 2) * B_diag[:, None, :], U.transpose(1, 2))

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q.squeeze(1) - torch.matmul(centroid_P, R.transpose(1, 2)).squeeze(1)  # Bx3

    # RMSD
    rmsd = torch.sqrt(torch.sum(torch.square(torch.matmul(p, R.transpose(1, 2)) - q), dim=(1, 2)) / P.shape[1])

    return R, t, rmsd

TensorFlow

The TensorFlow implementation returns S, U, and V directly. To handle immutability and potential compilation (e.g., via @tf.function), we avoid explicit conditional branching by constructing a correction matrix $B$ and broadcasting it.

import tensorflow as tf


def kabsch_tensorflow(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.

    :param P: A Nx3 matrix of points
    :param Q: A Nx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    P = tf.convert_to_tensor(P, dtype=tf.float32)
    Q = tf.convert_to_tensor(Q, dtype=tf.float32)

    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = tf.reduce_mean(P, axis=0)
    centroid_Q = tf.reduce_mean(Q, axis=0)

    # Center the points
    p = P - centroid_P
    q = Q - centroid_Q

    # Compute the covariance matrix
    H = tf.matmul(tf.transpose(p), q)

    # SVD
    S, U, V = tf.linalg.svd(H)

    # 1. Calculate determinant
    # Note: V in TF SVD is V, not V^T.
    # R = V * U^T. Det(R) = Det(V * U^T)
    d = tf.linalg.det(tf.matmul(V, tf.transpose(U)))

    # 2. Build diagonal B tensor: [1.0, 1.0, sign(d)]
    # Use static shape 3 if possible, or infer from D. Assuming D=3 here.
    B_diag = tf.stack([1.0, 1.0, tf.sign(d)])

    # 3. Scale columns of V via broadcasting (V * B_diag), then multiply by U^T
    # V is DxD, B_diag is D. V * B_diag[None, :] multiplies each column j by B_diag[j]
    R = tf.matmul(V * B_diag[None, :], tf.transpose(U))

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q - tf.linalg.matvec(R, centroid_P)

    # RMSD
    rmsd = tf.sqrt(tf.reduce_sum(tf.square(tf.matmul(p, tf.transpose(R)) - q)) / P.shape[0])

    return R, t, rmsd

and a batched version:

def kabsch_tensorflow_batched(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.

    :param P: A Nx3 matrix of points
    :param Q: A Nx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    P = tf.convert_to_tensor(P, dtype=tf.float32)
    Q = tf.convert_to_tensor(Q, dtype=tf.float32)

    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = tf.reduce_mean(P, axis=1, keepdims=True)
    centroid_Q = tf.reduce_mean(Q, axis=1, keepdims=True)

    # Center the points
    p = P - centroid_P
    q = Q - centroid_Q

    # Compute the covariance matrix
    H = tf.matmul(tf.transpose(p, perm=[0, 2, 1]), q)

    # SVD
    S, U, V = tf.linalg.svd(H)

    # 1. Calculate batched determinant
    d = tf.linalg.det(tf.matmul(V, tf.transpose(U, perm=[0, 2, 1])))

    # 2. Build batched B_diag: shape (B, 3)
    ones = tf.ones_like(d)
    B_diag = tf.stack([ones, ones, tf.sign(d)], axis=-1)

    # 3. Scale columns of V (Broadcasting adds the middle dimension)
    # V: (B, 3, 3), B_diag: (B, 3) -> B_diag[:, None, :]: (B, 1, 3)
    R = tf.matmul(V * B_diag[:, None, :], tf.transpose(U, perm=[0, 2, 1]))

    # Optimal translation (depends on R, so computed after it)
    t = tf.squeeze(centroid_Q, axis=1) - tf.linalg.matvec(R, tf.squeeze(centroid_P, axis=1))  # Bx3

    # RMSD
    rmsd = tf.sqrt(tf.reduce_sum(tf.square(tf.matmul(p, tf.transpose(R, perm=[0, 2, 1])) - q), axis=(1, 2)) / P.shape[1])

    return R, t, rmsd

JAX

The JAX implementation closely mirrors NumPy, replacing np with jnp. However, we again avoid if statements and in-place assignment (which JAX disallows) by using the broadcasting B-matrix approach.

import jax.numpy as jnp


def kabsch_jax(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.

    :param P: A Nx3 matrix of points
    :param Q: A Nx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    P = jnp.array(P)
    Q = jnp.array(Q)
    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = jnp.mean(P, axis=0)
    centroid_Q = jnp.mean(Q, axis=0)

    # Center the points
    p = P - centroid_P
    q = Q - centroid_Q

    # Compute the covariance matrix
    H = jnp.dot(p.T, q)

    # SVD
    U, S, Vt = jnp.linalg.svd(H)

    # 1. Calculate determinant
    d = jnp.linalg.det(jnp.dot(Vt.T, U.T))

    # 2. Build diagonal B array
    B_diag = jnp.array([1.0, 1.0, jnp.sign(d)])

    # 3. Scale columns of Vt.T and multiply by U.T
    # Vt.T is V.
    R = jnp.dot(Vt.T * B_diag[None, :], U.T)

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q - jnp.dot(R, centroid_P)

    # RMSD
    rmsd = jnp.sqrt(jnp.sum(jnp.square(jnp.dot(p, R.T) - q)) / P.shape[0])

    return R, t, rmsd

and batched:

def kabsch_jax_batched(P, Q):
    """
    Computes the optimal rotation and translation to align two sets of points (P -> Q),
    and their RMSD.

    :param P: A BxNx3 matrix of points
    :param Q: A BxNx3 matrix of points
    :return: A tuple containing the optimal rotation matrix, the optimal
             translation vector, and the RMSD.
    """
    P = jnp.array(P)
    Q = jnp.array(Q)
    assert P.shape == Q.shape, "Matrix dimensions must match"

    # Compute centroids
    centroid_P = jnp.mean(P, axis=1, keepdims=True)  # Bx1x3
    centroid_Q = jnp.mean(Q, axis=1, keepdims=True)  # Bx1x3

    # Center the points
    p = P - centroid_P  # BxNx3
    q = Q - centroid_Q  # BxNx3

    # Compute the covariance matrix
    H = jnp.matmul(p.transpose(0, 2, 1), q)  # Bx3x3

    # SVD
    U, S, Vt = jnp.linalg.svd(H)  # Bx3x3

    # 1. Calculate batched determinant
    d = jnp.linalg.det(jnp.matmul(Vt.transpose(0, 2, 1), U.transpose(0, 2, 1)))

    # 2. Build batched B_diag
    ones = jnp.ones_like(d)
    B_diag = jnp.stack([ones, ones, jnp.sign(d)], axis=-1)

    # 3. Scale columns of Vt.T and multiply by U.T
    # Vt.T: (B, 3, 3). B_diag: (B, 3).
    R = jnp.matmul(Vt.transpose(0, 2, 1) * B_diag[:, None, :], U.transpose(0, 2, 1))

    # Optimal translation (depends on R, so computed after it)
    t = centroid_Q.squeeze(1) - jnp.matmul(centroid_P, R.transpose(0, 2, 1)).squeeze(1)  # Bx3

    # RMSD
    rmsd = jnp.sqrt(jnp.sum(jnp.square(jnp.matmul(p, R.transpose(0, 2, 1)) - q), axis=(1, 2)) / P.shape[1])

    return R, t, rmsd

Extensions

The Kabsch algorithm has several important extensions that go beyond the formulation dealt with here:

• Quaternion Form: The algorithm can be reformulated using quaternions for better numerical stability, particularly useful in applications requiring high precision.
• Iterative Versions: More robust variants that handle noise better and have improved scaling properties for large point sets. This also can be advantageous for setups with limited computational resources.
• Weighted Kabsch: Extensions that incorporate point weights (e.g., atomic masses in molecular dynamics). While SciPy provides a weighted version, it lacks batch processing capabilities.
• The Umeyama Algorithm: If your point sets are rotated, translated, and scaled differently, the Umeyama algorithm is the direct extension of Kabsch. It solves the same optimization problem but introduces a scaling factor $c$, finding the optimal alignment for $Q \approx c R P + t$.

Several of these extensions are implemented in the Kabsch-Horn Cookbook library, which provides differentiable Kabsch, Horn, and Umeyama alignment across NumPy, PyTorch, JAX, TensorFlow, and MLX.

Further Reading

• Wikipedia, Kabsch Algorithm
• Zalo on Kabsch: An interactive shape matching demo.

Original Papers

• [Kabsch 1976] Kabsch, W. (1976). “A solution for the best rotation to relate two sets of vectors.” Acta Crystallographica Section A, 32(5), 922-923. DOI: 10.1107/S0567739476001873 The original paper: a closed-form, non-iterative optimal-rotation solution derived via Lagrange multipliers and eigendecomposition of $\tilde{R}R$ (the SVD reformulation came later; see Arun et al. 1987). See also: paper notes.
• [Kabsch 1978] Kabsch, W. (1978). “A discussion of the solution for the best rotation to relate two sets of vectors.” Acta Crystallographica Section A, 34(5), 827-828. DOI: 10.1107/S0567739478001680 The follow-up paper correcting for improper rotations (reflections).
• [Arun et al. 1987] Arun, K. S., Huang, T. S., & Blostein, S. D. (1987). “Least-Squares Fitting of Two 3-D Point Sets.” IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-9(5), 698-700. DOI: 10.1109/TPAMI.1987.4767965 The first SVD-based formulation for 3D point set alignment. See also: paper notes.
• [Horn et al. 1988] Horn, B. K. P., Hilden, H. M., & Negahdaripour, S. (1988). “Closed-form solution of absolute orientation using orthonormal matrices.” Journal of the Optical Society of America A, 5(7), 1127-1135. DOI: 10.1364/JOSAA.5.001127 The matrix square root (polar decomposition) approach to the same problem. See also: paper notes.
• [Horn 1987] Horn, B. K. P. (1987). “Closed-form solution of absolute orientation using unit quaternions.” Journal of the Optical Society of America A, 4(4), 629-642. DOI: 10.1364/JOSAA.4.000629 An alternative quaternion-based closed-form solution that also handles scale. See also: paper notes.
• [Umeyama 1991] Umeyama, S. (1991). “Least-squares estimation of transformation parameters between two point patterns.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(4), 376-380. DOI: 10.1109/34.88573 The extension of the algorithm to include optimal scaling in addition to rotation and translation. See also: paper notes.

Details on the simulation can be found in the LAMMPS Tutorial: Copper and Platinum Adatom Diffusion post and the Automated Adatom Diffusion Workflow project page.

Understanding how individual atoms move on crystal surfaces is fundamental to materials science, catalysis, and nanotechnology. This atomic-scale motion, called adatom diffusion, drives processes like thin film growth and surface chemical reactions.

While learning molecular dynamics simulations for my graduate work, I discovered these simulations generate valuable training data for machine learning models. This tutorial walks through simulating copper adatom diffusion on a Cu(100) surface using LAMMPS, building on Eric N. Hahn’s excellent adatom tutorial.

What you’ll learn:

• Setting up LAMMPS for surface diffusion simulations
• Understanding simulation parameters and their impact
• Visualizing results with Ovito
• Analyzing trajectory data for ML applications
• Connecting simulation data to machine learning workflows

In this tutorial, we will explore both Copper (Cu) and Platinum (Pt) to show how atomic properties affect diffusion behavior, generating data for training element-aware ML models.

Prerequisites

Before starting this tutorial, you’ll need:

• LAMMPS with EAM potential support (version 2020 or later recommended)
• Python 3.x with matplotlib for analysis scripts
• Ovito (free version) for trajectory visualization
• Cu01.eam.alloy potential file from the NIST repository
• Basic familiarity with molecular dynamics concepts (atoms, forces, timesteps)

Understanding Adatoms and Surface Diffusion

What is an Adatom?

An adatom (adsorbed atom) sits on a crystal surface but isn’t incorporated into the bulk structure. Adatoms have fewer bonds than fully coordinated bulk atoms, making them highly mobile and reactive.

Why Study Adatom Diffusion?

Adatom diffusion is important for several technological processes:

• Thin film growth: Adatoms are the building blocks of deposited films
• Catalysis: Many reactions happen at these mobile surface atoms
• Corrosion: How surface atoms move affects material degradation
• Self-assembly: Adatom movement enables formation of ordered structures

From a machine learning perspective, adatom diffusion is an ideal test case because:

• Well-understood physics provides ground truth for validation
• Small system size enables extensive simulation
• Behavior varies significantly with temperature and atomic species
• Systematic data generation across different conditions

Why Cu(100)?

Cu(100) surfaces are well-studied in literature, making them excellent benchmarks. The face-centered cubic (fcc) structure creates clear diffusion pathways, and copper’s moderate binding energy lets us observe diffusion at reasonable temperatures without extreme computational demands.

Simulation Overview

Before diving into the code details, let’s understand the simulation design:

Key Simulation Parameters

Simulation Strategy

The approach uses a thermal gradient setup:

• Bottom layers: Fixed to represent bulk crystal
• Middle layers: Heated to 850 K for thermal energy
• Top layers and adatom: Equilibrate to $\sim 600$ K for diffusion
• This lets thermal energy propagate up from the heated reservoir to the free surface where the adatom diffuses

The complete LAMMPS script implementing this approach:

### Original Created by Eric N. Hahn  ###
### ericnhahn@gmail.com ###

### Modifications by Hunter Heidenreich, CSE lab (Harvard, 2023)
### hheidenreich@g.harvard.edu
### 2023-09-01

### Simulating adatoms ###
### Version 0.2 ###


units metal
dimension 3
boundary p p s
atom_style atomic

lattice fcc 3.614
variable cubel equal 4
variable fixer1 equal "v_cubel+2"
variable fixer2 equal "v_cubel+1.49"
region  box block -${cubel} ${cubel} -${cubel} ${cubel} -${fixer1} 1 units lattice
region cbox block -${cubel} ${cubel} -${cubel} ${cubel} -${fixer1} 0 units lattice
create_box 1 box
create_atoms 1 region cbox
create_atoms 1 single -0.5 0 0.5 units lattice
region hold block INF INF INF INF -${fixer1} -${fixer2} units lattice
region temp block INF INF INF INF -${fixer2} -${cubel} units lattice
group hold region hold
group temp region temp

pair_style eam/alloy
pair_coeff * * Cu01.eam.alloy Cu

timestep        0.005
compute         new all temp
velocity        temp create 600 12345
fix heater temp temp/rescale 1 850 850 5 1
fix nve all nve
fix freeze hold setforce 0 0 0

variable e     equal pe
variable k     equal ke
variable t     equal etotal
variable T     equal temp
fix energy all ave/time 1 50 50 v_k v_e v_t v_T file energy_avg.txt

minimize 1.0e-4 1.0e-6 1000 10000

dump eve all custom 5 dump.lammpstrj id type xu yu zu   # fx fy fz  # uncomment for forces
dump_modify eve sort id

thermo 50
run 100000  # 100_000 * 5 fs = 500 ps

Line-by-Line Breakdown

Let’s examine each part of the LAMMPS script:

Simulation Setup

Units

units metal

Sets simulation units to “metal” units (a standard choice for metallic systems). Key conversions: length in $\text{\AA}$, energy in eV, time in ps. Full details in the LAMMPS documentation.

dimension 3

Sets 3D simulation.

boundary p p s

Boundary conditions: periodic in x,y (infinite surface) and shrink-wrapped in z (finite surface height). This allows the adatom to potentially leave the surface if needed.

atom_style atomic

Uses “atomic” style, atoms as point masses without internal structure. Standard for metallic systems.

Lattice

lattice fcc 3.614

Defines face-centered cubic lattice with experimental Cu lattice constant ($3.614 \text{ \AA}$).

variable cubel equal 4
variable fixer1 equal "v_cubel+2"
variable fixer2 equal "v_cubel+1.49"

Define variables for simulation box dimensions. cubel=4 sets system size, while fixer1 and fixer2 define the frozen and heated regions.

region  box block -${cubel} ${cubel} -${cubel} ${cubel} -${fixer1} 1 units lattice
region cbox block -${cubel} ${cubel} -${cubel} ${cubel} -${fixer1} 0 units lattice

Define regions: box for the entire simulation volume and cbox for crystal creation (excludes the surface layer where we’ll place the adatom).

create_box 1 box
create_atoms 1 region cbox
create_atoms 1 single -0.5 0 0.5 units lattice

Create simulation box, populate with Cu atoms, then add single adatom at specified position.

region hold block INF INF INF INF -${fixer1} -${fixer2} units lattice
region temp block INF INF INF INF -${fixer2} -${cubel} units lattice
group hold region hold
group temp region temp

Define atom groups: hold (frozen bottom layers) and temp (heated middle layers for thermal energy).

pair_style eam/alloy
pair_coeff * * Cu01.eam.alloy Cu

Use Embedded Atom Method (EAM) potential for metallic bonding. The Cu01.eam.alloy potential from Mishin et al. is available from the NIST repository.

timestep        0.005

5 femtosecond timestep (small enough for numerical stability).

Initial Conditions

velocity        temp create 600 12345

Initialize velocities for 600 K temperature using random seed 12345.

fix heater temp temp/rescale 1 850 850 5 1
fix nve all nve
fix freeze hold setforce 0 0 0

Three fixes control dynamics:

• heater: Maintains 850 K in middle layers
• nve: Velocity Verlet integration for all atoms
• freeze: Sets forces to zero for bottom atoms

variable e     equal pe
variable k     equal ke
variable t     equal etotal
variable T     equal temp
fix energy all ave/time 1 50 50 v_k v_e v_t v_T file energy_avg.txt

Track energies and temperature, averaging every 50 timesteps and writing to file.

Execution

Minimization

minimize 1.0e-4 1.0e-6 1000 10000

Relax initial structure. Should converge quickly, indicating the system is already well-optimized.

Output Setup

dump eve all custom 5 dump.lammpstrj id type xu yu zu   # fx fy fz  # uncomment for forces
dump_modify eve sort id

Write atomic positions every 5 timesteps, sorted by atom ID. Uncomment force components if needed for analysis.

Production Run

thermo 50
run 100000  # 100_000 * 5 fs = 500 ps

Run simulation for 500 ps with thermo output every 50 steps.

Visualization and Analysis

Visualize results using Ovito, a free atomistic visualization tool:

1. Open the trajectory file in Ovito
2. Color atoms by z-coordinate
3. Restrict height range to $0\text{-}2 \text{ \AA}$ for surface focus
4. Animate to observe diffusion events

Analysis Results

The simulation generates rich data for machine learning applications:

Energy Analysis

Energy fluctuations reveal thermal motion patterns:

Skipping the first 30 logged data points (each averaged over 50 timesteps, so the first ~1500 timesteps / 7.5 ps of equilibration), these fluctuations enable:

• Anomaly detection: Identifying unusual diffusion events
• Temperature prediction: Estimating local temperature from atomic motion
• Stability analysis: Detecting equilibrium states

Trajectory Analysis

Adatom motion reveals diffusion mechanisms:

This data enables:

• Path prediction: Training models for future position forecasting
• Diffusion coefficient estimation: Learning temperature-mobility relationships
• Transition state identification: Detecting hops between stable sites

Z-coordinate data shows exchange events where the adatom swaps with surface atoms (crucial for surface chemistry understanding). This enables:

• Event classification: Distinguishing diffusion vs. exchange mechanisms
• Activation barrier estimation: Learning energy landscapes from fluctuations
• Surface coordination analysis: Correlating height with local environment

Machine Learning Applications

This simulation produces multiple data types for ML training:

1. Coordinate trajectories: Neural network potential inputs or graph neural network features
2. Energy time series: Regression model features for system property prediction
3. Event annotations: Supervised learning labels for diffusion mechanism classification
4. Environmental descriptors: Local atomic arrangement features

Systematic MD simulations generate large, labeled datasets across varied conditions.

Extending to Platinum: Mass and Bonding Effects

To understand how different elements behave, we can extend this framework to platinum (Pt). Platinum’s higher atomic mass and stronger metallic bonding create notably different diffusion behavior, providing comparative data for machine learning.

Key Differences from Copper

Modifying the LAMMPS Script

The platinum simulation uses the exact same framework as the copper case, with three simple element-specific modifications:

1. Lattice constant: Change lattice fcc 3.614 to lattice fcc 3.96
2. Potential file: Change Cu01.eam.alloy to Pt_Zhou04.eam.alloy (available from the NIST repository)
3. Element specification: Change Cu to Pt in the pair_coeff line

These simple changes capture the essential physics differences between elements while maintaining the same simulation protocol, which is ideal for generating comparative datasets for ML training.

Expected Behavior vs. Copper

When you run the analysis scripts on the platinum trajectory, you will observe:

• Slower motion: Heavier atoms move more slowly at the same temperature. Platinum’s ~3x greater mass reduces diffusion rates.
• Higher energy barriers: Stronger metallic bonding creates deeper potential wells, requiring more thermal energy for diffusion hops.
• Different pathways: The larger lattice constant changes the energy landscape, potentially favoring different diffusion mechanisms.

Comparing Cu and Pt trajectories enables training element-aware models that account for atomic mass effects, binding strengths, and temperature scaling across different metals.

Code and Data

The complete simulation scripts and analysis tools are available for reproducibility:

Energy Analysis Script

# Hunter Heidenreich, 2023
# Plots the energy of a simulation over time.

import matplotlib.pyplot as plt
from argparse import ArgumentParser

if __name__ == '__main__':
    parser = ArgumentParser()
    parser.add_argument('--input', type=str, required=True)
    parser.add_argument('--output', type=str, required=True)
    parser.add_argument('--skip', type=int, default=1)
    args = parser.parse_args()

    # Parse energy data
    data = {'ts': [], 'kes': [], 'pes': [], 'tes': [], 'Ts': []}
    with open(args.input, 'r') as f:
        for line in f:
            if line.startswith('#') or not line.strip():
                continue
            t, v_k, v_e, v_t, v_T = map(float, line.split())
            data['ts'].append(t)
            data['kes'].append(v_k)
            data['pes'].append(v_e)
            data['tes'].append(v_t)
            data['Ts'].append(v_T)

    # Skip initial equilibration
    for key in data:
        data[key] = data[key][args.skip:]

    # Create subplots
    fig, axs = plt.subplots(2, 2, figsize=(16, 12))

    plots = [('Kinetic Energy', 'kes'), ('Potential Energy', 'pes'),
             ('Total Energy', 'tes'), ('Temperature', 'Ts')]

    for ax, (title, key) in zip(axs.flat, plots):
        ax.plot(data['ts'], data[key])
        ax.set_xlabel('TimeStep')
        ax.set_ylabel(title)
        ax.set_title(title)

    plt.tight_layout()
    plt.savefig(args.output, dpi=300, bbox_inches='tight')

Trajectory Analysis Script

# Hunter Heidenreich, 2023
# Plots the coordinates of the adatom.

import matplotlib.pyplot as plt
from argparse import ArgumentParser

if __name__ == '__main__':
    parser = ArgumentParser()
    parser.add_argument('--input', type=str, required=True)
    parser.add_argument('--output', type=str, required=True)
    parser.add_argument('--id', type=int, default=1665,
                       help='Atom ID to track (the adatom is the last created atom)')
    parser.add_argument('--do_z', action='store_true',
                       help='Plot z-coordinate instead of xy scatter')
    args = parser.parse_args()

    coords = {'x': [], 'y': [], 'z': []}
    with open(args.input, 'r') as f:
        for line in f:
            if line.startswith(f'{args.id} '):
                x, y, z = map(float, line.split()[2:5])
                coords['x'].append(x)
                coords['y'].append(y)
                coords['z'].append(z)

    plt.figure(figsize=(10, 8))
    if args.do_z:
        plt.plot(range(len(coords['z'])), coords['z'], 'b-', linewidth=1)
        plt.xlabel('Simulation Step')
        plt.ylabel('Z Coordinate (Å)')
        plt.title(f'Height vs. Time for Adatom {args.id}')
        plt.grid(True, alpha=0.3)
    else:
        plt.scatter(coords['x'], coords['y'], s=1, alpha=0.7, c='red')
        plt.xlabel('X Coordinate (Å)')
        plt.ylabel('Y Coordinate (Å)')
        plt.title(f'XY Trajectory for Adatom {args.id}')
        plt.axis('equal')
        plt.grid(True, alpha=0.3)

    plt.savefig(args.output, dpi=300, bbox_inches='tight')

Summary and Next Steps

This tutorial demonstrates how molecular dynamics generates valuable ML training data for materials science. Adatom diffusion provides an ideal starting point because it:

• Has interpretable physics: Well-understood mechanisms enable ML validation
• Shows diverse behaviors: Temperature-dependent dynamics create rich datasets
• Scales efficiently: Small systems allow extensive parameter exploration
• Connects to applications: Direct relevance to catalysis and surface engineering

What’s Next

Future posts will extend this framework:

1. Mixed-metal surfaces: Alloy effects on diffusion pathways
2. Stepped surfaces: How defects alter atomic mobility
3. ML implementation: Training neural networks on simulation data

Broader Applications

These simulation techniques enable various ML applications:

• Neural network potentials: Replacing expensive quantum calculations with trained models
• Rare event sampling: ML-enhanced diffusion pathway identification
• Catalyst design: Predicting surface modification effects on reactivity
• Materials discovery: Screening alloy compositions for desired properties

Getting Started

To reproduce these simulations:

1. Install LAMMPS with EAM potential support
2. Download Cu01.eam.alloy from the NIST repository and place in your working directory
3. Save the LAMMPS script as adatom_cu.lammps and run:

   lammps -in adatom_cu.lammps
   

4. Analyze the results with the Python scripts:

   python plot_energy.py --input energy_avg.txt --output energy.png --skip 30
   python plot_trajectory.py --input dump.lammpstrj --output trajectory_xy.png
   python plot_trajectory.py --input dump.lammpstrj --output trajectory_z.png --do_z
   

5. Visualize in Ovito by opening dump.lammpstrj
6. Experiment with different temperatures, orientations, or elements

The full project, including the simulation architecture and automated analysis pipeline, is documented on the Automated Adatom Diffusion Workflow project page.

Questions about the simulation setup or interested in applying these techniques to your research? Feel free to reach out. I’m always happy to discuss molecular dynamics and machine learning applications.

References

• LAMMPS
• Ovito
• NIST Interatomic Potentials Repository
• Mishin et al.

Details on the simulation can be found in the Cu Adatom Diffusion on Cu(100) post and the Automated Adatom Diffusion Workflow project page.

When developing machine learning models for protein dynamics, I needed training data, lots of it. Most researchers start with alanine dipeptide, a tiny two-amino-acid system that’s become the “hello world” of protein simulation. It’s small enough to simulate quickly but complex enough to show interesting folding behavior.

I wanted more diversity in my training data. Different amino acid side chains behave differently, and I was curious how this would affect model performance. So I extended the typical alanine dipeptide approach to include eight other amino acids, creating a small collection of “mini-proteins” for ML studies.

These dipeptides give a controlled testbed for studying how different chemical properties (aromatic rings, flexibility, branching) affect molecular dynamics, and for generating training data that varies those properties systematically.

What Are Mini-Proteins?

In this context, “mini-proteins” are single amino acid residues capped with acetyl and N-methyl groups (Ace-X-Nme, where X is the amino acid). These systems act as the simplest possible models that still capture essential protein-like behavior.

These systems are popular in computational studies because they:

• Simulate quickly (seconds to minutes instead of hours)
• Have well-characterized behavior for validation
• Show enough complexity to be interesting
• Can be systematically varied to study different chemical effects

Getting Started

The complete workflow and scripts are available on GitHub: mini-proteins. The full project overview is on the Mini-Protein Trajectory Generation project page.

Requirements

• Linux system with GROMACS installed
• Python 3 with numpy and matplotlib
• Basic familiarity with molecular dynamics concepts

Quick Start

git clone https://github.com/hunter-heidenreich/mini-proteins.git
cd mini-proteins
ID=ala sh scripts/run.sh

This runs the complete pipeline: energy minimization, solvation, equilibration, and production simulation. The default settings generate 1 ns of trajectory data saved every 100 fs. I chose high temporal resolution for my ML models, but you can adjust this in config/md_langevin.mdp.

For longer production runs (recommended for most applications), increase the simulation time to ~100 ns and reduce the save frequency to manage file sizes.

The Collection

I’ve included nine different amino acid dipeptides, each with distinct chemical properties:

Flexible systems: Glycine (smallest side chain), Alanine (methyl group)

Branched systems: Valine, Isoleucine, Leucine (different branching patterns)

Aromatic systems: Phenylalanine, Tryptophan (different ring structures)

Special cases: Proline (ring constraint), Methionine (sulfur chemistry)

This systematic set allows studying how different chemical features affect dynamics:

• Does the flexibility of glycine lead to more diverse conformational sampling?
• How do aromatic rings in tryptophan affect folding pathways?
• Does the ring constraint in proline create different energy landscapes?

These fundamental questions provide systematic data to test ML models against known chemical intuition, building confidence in the approach.

Ideally, a neural network trained on this dataset should learn physical invariances. By training on both aliphatic (Val, Leu, Ile) and aromatic (Phe, Trp) systems, the model learns to focus entirely on how electron density (π-systems vs. σ-bonds) influences local potential energy surfaces.

Generating ML-Ready Trajectory Data

Generating raw coordinates is easy; generating ML-ready data requires specific configurations. Standard MD simulations compress trajectory files to save space, discarding high-frequency velocity and force data. To train Neural Network Potentials (NNPs), I configured the GROMACS pipeline differently.

The fastest way to generate trajectory data is using the run.sh script:

ID=ala sh scripts/run.sh

where ID is the three-letter amino acid code (here, ala for alanine).

This script performs energy minimization, solvation, neutralization, NVT equilibration, NPT equilibration, and production simulation. The resulting trajectory saves to the out/ID/data directory.

Why This Pipeline Differs from Standard Tutorials

A key deviation from standard tutorials is the use of Stochastic Dynamics (Langevin) as the integrator. This adds friction and noise terms to the equations of motion, ensuring correct thermodynamic sampling:

; config/md_langevin.mdp
integrator  = sd        ; Stochastic dynamics (Langevin)
dt          = 0.001     ; 1 fs timestep
nstxout     = 100       ; Save coordinates every 100 steps
nstvout     = 100       ; Save velocities every 100 steps
nstfout     = 100       ; Save forces every 100 steps
tc-grps     = Protein Non-Protein
tau_t       = 0.1  0.1  ; Friction constant (ps)
ref_t       = 298  298  ; Reference temperature (K)

The critical settings for ML applications:

1. Langevin Dynamics (sd): Ensures proper canonical (NVT) sampling, providing a robust alternative to the velocity-rescaling thermostat often used in tutorials
2. Uncompressed Force Output (nstfout = 100): Writing to .trr format captures the precise atomic forces acting on every atom, essential for force-matching in NNP training
3. High-Frequency Sampling (0.1 ps): Saving frames every 100 fs captures fast bond vibrations often missed in standard 10 ps snapshots

Note: A production simulation currently runs for 1 nanosecond, saved every 0.1 picoseconds (100 fs). For most applications, increase this to 100 nanoseconds and adjust the save frequency to avoid large data files. I targeted 100 fs because I needed correlated time data for ML models; other applications may require a lower frequency.

You can also run each step individually (see scripts/run.sh for examples).

The Systems

Here are the nine amino acid dipeptides I’ve included, each chosen for different chemical properties:

Alanine Dipeptide: The Standard

The classic starting point for protein folding studies. The small methyl side chain provides a simple yet challenging system.

Glycine Dipeptide: Maximum Flexibility

No side chain means maximum backbone flexibility. Great for studying how constraints affect conformational sampling.

Proline Dipeptide: Built-in Rigidity

The ring structure creates backbone constraints. Interesting comparison to glycine’s flexibility.

Aromatic Systems

Phenylalanine: Simple benzene ring for studying aromatic interactions.

Tryptophan: Larger indole ring system with more complex aromatic chemistry.

Branched Aliphatic Systems

Valine: β-branched, creates steric constraints near the backbone.

Isoleucine: γ-branched, different steric profile than valine.

Leucine: Longer branched chain with more conformational freedom.

Special Chemistry

Methionine: Sulfur chemistry, different from the others and interesting for studying heteroatom effects.

What’s Next?

These mini-protein simulations have been useful for my ML work, providing systematic training data with controlled chemical variation. These simple systems have helped me understand how different amino acid properties affect molecular behavior, knowledge that’s valuable when working with larger, more complex proteins.

The primary value of this pipeline lies in the force extraction workflow. Having atomic forces alongside coordinates enables training NNPs via force matching; force information is a richer training signal than energies alone. Tools like TorchMD-Net, NequIP, and MACE can directly consume this data format.

The scripts are designed to be easily modified for different amino acids or simulation conditions. I’ve tried to make the workflow straightforward while keeping it flexible.

This work complements my other molecular dynamics projects:

• LAMMPS Tutorial: Copper and Platinum Adatom Diffusion: Learning LAMMPS for surface simulations and extending to different elements

Together, these projects have given me a solid foundation in MD simulations for generating ML training data across different molecular systems.

Find the complete code and documentation on GitHub. Questions or suggestions? I’d love to hear from you, especially if you’ve found interesting ways to extend or improve the approach.

Acknowledgements

The scripts build on the GROMACS tutorial by Luca Tubiana at the University of Trento.

This project provides an “input-to-analysis” workflow for simulating adatom diffusion on FCC metal surfaces. It demonstrates how to set up surface diffusion simulations in LAMMPS, manage EAM potentials, and parse trajectory data into energy and trajectory plots using Python. The LAMMPS input scripts are adapted from Eric N. Hahn’s adatom tutorial; the Python analysis layer (plot_energy.py, plot_xy.py) is my own, written while in CSElab (Harvard, 2023).

The workflow covers two material systems (Copper (Cu) and Platinum (Pt)) providing comparative datasets that highlight how atomic mass and bonding strength affect surface dynamics.

Features

Simulation Architecture

The project separates simulation logic from analysis code:

Each directory contains:

• LAMMPS input scripts (.in files) defining the physics
• EAM potential files for metallic bonding (the Cu potential is committed; the Pt potential must be downloaded separately from the NIST Interatomic Potentials Repository, so the Pt system does not run as-checked-out)
• Python analysis scripts for trajectory and energy parsing

Key Features

• EAM Potentials: Uses Embedded Atom Method alloy potentials to accurately model metallic bonding and surface energies, providing accuracy beyond simple Lennard-Jones potentials
• Automated Analysis: Python pipeline (plot_energy.py, plot_xy.py) that parses raw thermodynamic logs and trajectory dumps to generate “health check” dashboards
• Workflow Orchestration: Demonstrates the “Input → Simulation → Analysis” loop, automating the transition from raw .lammpstrj files to publication-ready plots
• Kokkos Support: Includes Kokkos execution commands for GPU/multi-threaded runs

Simulation Parameters

Usage

The repository includes LAMMPS input scripts and Python analysis scripts. Run the LAMMPS scripts to generate trajectory data, then use the Python scripts to visualize the results.

Results

This workflow is documented in detail in companion blog posts:

• LAMMPS Tutorial: Copper and Platinum Adatom Diffusion - Complete setup walkthrough with line-by-line script explanation and comparison of how heavier atoms behave differently on surfaces

I developed an automated GROMACS pipeline to generate molecular dynamics (MD) datasets for machine learning applications. The workflow automates the simulation of capped dipeptides across nine distinct residue types, creating a diverse training set suitable for Neural Network Potentials (NNPs). The pipeline is built off Luca Tubiana’s GROMACS tutorial (University of Trento); the Python analysis layer and the curated dipeptide dataset are my own.

Features

Automated Simulation Pipeline

• End-to-End Scripting: Bash-automated workflow handling topology generation (pdb2gmx), solvation, ionization, and equilibration
• Langevin Dynamics: Implemented Stochastic Dynamics (SD) integration to ensure proper canonical (NVT) ensemble sampling
• High-Resolution Output: Configured to capture 0.1 ps (100 fs) resolution trajectories, critical for capturing fast bond vibrations
• Force Extraction: Optimized output to .trr format preserving uncompressed atomic forces, a key requirement for force-matching in ML potentials

; md_langevin.mdp
integrator  = sd        ; Stochastic dynamics for proper sampling
dt          = 0.001     ; 1 fs timestep
nstxout     = 100       ; Output every 100 steps = 0.1 ps resolution
tc-grps     = Protein Non-Protein
tau_t       = 0.1  0.1  ; Friction constant (ps)

Chemical Diversity Suite

Designed to stress-test ML models against varied kinematic constraints:

Usage

The pipeline is executed via bash scripts, requiring GROMACS to be installed.

Results

• Data Volume vs. Fidelity: Balanced high-frequency force outputs (every 100 steps) against storage constraints by automating post-processing extraction of forces into lightweight .xvg formats
• Force Field Consistency: Standardized the Amber03 force field and TIP3P water model across all residues to ensure consistent potential energy surfaces for downstream model training

Note: This pipeline uses Amber03 for consistency across residue types. For production ML potentials, consider swapping to Charmm36m or similar modern force fields.

Retrospective

• Demonstrative, not production-scale: the 1 ns trajectories exercise the pipeline and capture fast bond vibrations, but proper conformational sampling needs 100 ns to 1 µs runs. This is a working reference, not a finished dataset.
• Dated force field: Amber03 / TIP3P keeps the potential energy surface consistent across residues, but it is not state-of-the-art for ML-potential training; CHARMM36m or Amber ff19SB would be the upgrade path.
• Paused, not abandoned: a candidate to revive and extend (more residues, longer trajectories, Ramachandran analysis) for future force-matching work.

Related Work

• Mini-Protein Dynamics - Detailed blog post on the simulation methodology