Computational Chemistry

Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsity

Luo et al. introduce SPHNet, using adaptive sparsity to dramatically improve SE(3)-equivariant Hamiltonian prediction …...

Computational Chemistry

Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction

Fu et al. propose energy conservation as a key MLIP diagnostic and introduce eSEN, bridging test accuracy and real …...

Computational Chemistry

The Dark Side of the Forces: Assessing Non-Conservative Force Models for Atomistic Machine Learning

Bigi et al. critique non-conservative force models in ML potentials, showing their simulation failures and proposing …...

Generative Modeling
Visualization of the VAE prior hole problem showing a ring-shaped aggregate posterior with an empty center where the Gaussian prior has highest density

A Contrastive Learning Approach for Training Variational Autoencoder Priors

Aneja et al.'s NeurIPS 2021 paper introducing Noise Contrastive Priors (NCPs) to address VAE's 'prior hole' problem with …...

Machine Learning Fundamentals
Comparison of standard 3D CNN versus 3D Steerable CNN for handling rotational symmetry

3D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Data

Weiler et al.'s NeurIPS 2018 paper introducing SE(3)-equivariant CNNs for volumetric data using group theory and …...

Computational Chemistry

Invalid SMILES are Beneficial Rather than Detrimental to Chemical Language Models

Skinnider (2024) shows that generating invalid SMILES actually improves chemical language model performance through …...

Generative Modeling
Variational Autoencoder architecture diagram showing encoder, latent space, and decoder

Modern PyTorch Techniques for VAEs: A Hands-On Tutorial

Learn to implement VAEs in PyTorch: ELBO objective, reparameterization trick, loss scaling, and MNIST experiments on …

Scientific Computing
Comparison of IQCRNN (Our Method) vs standard Policy Gradient showing training curves, phase portraits, and state trajectories for control tasks

IQCRNN: Certified Stability for Neural Networks

PyTorch IQCRNN enforcing stability guarantees on RNNs via Integral Quadratic Constraints and semidefinite programming....

Computational Chemistry

IMG2SMI: Translating Molecular Structure Images to SMILES

Campos & Ji's method for converting 2D molecular images to SMILES strings using Transformers and SELFIES representation....

AI Safety
A nonsensical trigger sequence 'WTC theoriesclimate Flat Hubbard Principle' is fed into GPT-2, which then generates Flat Earth conspiracy text

GPT-2 Susceptibility to Universal Adversarial Triggers

Investigation into whether universal adversarial triggers can control both topic and stance of GPT-2's generated text …...

Machine Learning Fundamentals
Various symmetric and repetitive patterns generated by Compositional Pattern Producing Networks

HyperNEAT: Scaling Neuroevolution with Geometric Patterns

How HyperNEAT uses indirect encoding and geometric patterns to evolve large-scale neural networks with biological …

Machine Learning Fundamentals
NEAT genome encoding diagram showing node genes and connection genes with innovation numbers

NEAT: Evolving Neural Network Topologies

Learn about NEAT's approach to evolving neural networks: automatic topology design, historical markings, and speciation …