Machine Learning Fundamentals
Comparison of linear interpolation (teleportation) showing double peaks versus displacement interpolation (transportation) showing smooth single peak

A Convexity Principle for Interacting Gases

Introduces displacement interpolation to prove ground state uniqueness via optimal transport, establishing foundations …

Machine Learning Fundamentals
Comparison of Residual Network vs ODE Network architectures showing discrete layers versus continuous transformations

Neural Ordinary Differential Equations

Introduces ODE-Nets, a continuous-depth neural network model parameterized by ODEs, enabling constant memory …

Machine Learning Fundamentals
Diagram showing distributed representations with three pools of units (AGENT, RELATIONSHIP, PATIENT) connected via role/identity bindings

Distributed Representations

Hinton's 1984 technical report establishing the theoretical efficiency of distributed representations over local …

Machine Learning Fundamentals
Visualization of inverse problem showing one input mapping to multiple valid outputs

Mixture Density Networks

Seminal 1994 paper introducing MDNs to model arbitrary conditional probability distributions using neural networks.

Machine Learning Fundamentals
Sphere packing illustration showing Shannon's geometric interpretation of channel capacity

Communication in the Presence of Noise

Shannon's 1949 foundational paper establishing information theory, channel capacity, and the sampling theorem for …

Machine Learning Fundamentals
Comparison of standard 3D CNN versus 3D Steerable CNN for handling rotational symmetry

3D Steerable CNNs: Rotationally Equivariant Features

Weiler et al.'s NeurIPS 2018 paper introducing SE(3)-equivariant CNNs for volumetric data using group theory and …

Machine Learning Fundamentals
Vintage slot machine with multiple arms representing the multi-arm bandit problem in machine learning

A Framework for Multi-Arm Bandit Problems: 5 Key Dimensions

Framework for understanding multi-arm bandit algorithms through five dimensions. Covers exploration vs exploitation and …

Machine Learning Fundamentals
Various symmetric and repetitive patterns generated by Compositional Pattern Producing Networks

HyperNEAT: Scaling Neuroevolution with Geometric Patterns

How HyperNEAT uses indirect encoding and geometric patterns to evolve large-scale neural networks with biological …

Machine Learning Fundamentals
NEAT genome encoding diagram showing node genes and connection genes with innovation numbers

NEAT: Evolving Neural Network Topologies

Learn about NEAT's approach to evolving neural networks: automatic topology design, historical markings, and speciation …

Machine Learning Fundamentals
Diagram showing the three main types of machine learning: supervised, unsupervised, and reinforcement learning

Breaking Down Machine Learning for the Average Person

Discover how machine learning actually works through three fundamental approaches, explained with everyday examples you …