Machine Learning Fundamentals
Comparison of linear interpolation (teleportation) showing double peaks versus displacement interpolation (transportation) showing smooth single peak

A Convexity Principle for Interacting Gases: Theory

Introduces displacement interpolation to prove ground state uniqueness via optimal transport, establishing foundations …

Machine Learning Fundamentals
Comparison of Residual Network vs ODE Network architectures showing discrete layers versus continuous transformations

Neural ODEs: Continuous-Depth Deep Learning

Introduces ODE-Nets, a continuous-depth neural network model parameterized by ODEs, enabling constant memory …

Machine Learning Fundamentals
Diagram showing distributed representations with three pools of units (AGENT, RELATIONSHIP, PATIENT) connected via role/identity bindings

Distributed Representations: A Foundational Theory

Hinton's 1984 technical report establishing the theoretical efficiency of distributed representations over local …

Machine Learning Fundamentals
Visualization of inverse problem showing one input mapping to multiple valid outputs

Mixture Density Networks: Modeling Multimodal Distributions

Seminal 1994 paper introducing MDNs to model arbitrary conditional probability distributions using neural networks.

Machine Learning Fundamentals
Sphere packing illustration showing Shannon's geometric interpretation of channel capacity

Communication in the Presence of Noise: Shannon's 1949 Paper

Shannon's 1949 foundational paper establishing information theory, channel capacity, and the sampling theorem for …

Machine Learning Fundamentals
Comparison of standard 3D CNN versus 3D Steerable CNN for handling rotational symmetry

3D Steerable CNNs: Rotationally Equivariant Features

Weiler et al.'s NeurIPS 2018 paper introducing SE(3)-equivariant CNNs for volumetric data using group theory and …

Machine Learning Fundamentals
Vintage slot machine with multiple arms representing the multi-arm bandit problem in machine learning

5 Axes of Multi-Arm Bandit Problems: A Practical Guide

Explore 5 key dimensions of multi-arm bandit problems to help practitioners better navigate the exploration-exploitation …

Machine Learning Fundamentals
NEAT genome encoding diagram showing node genes and connection genes with innovation numbers

A Guide to Neuroevolution: NEAT and HyperNEAT

Explore the evolution of neural network topologies with NEAT and how HyperNEAT scales this approach using geometric …

Machine Learning Fundamentals
Diagram showing the three main types of machine learning: supervised, unsupervised, and reinforcement learning

Breaking Down Machine Learning for the Average Person

Discover how machine learning actually works through three fundamental approaches, explained with everyday examples you …