Generative Modeling
Diagram comparing standard stochastic sampling (gradient blocked) vs the reparameterization trick (gradient flows)

Auto-Encoding Variational Bayes (VAE Paper Summary)

Summary of Kingma & Welling's foundational VAE paper introducing the reparameterization trick and variational …...

Generative Modeling
Flowchart comparing VAE and IWAE computation showing the key difference in where averaging occurs relative to the log operation

Importance Weighted Autoencoders (IWAE Paper Summary)

Summary of Burda, Grosse & Salakhutdinov's ICLR 2016 paper introducing Importance Weighted Autoencoders for tighter …...

Generative Modeling
MNIST digit samples generated from a Variational Autoencoder latent space

Importance Weighted Autoencoders: Beyond the Standard VAE

The key difference between multi-sample VAEs and IWAEs: how log-of-averages creates a tighter bound on log-likelihood.

Generative Modeling
Visualization of the VAE prior hole problem showing a ring-shaped aggregate posterior with an empty center where the Gaussian prior has highest density

A Contrastive Learning Approach for Training Variational Autoencoder Priors

Aneja et al.'s NeurIPS 2021 paper introducing Noise Contrastive Priors (NCPs) to address VAE's 'prior hole' problem with …...

Generative Modeling
Variational Autoencoder architecture diagram showing encoder, latent space, and decoder

Modern PyTorch Techniques for VAEs: A Hands-On Tutorial

Learn to implement VAEs in PyTorch: ELBO objective, reparameterization trick, loss scaling, and MNIST experiments on …

Generative Modeling
Wasserstein distance visualization showing Earth-Mover distance concept for GAN training

GAN Objective Functions: A Comprehensive Guide

Complete guide to GAN objective functions including WGAN, LSGAN, Fisher GAN, and more. Understand which loss function to …

Generative Modeling
Illustration of GAN training process showing adversarial competition between generator and discriminator

Understanding Generative Adversarial Networks (GANs)

Learn about GANs with intuitive explanations and mathematical foundations. Learn how adversarial networks generate …