Mason Wang

Notes Index

• DDPM Math

• DDPM - Reparametrization

• Diffusion Models - UDL Notes

• Gradients and Initialization - UDL

• Loss Functions - UDL

• MLP Interpretation - UDL

• Optimization - UDL

• VAEs - UDL

• Actor Critic

• Advances in Computer Vision

• Geometric Deep Learning

• Image Formation

• Language Modeling from Scratch

• Linear Image Processing

• Policy Gradient

• Bayes

• Biased vs Unbiased Estimates

• CNNs

• Chain Rule

• Classifier Free Guidance

• Conditional Independence

• Convolution

• Cross Entropy

• DDPM Noise Schedules

• Diffusion Best Practices

• Discrete Fourier Transform

• Distributed Training

• Downsampling and Stretching

• Downsampling and Stretching

• Encoder-Decoder Transformers

• Energy-Based Generative Model

• Entropy

• Fine Tuning

• Fourier Dualities

• Functions

• Gated Activations

• Generalized Advantage Estimation

• Generative Modeling Using SDEs

• Gradients

• Group Theory

• Infinitesimals

• Info Theory Basics

• Jensens Inequality

• KL-Divergence

• Large Scale Deep Learning

• Mixed Precision

• Momentum, RMSProp, Adam

• Normalization

• PQMF

• Pink Frequency Profiles

• Pocketed Activation

• Positional Encodings

• Random Variables and Probability Distributions

• Score-Based Generative Models

• Training

• Transformers

• Transpose Convolution

• UNet

• Uniform Width Sampling

• Wiener Process

• ‘1/f noise’ in music and speech

• Concept Activation Vectors

• DAC

• DDIM

• DiT

• DiffWave

• Diffusion Models Beat GANs on Image Synthesis

• Diffusion Forcing

• Edify - Image

• Elucidated Diffusion Models

• Gaussian Splatting

• History Guidance

• PixelVAE

• RLOO

• VAR

• A Brief Introduction To Information

• A Recipe for Training Neural Networks

• An Interpretation of KL Divergence

• File Systems

• Hydra

• Lightning

• PyTorch

• Python

• Slurm

• Wandb

• Webdataset