Stochastic Gradient Descent: Theory, Numerical Examples, and Implementation
A comprehensive guide to Stochastic Gradient Descent (SGD), covering mathematical foundations, variance analysis, convergence theory, numerical step-by-step ...
Recent Posts
Mathematical Foundations of Contrastive Loss
Explore the mathematical principles behind contrastive loss, InfoNCE, and supervised contrastive learning.
Cross Entropy from First Principles
A derivation of binary cross entropy to showcase its mathematical foundation
Generating new samples with Variational Autoencoders
KL Divergence (Dipesh Dai) Limitations of Autoencoder (Suruchi) Variational Autoencoder Basic Architecture of Variational Autoencoder (Rajan) Loss of VAE...
Introduction to Autoencoder
Autoencoder Difference between generative and discriminative modelling Generative modelling Generative modelling is a statistical modeling technique that ...