NaokiDartmouth Conference, AI in 1956What happened in the first AI boom start? How did it end, and why?Aug 9, 2021Aug 9, 2021
NaokiGradient Descent OptimizersUnderstanding SGD, Momentum, Nesterov Momentum, AdaGrad, RMSprop, AdaDelta, and ADAMAug 29, 2021Aug 29, 2021
NaokiMatrix Decomposition DemystifiedEigen Decomposition, SVD, and Pseudo-inverse MatrixAug 30, 2021Aug 30, 2021
NaokiMonty Hall Problem RevisitedThe famous Monty Hall Problem requires a non-intuitive solution — revisited in a story of three math fans.Jul 26, 20211Jul 26, 20211
NaokiBayes Theorem DemystifiedDo we really need the Bayes theorem? Can we do everything with the conditionals and marginals?Jul 19, 20211Jul 19, 20211
NaokiNormal Distribution DemystifiedUnderstanding the Maximum Entropy PrincipleOct 24, 2020Oct 24, 2020
NaokiCalculus of Variations DemystifiedHow to derive the Euler-Lagrange equationOct 18, 20202Oct 18, 20202
NaokiKL Divergence DemystifiedWhat does KL stand for? Is it a distance measure? What does it mean to measure the similarity of two probability distributions?Nov 5, 201816Nov 5, 201816
NaokiCross-Entropy DemystifiedWhat is it? Is there any relation to the entropy concept? Why is it used for classification loss? What about the binary cross-entropy?Oct 28, 201814Oct 28, 201814
NaokiSudoku Solver by Peter NorvigI recently came across Peter Norvig’s Solving Every Sudoku Puzzle. I was impressed with his concise and beautiful Python code that solves…Jan 27, 20175Jan 27, 20175
