Transformer Autoregressive Inference Optimization 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)Principles for Faster Transformer Inference Deep Learning, Inference, Natural Language Processing, Optimization, Transformer, Accelerated Computing Read More
Solving 0-1 Knapsack Problems 02-13-2023 02-13-2023 blog 11 minutes read (About 1582 words)Recursion, Dynamic Programming, and Linear Programming Python, Optimization, Linear Programming, Recursion, Dynamic Programming Read More
Maximum Likelihood Estimation VS Maximum A Posteriori Estimation 07-02-2021 07-02-2021 blog 6 minutes read (About 941 words)MLE VS MAP Mathematics, Optimization Read More
Hessian Matrix of Convex Functions 06-24-2021 06-23-2023 blog 19 minutes read (About 2922 words)Verification of Convex Functions using Hessian Matrix Mathematics, Optimization Read More
Minimax Game for Training Generative Adversarial Networks 10-07-2020 05-07-2023 blog 10 minutes read (About 1426 words)Some Intuitions to Training Generative Adversarial Networks Deep Learning, Generative Adversarial Networks, Optimization, GAN, Neural Networks Read More
Newton-Raphson Method 09-27-2020 09-27-2020 blog 5 minutes read (About 771 words)Approximate Algorithm for Finding Roots to Real-Valued Function Optimization Read More
Cross Entropy Loss VS Log Loss VS Sum of Log Loss 07-18-2020 07-18-2020 blog 23 minutes read (About 3404 words)Conventional Classification Loss Functions Elucidated Machine Learning, Mathematics, Optimization Read More
Population Based Training 06-28-2020 06-28-2020 blog 14 minutes read (About 2061 words)Model Optimization with Genetically Evolved Hyperparameters Machine Learning, Optimization, Genetics Algorithm Read More
Word2Vec Models Revisited 08-23-2019 08-23-2019 article 24 minutes read (About 3525 words)A Review on the Classic Word2Vec Models Machine Learning, Natural Language Processing, Optimization Read More
Hierarchical Softmax 08-17-2019 08-17-2019 article 8 minutes read (About 1194 words)Orchestrated Softmax for Fast Language Model Training Machine Learning, Natural Language Processing, Optimization Read More