Simple Inference Server 12-30-2020 12-30-2020 project 7 minutes read (About 979 words)Running Machine Learning Inference as Service from Scratch Machine Learning, Deep Learning, Python, Inference Read More
Cross Entropy Loss VS Log Loss VS Sum of Log Loss 07-18-2020 07-18-2020 blog 23 minutes read (About 3404 words)Conventional Classification Loss Functions Elucidated Machine Learning, Mathematics, Optimization Read More
Population Based Training 06-28-2020 06-28-2020 blog 14 minutes read (About 2061 words)Model Optimization with Genetically Evolved Hyperparameters Machine Learning, Optimization, Genetics Algorithm Read More
Quantization for Neural Networks 05-17-2020 02-09-2023 article an hour read (About 6957 words)Mathematical Foundations to Neural Network Quantization Machine Learning, Deep Learning, Mathematics, Neural Network, Quantization, Matrix Multiplication Read More
Gated Linear Units (GLU) and Gated CNN 03-09-2020 03-09-2020 blog 6 minutes read (About 827 words)Gated Linear Units and Gated CNN Explained Machine Learning, Deep Learning, Natural Language Processing Read More
Evolved Transformer Explained 03-07-2020 03-07-2020 blog 5 minutes read (About 777 words)Evolution Search on Transformer Neural Network Architectures Machine Learning, Deep Learning, Natural Language Processing, Transformer, Neural Architecture Search, Evolution Algorithm Read More
Group Lasso 02-13-2020 02-13-2020 blog 5 minutes read (About 744 words)Understand the Sparsity Introduced by Group Lasso Machine Learning, Statistics Read More
Gradient Boosting Machine 01-26-2020 01-26-2020 article 12 minutes read (About 1779 words)Fundamental Theories of Gradient Boosting Machine Machine Learning, Data Science Read More
Save, Load and Inference From TensorFlow 2.x Frozen Graph 01-09-2020 01-09-2020 blog 6 minutes read (About 826 words)Continuing to Support Frozen Graph for TensorFlow 2.x Machine Learning, Deep Learning, TensorFlow Read More
Word2Vec Models Revisited 08-23-2019 08-23-2019 article 24 minutes read (About 3525 words)A Review on the Classic Word2Vec Models Machine Learning, Natural Language Processing, Optimization Read More
Hierarchical Softmax 08-17-2019 08-17-2019 article 8 minutes read (About 1194 words)Orchestrated Softmax for Fast Language Model Training Machine Learning, Natural Language Processing, Optimization Read More
Label Smoothing 08-11-2019 12-26-2020 blog 6 minutes read (About 956 words)Regularization for Classification Models Machine Learning, Optimization, Regularization Read More