Evolved Transformer Explained 03-07-2020 03-07-2020 blog 5 minutes read (About 777 words)Evolution Search on Transformer Neural Network Architectures Machine Learning, Deep Learning, Natural Language Processing, Transformer, Neural Architecture Search, Evolution Algorithm Read More
Save, Load and Inference From TensorFlow 2.x Frozen Graph 01-09-2020 01-09-2020 blog 6 minutes read (About 826 words)Continuing to Support Frozen Graph for TensorFlow 2.x Machine Learning, Deep Learning, TensorFlow Read More
TensorFlow Inference for Estimator 08-29-2019 08-29-2019 blog 9 minutes read (About 1392 words)Guidance for Fast TensorFlow Inference Deep Learning, TensorFlow Read More
PyTorch Model Export to ONNX Failed Due to ATen 07-03-2019 07-03-2019 blog 10 minutes read (About 1445 words)A Funny Story About PyTorch, ATen, and ONNX Deep Learning, Software Engineering, PyTorch, ATen, ONNX Read More
Dropout Explained 06-04-2019 06-04-2019 blog 8 minutes read (About 1155 words)The Math of Dropout You Know and Don't Know Machine Learning, Deep Learning Read More
Transformer Explained In One Single Page 06-01-2019 02-09-2023 blog 23 minutes read (About 3454 words)Attention is All You Need Mathematically Deep Learning, Natural Language Processing, Transformer, Machine Translation Read More
Layer Normalization Explained 05-31-2019 12-24-2024 blog 5 minutes read (About 707 words)Layer Normalization vs Batch Normalization vs Instance Normalization Deep Learning Read More
Data Parallelism VS Model Parallelism In Distributed Deep Learning Training 05-23-2019 05-23-2019 blog 7 minutes read (About 1067 words)Some Simple Logic and Theory Behind Deep Learning, Distributed System Read More
YOLO v2 Reorg Layer Explained 04-24-2019 04-24-2019 blog 18 minutes read (About 2716 words)The Most Detailed Explanation on Reorg Layer Deep Learning, Computer Vision Read More
Poolings in Deep Learning 04-19-2019 04-19-2019 blog 5 minutes read (About 731 words)Funny Relationships Between Max Pooling, SPP Pooling, and ROI Pooling Deep Learning, Computer Vision Read More
Tensor Physical Layouts on Memory 04-17-2019 08-23-2021 blog 3 minutes read (About 402 words)Know Your Tensor! Deep Learning, High Performance Computing Read More
Semantic Segmentation Using DeepLab V3 12-11-2018 12-11-2018 project 5 minutes read (About 751 words)Straightforward Implementation of DeepLab V3 Deep Learning, Computer Vision, Semantic Segmentation Read More