CUDA Matrix Multiplication Optimization 01-20-2024 01-20-2024 article 2 hours read (About 19315 words)General Matrix Multiplication CUDA Performance Optimization CPP, Accelerated Computing, CUDA, NVIDIA Read more
How To Debug Deep Learning Inference Applications 01-01-2024 01-01-2024 article 23 minutes read (About 3511 words)First Principles of Evaluating Deep Learning Inference Deep Learning, Software Engineering, Deep Learning Inference, Numerical Errors Read more
Interpolation 06-07-2023 06-07-2023 article 27 minutes read (About 4120 words)One of the Most Widely Used Estimation Methods Computer Vision, Mathematics, Signal Processing Read more
OpenAI GPT Models 04-15-2023 04-15-2023 article 28 minutes read (About 4161 words)Generative Pre-Trained Transformer Models From OpenAI Deep Learning, Natural Language Processing, Transformer, Reinforcement Learning, OpenAI, GPT, ChatGPT, InstructGPT Read more
Transformer Autoregressive Inference Optimization 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)Principles for Faster Transformer Inference Deep Learning, Inference, Natural Language Processing, Optimization, Transformer, Accelerated Computing Read more
Hamming Code 06-01-2022 06-01-2022 article 29 minutes read (About 4421 words)Create Perfect Error-Correction Hamming Code From Scratch Telecommunication, Computer Science Read more
Automatic Differentiation 02-21-2022 06-28-2023 article 34 minutes read (About 5117 words)Mathematical Foundations to Neural Network Optimization Machine Learning, Deep Learning, Mathematics, Mathematical Optimization Read more
Pruning for Neural Networks 03-01-2021 03-01-2021 article 14 minutes read (About 2172 words)Mathematical Foundations to Neural Network Pruning Machine Learning, Deep Learning, Mathematics Read more
Principal Component Analysis 05-17-2020 05-17-2020 article 25 minutes read (About 3737 words)Fundamentals to Principal Component Analysis Mathematics, Principal Component Analysis Read more
Quantization for Neural Networks 05-17-2020 02-09-2023 article an hour read (About 6955 words)Mathematical Foundations to Neural Network Quantization Machine Learning, Deep Learning, Mathematics Read more