PyTorch Automatic Differentiation 03-15-2022 03-15-2022 blog 18 minutes read (About 2737 words)Automatic Differentiation in Forward Mode and Reverse Mode Using PyTorch autograd and functorch Deep Learning, Mathematics, PyTorch Read More
Automatic Differentiation 02-21-2022 06-28-2023 article 34 minutes read (About 5117 words)Mathematical Foundations to Neural Network Optimization Machine Learning, Deep Learning, Mathematics, Mathematical Optimization Read More
PyTorch Distributed Evaluation 02-05-2022 02-05-2022 blog 15 minutes read (About 2203 words)Distributed Evaluation for Deep Learning Model on Large Volume of Data Deep Learning, PyTorch, Distributed Computing Read More
Convolution Shape Inference 01-17-2022 01-17-2022 blog 2 minutes read (About 291 words)Compute Convolution Output Shape from Configurations Deep Learning, Mathematics Read More
ONNX IO Stream 01-03-2022 05-01-2025 blog 3 minutes read (About 477 words)Hard Drive Free ONNX IO Machine Learning, Deep Learning, ONNX Read More
Transposed Convolution as Convolution 11-22-2021 11-22-2021 blog 13 minutes read (About 2016 words)Understand Transposed Convolution as Convolution Deep Learning Read More
Depthwise Separable Convolution 11-08-2021 11-08-2021 blog 7 minutes read (About 1018 words)Reducing Memory and Math Bandwidth Requirements for Convolution Deep Learning, Mathematics Read More
Multi-Thread Single-Stream VS Single-Thread Multi-Stream CUDA 10-18-2021 05-12-2022 blog 13 minutes read (About 1946 words)CUDA Programming Choices for CUDA Stream Deep Learning, Mathematics, CUDA, High Performance Computing, Computer Architecture, Parallel Computing Read More
Math-Bound VS Memory-Bound Operations 10-11-2021 09-18-2023 blog 8 minutes read (About 1188 words)Computation Bandwidth, Memory Bandwidth, and Data Reuse Deep Learning, Mathematics, Computer Architecture Read More
Fast Fourier Transform for Convolution 10-04-2021 09-20-2022 blog 9 minutes read (About 1346 words)Understand Asymptotically Faster Convolution Using Fast Fourier Transform Deep Learning, Mathematics Read More
Cross-Correlation VS Convolution 09-27-2021 09-27-2021 blog 6 minutes read (About 903 words)A Historical Ambiguity in Deep Learning Deep Learning, Mathematics Read More
Creating and Modifying ONNX Model Using ONNX Python API 09-15-2021 09-15-2021 blog 12 minutes read (About 1866 words)Getting Familiar with ONNX Data Structure and Python API Usages Deep Learning, ONNX Read More