Numerical Errors In HPC and Deep Learning 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)Numerical Errors are Evil Deep Learning, High Performance Computing, Numerical Errors Read More
Deformable Attention 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)Attention with Learned Spatial Feature Sampling Deep Learning, Computer Vision, Transformer, Attention Read More
Deformable Convolution 12-08-2023 12-08-2023 blog 6 minutes read (About 889 words)Convolution with Learned Spatial Feature Sampling Deep Learning, Computer Vision, Convolution Read More
Function Approximation Using Lookup Table and Interpolation 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)Using Motorola CPU32 as an Example Deep Learning, Computer Architecture, Quantization Read More
ONNX Opset Operator Counts 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)How ONNX Expands the Support for Deep Learning Inference Over the Years Deep Learning, JavaScript, ONNX Read More
PyTorch Leaf Tensor 06-19-2023 06-19-2023 blog 10 minutes read (About 1503 words)Understanding PyTorch Leaf Tensor Deep Learning, PyTorch, Graph Algorithm Read More
Contribute To ONNX 05-28-2023 05-28-2023 blog 5 minutes read (About 694 words)Personal Unwarranted ONNX Contribution Guideline Deep Learning, ONNX Read More
ONNX Runtime Python Inference 04-25-2023 04-02-2025 blog 5 minutes read (About 691 words)ONNX Runtime Python Inference Example Deep Learning, Python, Software Engineering, ONNX Read More
OpenAI GPT Models 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)Generative Pre-Trained Transformer Models From OpenAI Deep Learning, Natural Language Processing, Reinforcement Learning, Transformer, GPT, OpenAI, ChatGPT, InstructGPT Read More
Transformer Autoregressive Inference Optimization 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)Principles for Faster Transformer Inference Deep Learning, Inference, Natural Language Processing, Transformer, Optimization, Accelerated Computing Read More
Neural Network Mixed Precision Training 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)Accelerated Low Bit-Width Neural Network Training Machine Learning, Deep Learning, Mathematics Read More
Exponential Moving Average 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)Neural Network Training Trick Improves Model Generalization Machine Learning, Deep Learning, Statistics, Mathematics Read More