Function Approximation Using Lookup Table and Interpolation 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)Using Motorola CPU32 as an Example Deep Learning, Computer Architecture, Quantization Read more
ONNX Opset Operator Counts 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)How ONNX Expands the Support for Deep Learning Inference Over the Years Deep Learning, JavaScript, ONNX Read more
PyTorch Leaf Tensor 06-19-2023 06-19-2023 blog 10 minutes read (About 1502 words)Understanding PyTorch Leaf Tensor Deep Learning, PyTorch, Graph Algorithm Read more
Contribute To ONNX 05-28-2023 05-28-2023 blog 5 minutes read (About 692 words)Personal Unwarranted ONNX Contribution Guideline Deep Learning, ONNX Read more
ONNX Runtime Python Inference 04-25-2023 04-25-2023 blog 5 minutes read (About 691 words)ONNX Runtime Python Inference Example Deep Learning, Python, Software Engineering, ONNX Read more
OpenAI GPT Models 04-15-2023 04-15-2023 article 28 minutes read (About 4161 words)Generative Pre-Trained Transformer Models From OpenAI Deep Learning, Natural Language Processing, Transformer, Reinforcement Learning, OpenAI, GPT, ChatGPT, InstructGPT Read more
Transformer Autoregressive Inference Optimization 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)Principles for Faster Transformer Inference Deep Learning, Inference, Natural Language Processing, Optimization, Transformer, Accelerated Computing Read more
Neural Network Mixed Precision Training 01-31-2023 01-31-2023 blog 13 minutes read (About 1968 words)Accelerated Low Bit-Width Neural Network Training Machine Learning, Deep Learning, Mathematics Read more
Exponential Moving Average 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)Neural Network Training Trick Improves Model Generalization Machine Learning, Deep Learning, Mathematics, Statistics Read more
Tensor Rank VS Matrix Rank 01-03-2023 01-03-2023 blog 5 minutes read (About 817 words)Connections Between Tensor Rank and Matrix Rank Deep Learning, Mathematics Read more