Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Deformable Attention

 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)
Attention with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Transformer, 
Attention  
  Read More

Deformable Convolution

 12-08-2023 12-08-2023 blog 6 minutes read (About 889 words)
Convolution with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Convolution  
  Read More

Function Approximation Using Lookup Table and Interpolation

 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)
Using Motorola CPU32 as an Example

 
Deep Learning, 
Quantization, 
Computer Architecture  
  Read More

ONNX Opset Operator Counts

 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)
How ONNX Expands the Support for Deep Learning Inference Over the Years

 
Deep Learning, 
JavaScript, 
ONNX  
  Read More

PyTorch Leaf Tensor

 06-19-2023 06-19-2023 blog 10 minutes read (About 1503 words)
Understanding PyTorch Leaf Tensor

 
Deep Learning, 
PyTorch, 
Graph Algorithm  
  Read More

Contribute To ONNX

 05-28-2023 05-28-2023 blog 5 minutes read (About 694 words)
Personal Unwarranted ONNX Contribution Guideline

 
Deep Learning, 
ONNX  
  Read More

ONNX Runtime Python Inference

 04-25-2023 04-02-2025 blog 5 minutes read (About 691 words)
ONNX Runtime Python Inference Example

 
Deep Learning, 
Python, 
Software Engineering, 
ONNX  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1243

Categories

8

Tags

773

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog549
  • essay315
  • life280
  • miscellaneous2
  • photography49
  • project20
  • reading8

follow.it

Recents

12-06-2025

NVIDIA Tensor Core TN Layout MMA Instruction

blog

12-06-2025

网红的自杀式挑战

essay

12-06-2025

2025 Midway Shelter Winter Run 10K 竞赛

life

12-02-2025

Replacing Thinkpad X1 Yoga CMOS Battery

blog

11-30-2025

避免使用劣质湿巾

essay

Archives

  • December 20254
  • November 202525
  • October 202524
  • September 202515
  • August 202527
  • See All >>

Tags

Outdoors285
Hiking217
California216
CPP117
Mathematics102
Deep Learning84
CUDA67
Photography62
Running58
Wildlife41
Racing37
Bird36
Software Engineering36
Machine Learning34
Python34
Movie33
Statistics32
Park31
Linux30
China29
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×