Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
High Performance Computing, 
Numerical Errors  
  Read More

Deformable Attention

 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)
Attention with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Transformer, 
Attention  
  Read More

Deformable Convolution

 12-08-2023 12-08-2023 blog 6 minutes read (About 889 words)
Convolution with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Convolution  
  Read More

Function Approximation Using Lookup Table and Interpolation

 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)
Using Motorola CPU32 as an Example

 
Deep Learning, 
Computer Architecture, 
Quantization  
  Read More

ONNX Opset Operator Counts

 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)
How ONNX Expands the Support for Deep Learning Inference Over the Years

 
Deep Learning, 
JavaScript, 
ONNX  
  Read More

PyTorch Leaf Tensor

 06-19-2023 06-19-2023 blog 10 minutes read (About 1503 words)
Understanding PyTorch Leaf Tensor

 
Deep Learning, 
PyTorch, 
Graph Algorithm  
  Read More

Contribute To ONNX

 05-28-2023 05-28-2023 blog 5 minutes read (About 694 words)
Personal Unwarranted ONNX Contribution Guideline

 
Deep Learning, 
ONNX  
  Read More

ONNX Runtime Python Inference

 04-25-2023 04-02-2025 blog 5 minutes read (About 691 words)
ONNX Runtime Python Inference Example

 
Deep Learning, 
Python, 
Software Engineering, 
ONNX  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Reinforcement Learning, 
Transformer, 
GPT, 
OpenAI, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Transformer, 
Optimization, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1197

Categories

8

Tags

750

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog537
  • essay304
  • life267
  • miscellaneous2
  • photography39
  • project20
  • reading8

follow.it

Recents

10-10-2025

Setting Up Environment Variables In SSH Sessions Over TCP On Runpod

blog

10-08-2025

Setting Up Remote Development Using Custom Template On Runpod

blog

10-07-2025

恶魔阿萨谢尔在召唤你

essay

10-04-2025

Bair Island

photography

10-04-2025

汉堡王 Monster 套餐

essay

Archives

  • October 20257
  • September 202515
  • August 202527
  • July 202523
  • June 202547
  • See All >>

Tags

Outdoors272
Hiking206
California203
CPP114
Mathematics100
Deep Learning84
CUDA61
Running52
Photography47
Software Engineering36
Machine Learning34
Python34
Racing34
Movie32
Statistics31
Bird30
Linux30
Park30
Wildlife30
China29
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×