Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Deformable Attention

 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)
Attention with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Transformer, 
Attention  
  Read More

Deformable Convolution

 12-08-2023 12-08-2023 blog 6 minutes read (About 889 words)
Convolution with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Convolution  
  Read More

Function Approximation Using Lookup Table and Interpolation

 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)
Using Motorola CPU32 as an Example

 
Deep Learning, 
Quantization, 
Computer Architecture  
  Read More

ONNX Opset Operator Counts

 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)
How ONNX Expands the Support for Deep Learning Inference Over the Years

 
Deep Learning, 
JavaScript, 
ONNX  
  Read More

PyTorch Leaf Tensor

 06-19-2023 06-19-2023 blog 10 minutes read (About 1503 words)
Understanding PyTorch Leaf Tensor

 
Deep Learning, 
PyTorch, 
Graph Algorithm  
  Read More

Contribute To ONNX

 05-28-2023 05-28-2023 blog 5 minutes read (About 694 words)
Personal Unwarranted ONNX Contribution Guideline

 
Deep Learning, 
ONNX  
  Read More

ONNX Runtime Python Inference

 04-25-2023 04-02-2025 blog 5 minutes read (About 691 words)
ONNX Runtime Python Inference Example

 
Deep Learning, 
Python, 
Software Engineering, 
ONNX  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1256

Categories

8

Tags

776

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog552
  • essay319
  • life283
  • miscellaneous2
  • photography52
  • project20
  • reading8

follow.it

Recents

12-26-2025

指甲盖下的淤血

essay

12-25-2025

NVIDIA NVML GPU Statistics

blog

12-20-2025

Los Gatos Creek County Park

photography

12-20-2025

Sony Float Run Open-Ear Wireless Headphones

essay

12-20-2025

Los Gatos Creek County Park 徒步

life

Archives

  • December 202517
  • November 202525
  • October 202524
  • September 202515
  • August 202527
  • See All >>

Tags

Outdoors288
Hiking220
California219
CPP119
Mathematics102
Deep Learning84
CUDA68
Photography65
Running59
Wildlife44
Bird39
Racing37
Software Engineering36
Python35
Machine Learning34
Movie33
Statistics32
Park31
Linux30
China29
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×