Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Deformable Attention

 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)
Attention with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Transformer, 
Attention  
  Read More

Deformable Convolution

 12-08-2023 12-08-2023 blog 6 minutes read (About 889 words)
Convolution with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Convolution  
  Read More

Function Approximation Using Lookup Table and Interpolation

 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)
Using Motorola CPU32 as an Example

 
Deep Learning, 
Quantization, 
Computer Architecture  
  Read More

ONNX Opset Operator Counts

 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)
How ONNX Expands the Support for Deep Learning Inference Over the Years

 
Deep Learning, 
JavaScript, 
ONNX  
  Read More

PyTorch Leaf Tensor

 06-19-2023 06-19-2023 blog 10 minutes read (About 1503 words)
Understanding PyTorch Leaf Tensor

 
Deep Learning, 
PyTorch, 
Graph Algorithm  
  Read More

Contribute To ONNX

 05-28-2023 05-28-2023 blog 5 minutes read (About 694 words)
Personal Unwarranted ONNX Contribution Guideline

 
Deep Learning, 
ONNX  
  Read More

ONNX Runtime Python Inference

 04-25-2023 04-02-2025 blog 5 minutes read (About 691 words)
ONNX Runtime Python Inference Example

 
Deep Learning, 
Python, 
Software Engineering, 
ONNX  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1279

Categories

8

Tags

786

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog556
  • essay323
  • life291
  • miscellaneous2
  • photography59
  • project20
  • reading8

follow.it

Recents

01-24-2026

Pleasanton Ridge Regional Park 徒步

life

01-24-2026

Pleasanton Ridge Regional Park

photography

01-23-2026

Xfinity Internet 多年来的使用感受

essay

01-19-2026

Randomized SVD

blog

01-17-2026

Don Castro Regional Recreation Area 徒步

life

Archives

  • January 202613
  • December 202527
  • November 202525
  • October 202524
  • September 202515
  • See All >>

Tags

Outdoors296
Hiking228
California227
CPP119
Mathematics102
Deep Learning84
Photography73
CUDA69
Running59
Wildlife50
Bird45
Racing37
Python36
Software Engineering36
Machine Learning34
Movie33
Statistics32
Park31
Linux30
China29
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×