Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Deformable Attention

 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)
Attention with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Transformer, 
Attention  
  Read More

Deformable Convolution

 12-08-2023 12-08-2023 blog 6 minutes read (About 889 words)
Convolution with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Convolution  
  Read More

Function Approximation Using Lookup Table and Interpolation

 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)
Using Motorola CPU32 as an Example

 
Deep Learning, 
Quantization, 
Computer Architecture  
  Read More

ONNX Opset Operator Counts

 07-10-2023 07-10-2023 blog 4 minutes read (About 549 words)
How ONNX Expands the Support for Deep Learning Inference Over the Years

 
Deep Learning, 
JavaScript, 
ONNX  
  Read More

PyTorch Leaf Tensor

 06-19-2023 06-19-2023 blog 10 minutes read (About 1503 words)
Understanding PyTorch Leaf Tensor

 
Deep Learning, 
PyTorch, 
Graph Algorithm  
  Read More

Contribute To ONNX

 05-28-2023 05-28-2023 blog 5 minutes read (About 694 words)
Personal Unwarranted ONNX Contribution Guideline

 
Deep Learning, 
ONNX  
  Read More

ONNX Runtime Python Inference

 04-25-2023 04-02-2025 blog 5 minutes read (About 691 words)
ONNX Runtime Python Inference Example

 
Deep Learning, 
Python, 
Software Engineering, 
ONNX  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1313

Categories

8

Tags

798

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog562
  • essay332
  • life302
  • miscellaneous2
  • photography66
  • project20
  • reading8

follow.it

Recents

03-08-2026

2026 Union City Superhero Fun Run 5K 竞赛

life

03-07-2026

McLaughlin Eastshore State Park 徒步

life

03-07-2026

McLaughlin Eastshore State Park

photography

03-06-2026

Cloudflare Worker Proxy R2 Bucket Access

blog

03-05-2026

Zorro 和 Batman

essay

Archives

  • March 20265
  • February 202617
  • January 202616
  • December 202535
  • November 202525
  • See All >>

Tags

Outdoors307
California238
Hiking234
CPP120
Mathematics102
Deep Learning84
Photography80
CUDA71
Running64
Wildlife57
Bird51
Racing42
Python36
Software Engineering36
Machine Learning34
Movie34
Statistics32
China31
NVIDIA31
Park31
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×