Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More

Tensor Rank VS Matrix Rank

 01-03-2023 01-03-2023 blog 5 minutes read (About 817 words)
Connections Between Tensor Rank and Matrix Rank

 
Deep Learning, 
Mathematics  
  Read More

ONNX Runtime JavaScript

 11-28-2022 11-28-2022 blog 16 minutes read (About 2458 words)
Front-End Neural Network Inference

 
Artificial Intelligence, 
Deep Learning, 
Inference, 
ONNX, 
Neural Networks  
  Read More

Setting Up Netron Server

 06-07-2022 06-07-2022 blog 3 minutes read (About 392 words)
Viewing Neural Networks Remotely

 
Deep Learning, 
Netron  
  Read More

PyTorch Automatic Differentiation

 03-15-2022 03-15-2022 blog 18 minutes read (About 2737 words)
Automatic Differentiation in Forward Mode and Reverse Mode Using PyTorch autograd and functorch

 
Deep Learning, 
Mathematics, 
PyTorch  
  Read More

Automatic Differentiation

 02-21-2022 06-28-2023 article 34 minutes read (About 5117 words)
Mathematical Foundations to Neural Network Optimization

 
Machine Learning, 
Deep Learning, 
Mathematics, 
Mathematical Optimization  
  Read More

PyTorch Distributed Evaluation

 02-05-2022 02-05-2022 blog 15 minutes read (About 2203 words)
Distributed Evaluation for Deep Learning Model on Large Volume of Data

 
Deep Learning, 
PyTorch, 
Distributed Computing  
  Read More

Convolution Shape Inference

 01-17-2022 01-17-2022 blog 2 minutes read (About 291 words)
Compute Convolution Output Shape from Configurations

 
Deep Learning, 
Mathematics  
  Read More

ONNX IO Stream

 01-03-2022 05-01-2025 blog 3 minutes read (About 477 words)
Hard Drive Free ONNX IO

 
Machine Learning, 
Deep Learning, 
ONNX  
  Read More

Transposed Convolution as Convolution

 11-22-2021 11-22-2021 blog 13 minutes read (About 2016 words)
Understand Transposed Convolution as Convolution

 
Deep Learning  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • 5
  • …
  • 8
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1468

Categories

8

Tags

845

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog591
  • essay370
  • life355
  • miscellaneous2
  • photography101
  • project20
  • reading8

follow.it

Recents

10-03-2026

East Bay Regional Park Trails Challenge 2026

essay

10-03-2026

2026 Pace For Peace 10K 竞赛

life

10-03-2026

Sycamore Grove Park 徒步

life

10-03-2026

Sycamore Grove Park

photography

10-02-2026

AOTInductor Triton SASS Inspection

blog

Archives

  • October 20265
  • September 202624
  • August 202625
  • July 202623
  • June 202621
  • See All >>

Tags

Outdoors361
California294
Hiking269
CPP123
Photography117
Mathematics103
Wildlife91
Deep Learning87
Bird85
Running84
CUDA83
Racing60
Movie48
Python38
Software Engineering36
China35
Machine Learning35
PyTorch34
Accelerated Computing33
Linux33
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×