Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Neural Network Mixed Precision Training

 01-31-2023 04-26-2024 blog 15 minutes read (About 2215 words)
Accelerated Low Bit-Width Neural Network Training

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Exponential Moving Average

 01-26-2023 02-28-2023 blog 7 minutes read (About 1003 words)
Neural Network Training Trick Improves Model Generalization

 
Machine Learning, 
Deep Learning, 
Statistics, 
Mathematics  
  Read More

Tensor Rank VS Matrix Rank

 01-03-2023 01-03-2023 blog 5 minutes read (About 817 words)
Connections Between Tensor Rank and Matrix Rank

 
Deep Learning, 
Mathematics  
  Read More

ONNX Runtime JavaScript

 11-28-2022 11-28-2022 blog 16 minutes read (About 2458 words)
Front-End Neural Network Inference

 
Artificial Intelligence, 
Deep Learning, 
Inference, 
ONNX, 
Neural Networks  
  Read More

Setting Up Netron Server

 06-07-2022 06-07-2022 blog 3 minutes read (About 392 words)
Viewing Neural Networks Remotely

 
Deep Learning, 
Netron  
  Read More

PyTorch Automatic Differentiation

 03-15-2022 03-15-2022 blog 18 minutes read (About 2737 words)
Automatic Differentiation in Forward Mode and Reverse Mode Using PyTorch autograd and functorch

 
Deep Learning, 
Mathematics, 
PyTorch  
  Read More

Automatic Differentiation

 02-21-2022 06-28-2023 article 34 minutes read (About 5117 words)
Mathematical Foundations to Neural Network Optimization

 
Machine Learning, 
Deep Learning, 
Mathematics, 
Mathematical Optimization  
  Read More

PyTorch Distributed Evaluation

 02-05-2022 02-05-2022 blog 15 minutes read (About 2203 words)
Distributed Evaluation for Deep Learning Model on Large Volume of Data

 
Deep Learning, 
PyTorch, 
Distributed Computing  
  Read More

Convolution Shape Inference

 01-17-2022 01-17-2022 blog 2 minutes read (About 291 words)
Compute Convolution Output Shape from Configurations

 
Deep Learning, 
Mathematics  
  Read More

ONNX IO Stream

 01-03-2022 05-01-2025 blog 3 minutes read (About 477 words)
Hard Drive Free ONNX IO

 
Machine Learning, 
Deep Learning, 
ONNX  
  Read More

Transposed Convolution as Convolution

 11-22-2021 11-22-2021 blog 13 minutes read (About 2016 words)
Understand Transposed Convolution as Convolution

 
Deep Learning  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • 4
  • 5
  • …
  • 8
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1372

Categories

8

Tags

819

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog576
  • essay348
  • life320
  • miscellaneous2
  • photography77
  • project20
  • reading8

follow.it

Recents

06-05-2026

Synchronizations With TorchRec KeyedJaggedTensor

blog

06-01-2026

Pacific Commons Linear Park 徒步

life

06-01-2026

Pacific Commons Linear Park

photography

05-31-2026

2026 San Jose Half Marathon 竞赛

life

05-30-2026

目标

essay

Archives

  • June 20263
  • May 202624
  • April 202618
  • March 202618
  • February 202617
  • See All >>

Tags

Outdoors325
California256
Hiking244
CPP122
Mathematics102
Photography91
Deep Learning87
CUDA75
Running74
Wildlife68
Bird62
Racing50
Movie40
Python37
Software Engineering36
Machine Learning35
China33
Linux32
NVIDIA32
Statistics32
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×