Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

浮躁的科研和胡扯的自媒体

 03-27-2026 03-27-2026 essay 6 minutes read (About 890 words)
胡说八道

 
Deep Learning, 
Quantization, 
Computer Engineering, 
Research  
  Read More

NeurIPS 2025 Area Chair Experience

 09-21-2025 09-21-2025 blog 8 minutes read (About 1136 words)
Serving The Dataset and Benchmark Track This Year

 
Deep Learning, 
NeurIPS, 
Conference  
  Read More

TensorRT Plugin Version and Namespace

 09-08-2025 09-08-2025 blog 8 minutes read (About 1152 words)
Handling TensorRT Plugin Conflicts Using Version and Namespace

 
Deep Learning, 
Software Engineering, 
NVIDIA, 
TensorRT  
  Read More

Online Safe Softmax

 06-23-2025 06-23-2025 blog 5 minutes read (About 741 words)
Safe and Efficient Online Softmax Calculation

 
Deep Learning, 
Mathematics, 
Accelerated Computing  
  Read More

TensorRT Static Plugin VS Dynamic Plugin

 06-05-2025 06-05-2025 blog 13 minutes read (About 1941 words)
Managing The Lifetime and Registration of TensorRT Plugins

 
Deep Learning, 
CPP, 
TensorRT  
  Read More

Computing Hessian Matrix Via Automatic Differentiation

 05-22-2025 05-22-2025 blog 18 minutes read (About 2664 words)
Computing Higher-Order Derivatives Using Automatic Differentiation

 
Deep Learning, 
Mathematics, 
Neural Networks, 
Calculus, 
Automatic Differentiation  
  Read More

Optimal Brain Surgeon

 05-14-2025 05-14-2025 blog 40 minutes read (About 6047 words)
Derivation and Extension of The Classical Optimal Brain Surgeon Algorithm

 
Deep Learning, 
Mathematics, 
Neural Networks, 
Calculus, 
Neural Network Pruning  
  Read More

ICML 2025 Area Chair Experience

 05-03-2025 05-03-2025 blog 8 minutes read (About 1181 words)
First Time Serving as ICML Area Chair

 
Machine Learning, 
Deep Learning, 
Conference, 
ICML  
  Read More

TensorRT Implicit Weight Quantization

 04-29-2025 04-29-2025 blog 8 minutes read (About 1265 words)
TensorRT Implicit Weight Quantization Caveats and Tricks

 
Deep Learning, 
Mathematics, 
Quantization, 
TensorRT  
  Read More

Automatic Differentiation Revisited

 04-12-2025 04-12-2025 blog 15 minutes read (About 2198 words)
Jacobian Matrix, De Novo Chain Rule Expression, Jacobian-Vector Product, Vector-Jacobian Product

 
Deep Learning, 
Mathematics, 
Linear Algebra, 
Calculus, 
Automatic Differentiation  
  Read More

Grouped Query Attention Performance Theoretical Analysis

 02-03-2025 03-02-2025 blog 11 minutes read (About 1612 words)
Sharing Key and Value Tensors for a Group of Query Tensors to Mitigate Transformer Attention Layer Performance Bottleneck

 
Deep Learning, 
Neural Network, 
Transformer, 
Performance Optimization, 
Computer Architecture, 
Large Language Model  
  Read More

Transformer Vanilla Attention Performance Theoretical Analysis

 01-27-2025 03-02-2025 blog 9 minutes read (About 1275 words)
Performance Bottleneck for Serving Transformer Models

 
Deep Learning, 
Neural Network, 
Transformer, 
Performance Optimization, 
Computer Architecture, 
Large Language Model  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 8
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1326

Categories

8

Tags

803

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog566
  • essay335
  • life306
  • miscellaneous2
  • photography68
  • project20
  • reading8

follow.it

Recents

03-31-2026

PyTorch Export

blog

03-28-2026

2026 Western Pacific 5K 竞赛

life

03-27-2026

浮躁的科研和胡扯的自媒体

essay

03-25-2026

Connecting Logitech Devices On Linux

blog

03-22-2026

2026 Oakland Half Marathon 竞赛

life

Archives

  • March 202618
  • February 202617
  • January 202616
  • December 202535
  • November 202525
  • See All >>

Tags

Outdoors311
California242
Hiking236
CPP121
Mathematics102
Deep Learning85
Photography82
CUDA72
Running66
Wildlife59
Bird53
Racing44
Python36
Software Engineering36
Machine Learning34
Movie34
Statistics32
China31
Linux31
NVIDIA31
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×