Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning Inference

PyTorch Multi-Process Inference Weight Sharing Via Inter-Process Communication

 07-31-2026 09-02-2026 blog 17 minutes read (About 2564 words)
Avoiding Weight Duplication In PyTorch Multi-Process Inference

 
Deep Learning Inference, 
CUDA, 
PyTorch, 
AOTInductor  
  Read More

Synchronizations With TorchRec KeyedJaggedTensor

 06-05-2026 06-05-2026 blog 8 minutes read (About 1188 words)
Efficiently Using TorchRec KeyedJaggedTensor In GPU Systems

 
Deep Learning Inference, 
PyTorch, 
GPU, 
TorchRec  
  Read More

PyTorch AOTInductor Hybrid Lowering

 05-28-2026 05-28-2026 blog 8 minutes read (About 1224 words)
A Hybrid DeviceExecution Inference Engine from PyTorch

 
Deep Learning Inference, 
PyTorch  
  Read More

PyTorch Triton Kernel Transparent Tracing and Compilation

 05-22-2026 05-22-2026 blog 27 minutes read (About 4044 words)
Exporting and Compiling Triton Kernels for AOTInductor

 
Deep Learning Inference, 
PyTorch, 
AOTInductor, 
Triton  
  Read More

PyTorch Fake Export

 05-17-2026 05-17-2026 blog 11 minutes read (About 1634 words)
Eliminating PyTorch Model Data Memory Allocation for PyTorch Export Verification

 
Deep Learning Inference, 
PyTorch  
  Read More

How To Debug Deep Learning Inference Applications

 01-01-2024 01-01-2024 article 23 minutes read (About 3511 words)
First Principles of Evaluating Deep Learning Inference

 
Deep Learning, 
Software Engineering, 
Deep Learning Inference, 
Numerical Errors  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1506

Categories

8

Tags

852

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog597
  • essay380
  • life367
  • miscellaneous2
  • photography111
  • project20
  • reading8

follow.it

Recents

11-16-2026

AOTInductor Compile Cache

blog

11-16-2026

San Mateo County Parks Take A Hike Challenge 2026

essay

11-15-2026

2026 Morgan Hill Veterans Day Run 5K 竞赛

life

11-14-2026

Raptor Fest at Rancho San Vicente 参观

life

11-14-2026

Raptor Fest at Rancho San Vicente

photography

Archives

  • November 202612
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors374
California308
Hiking278
Photography130
CPP125
Mathematics104
Wildlife98
Bird91
Running88
CUDA87
Deep Learning87
Racing63
Movie52
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
PyTorch35
Accelerated Computing34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×