Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • PyTorch

AOTInductor External Weight Storage and Weight Streaming Update

 08-27-2026 08-27-2026 blog 14 minutes read (About 2110 words)
AOTInductor Weight Streaming from PyTorch Models

 
PyTorch, 
AOTInductor, 
TorchInductor  
  Read More

PyTorch Asynchronous Assert

 08-14-2026 08-14-2026 blog 11 minutes read (About 1587 words)
Using torch._assert_async for PyTorch CUDA Model Development

 
CUDA, 
PyTorch, 
Perfetto, 
Triton  
  Read More

PyTorch Multi-Process Inference Weight Sharing Via Inter-Process Communication

 07-31-2026 07-31-2026 blog 17 minutes read (About 2500 words)
Avoiding Weight Duplication In PyTorch Multi-Process Inference

 
Deep Learning Inference, 
PyTorch, 
AOTInductor  
  Read More

Predicated Execution VS Conditional Execution

 07-01-2026 07-02-2026 blog 17 minutes read (About 2609 words)
where VS cond

 
Accelerated Computing, 
CUDA, 
TensorRT, 
PyTorch, 
GPU, 
AOTInductor, 
TorchInductor, 
JAX, 
XLA, 
TPU  
  Read More

Synchronizations With TorchRec KeyedJaggedTensor

 06-05-2026 06-05-2026 blog 8 minutes read (About 1188 words)
Efficiently Using TorchRec KeyedJaggedTensor In GPU Systems

 
Deep Learning Inference, 
PyTorch, 
GPU, 
TorchRec  
  Read More

PyTorch AOTInductor Hybrid Lowering

 05-28-2026 05-28-2026 blog 8 minutes read (About 1224 words)
A Hybrid DeviceExecution Inference Engine from PyTorch

 
Deep Learning Inference, 
PyTorch  
  Read More

PyTorch Triton Kernel Transparent Tracing and Compilation

 05-22-2026 05-22-2026 blog 27 minutes read (About 4044 words)
Exporting and Compiling Triton Kernels for AOTInductor

 
Deep Learning Inference, 
PyTorch, 
AOTInductor, 
Triton  
  Read More

PyTorch Fake Export

 05-17-2026 05-17-2026 blog 11 minutes read (About 1634 words)
Eliminating PyTorch Model Data Memory Allocation for PyTorch Export Verification

 
Deep Learning Inference, 
PyTorch  
  Read More

PyTorch Custom Operation

 05-10-2026 05-10-2026 blog 23 minutes read (About 3501 words)
Implementing PyTorch Custom Operations In C++ and CUDA Using torch.library

 
CPP, 
Python, 
CUDA, 
PyTorch, 
AOTInductor  
  Read More

PyTorch Graph Symbolic Integer

 04-05-2026 06-09-2026 blog 11 minutes read (About 1602 words)
Graph Shape Inference with Symbolic Integers for Dynamic Shapes

 
Deep Learning, 
Inference, 
PyTorch, 
Neural Network Compiler  
  Read More

PyTorch Export

 03-31-2026 04-01-2026 blog 6 minutes read (About 857 words)
Exporting Graph-Representable PyTorch Models for Inference

 
CPP, 
Inference, 
PyTorch  
  Read More

PyTorch CUDA Graph Capture

 01-12-2026 08-07-2026 blog 23 minutes read (About 3479 words)
Using PyTorch CUDA Graph APIs

 
CUDA, 
PyTorch, 
CUDA Graph, 
Perfetto  
  Read More
Previous
Next
  • 1
  • 2
  • 3
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1436

Categories

8

Tags

835

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog585
  • essay363
  • life343
  • miscellaneous2
  • photography94
  • project20
  • reading8

follow.it

Recents

08-29-2026

一次极度垃圾的 KFC 经历

essay

08-29-2026

Devil's Slide Trail 徒步

life

08-29-2026

Devil's Slide Trail

photography

08-27-2026

AOTInductor External Weight Storage and Weight Streaming Update

blog

08-26-2026

宁波特产伴手礼

essay

Archives

  • August 202623
  • July 202623
  • June 202621
  • May 202624
  • April 202618
  • See All >>

Tags

Outdoors348
California280
Hiking260
CPP122
Photography110
Mathematics103
Deep Learning87
Wildlife84
Running80
Bird78
CUDA78
Racing56
Movie45
Python38
Software Engineering36
Machine Learning35
China34
Linux33
NVIDIA32
Statistics32
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×