Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs

Performance Bottleneck from Hidden Atomic Operations

 11-05-2026 11-05-2026 blog 11 minutes read (About 1592 words)
Watch Out For Hidden Atomic Operations In Constructs Used In Concurrent Programs

 
CPP, 
Performance Optimization, 
C, 
Atomics  
  Read More

Triton Tensor Descriptor

 10-27-2026 10-27-2026 blog 12 minutes read (About 1743 words)
Simplifying Memory Access Arithmetic with Triton Tensor Descriptors

 
Accelerated Computing, 
CUDA, 
Triton  
  Read More

CUDA Memory Fence

 10-20-2026 10-20-2026 blog 10 minutes read (About 1536 words)
Enforcing a Sequentially-Consistent Ordering on Memory Accesses

 
CPP, 
CUDA, 
NVIDIA, 
Computer Architecture, 
Memory  
  Read More

CUDA Approximate Sigmoid

 10-13-2026 10-13-2026 blog 17 minutes read (About 2541 words)
Architecture-Dependent Instruction Efficiency for Sigmoid Operations

 
CUDA, 
NVIDIA, 
Computer Architecture, 
GPU, 
Triton  
  Read More

The Mathematics of Software Development Efficiency

 10-06-2026 10-06-2026 blog 12 minutes read (About 1817 words)
Trunk-Based Development VS Feature-Based Development

 
Git, 
Mathematics, 
Software Engineering, 
Operation Research  
  Read More

AOTInductor Triton SASS Inspection

 10-02-2026 10-02-2026 blog 9 minutes read (About 1352 words)
Triton Kernel Behavior Verification In AOTInductor

 
Accelerated Computing, 
CUDA, 
PyTorch, 
AOTInductor, 
Triton, 
JIT  
  Read More

CUDA Device Max Connections

 09-26-2026 09-26-2026 blog 10 minutes read (About 1514 words)
Unlocking GPU Concurrency

 
CPP, 
Accelerated Computing, 
CUDA, 
NVIDIA, 
AMD  
  Read More

CUDA Thread Block Swizzle

 09-20-2026 09-20-2026 blog 36 minutes read (About 5405 words)
Influencing L2 Cache Efficiency Using CUDA Thread Block Swizzle

 
Accelerated Computing, 
CUDA, 
Triton  
  Read More

Residual-Quantized Variational Autoencoder

 09-14-2026 09-14-2026 blog 9 minutes read (About 1396 words)
Hierarchical Semantic Encodings

 
Quantization, 
Variational Autoencoder, 
VAE, 
RQ-VAE, 
VQ-VAE, 
Recommender System, 
Semantic Indexing  
  Read More

CUDA Multi-Process Service

 09-08-2026 09-08-2026 blog 8 minutes read (About 1199 words)
Executing CUDA Kernels Concurrently From Multiple Processes

 
Accelerated Computing, 
CUDA, 
PyTorch, 
MPS  
  Read More

AOTInductor Input Mutation

 09-01-2026 09-01-2026 blog 26 minutes read (About 3970 words)
Enabling Inplace Input Mutation Optimizations In AOTInductor

 
PyTorch, 
AOTInductor, 
Triton, 
TorchInductor  
  Read More

AOTInductor External Weight Storage and Weight Streaming Update

 08-27-2026 08-27-2026 blog 14 minutes read (About 2110 words)
AOTInductor Weight Streaming from PyTorch Models

 
PyTorch, 
AOTInductor, 
TorchInductor  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 50
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1497

Categories

8

Tags

852

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog596
  • essay378
  • life363
  • miscellaneous2
  • photography109
  • project20
  • reading8

follow.it

Recents

11-05-2026

Performance Bottleneck from Hidden Atomic Operations

blog

11-05-2026

PokéBonk

essay

11-01-2026

老江湖

essay

10-31-2026

Alum Rock Park and Sierra Vista Open Space 徒步

life

10-31-2026

Alum Rock Park and Sierra Vista Open Space

photography

Archives

  • November 20263
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors369
California303
Hiking275
Photography128
CPP125
Mathematics104
Wildlife96
Bird89
Deep Learning87
CUDA86
Running86
Racing61
Movie51
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×