Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs

Performance Bottleneck from Hidden Atomic Operations

 11-05-2026 11-05-2026 blog 11 minutes read (About 1592 words)
Watch Out For Hidden Atomic Operations In Constructs Used In Concurrent Programs

 
CPP, 
Performance Optimization, 
C, 
Atomics  
  Read More

Triton Tensor Descriptor

 10-27-2026 10-27-2026 blog 12 minutes read (About 1743 words)
Simplifying Memory Access Arithmetic with Triton Tensor Descriptors

 
Accelerated Computing, 
CUDA, 
Triton  
  Read More

CUDA Memory Fence

 10-20-2026 10-20-2026 blog 10 minutes read (About 1536 words)
Enforcing a Sequentially-Consistent Ordering on Memory Accesses

 
CPP, 
CUDA, 
NVIDIA, 
Computer Architecture, 
Memory  
  Read More

CUDA Approximate Sigmoid

 10-13-2026 10-13-2026 blog 17 minutes read (About 2541 words)
Architecture-Dependent Instruction Efficiency for Sigmoid Operations

 
CUDA, 
NVIDIA, 
Computer Architecture, 
GPU, 
Triton  
  Read More

The Mathematics of Software Development Efficiency

 10-06-2026 10-06-2026 blog 12 minutes read (About 1817 words)
Trunk-Based Development VS Feature-Based Development

 
Git, 
Mathematics, 
Software Engineering, 
Operation Research  
  Read More

AOTInductor Triton SASS Inspection

 10-02-2026 10-02-2026 blog 9 minutes read (About 1352 words)
Triton Kernel Behavior Verification In AOTInductor

 
Accelerated Computing, 
CUDA, 
PyTorch, 
AOTInductor, 
Triton, 
JIT  
  Read More

CUDA Device Max Connections

 09-26-2026 09-26-2026 blog 10 minutes read (About 1514 words)
Unlocking GPU Concurrency

 
CPP, 
Accelerated Computing, 
CUDA, 
NVIDIA, 
AMD  
  Read More

CUDA Thread Block Swizzle

 09-20-2026 09-20-2026 blog 36 minutes read (About 5405 words)
Influencing L2 Cache Efficiency Using CUDA Thread Block Swizzle

 
Accelerated Computing, 
CUDA, 
Triton  
  Read More

Residual-Quantized Variational Autoencoder

 09-14-2026 09-14-2026 blog 9 minutes read (About 1396 words)
Hierarchical Semantic Encodings

 
Quantization, 
Variational Autoencoder, 
VAE, 
RQ-VAE, 
VQ-VAE, 
Recommender System, 
Semantic Indexing  
  Read More

CUDA Multi-Process Service

 09-08-2026 09-08-2026 blog 8 minutes read (About 1199 words)
Executing CUDA Kernels Concurrently From Multiple Processes

 
Accelerated Computing, 
CUDA, 
PyTorch, 
MPS  
  Read More

AOTInductor Input Mutation

 09-01-2026 09-01-2026 blog 26 minutes read (About 3970 words)
Enabling Inplace Input Mutation Optimizations In AOTInductor

 
PyTorch, 
AOTInductor, 
Triton, 
TorchInductor  
  Read More

AOTInductor External Weight Storage and Weight Streaming Update

 08-27-2026 08-27-2026 blog 14 minutes read (About 2110 words)
AOTInductor Weight Streaming from PyTorch Models

 
PyTorch, 
AOTInductor, 
TorchInductor  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 50
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1501

Categories

8

Tags

852

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog596
  • essay379
  • life365
  • miscellaneous2
  • photography110
  • project20
  • reading8

follow.it

Recents

11-10-2026

群体

essay

11-07-2026

Coyote Creek Trail

photography

11-07-2026

2026 Annual Celebration Of Life 5K 竞赛

life

11-07-2026

Coyote Creek Trail 徒步

life

11-05-2026

Performance Bottleneck from Hidden Atomic Operations

blog

Archives

  • November 20267
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors371
California305
Hiking276
Photography129
CPP125
Mathematics104
Wildlife97
Bird90
Deep Learning87
Running87
CUDA86
Racing62
Movie52
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×