Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • CPP

CUDA Memory Fence

 10-20-2026 10-20-2026 blog 10 minutes read (About 1536 words)
Enforcing a Sequentially-Consistent Ordering on Memory Accesses

 
CPP, 
CUDA, 
NVIDIA, 
Computer Architecture, 
Memory  
  Read More

CUDA Device Max Connections

 09-26-2026 09-26-2026 blog 10 minutes read (About 1514 words)
Unlocking GPU Concurrency

 
CPP, 
Accelerated Computing, 
CUDA, 
NVIDIA, 
AMD  
  Read More

PyTorch Custom Operation

 05-10-2026 05-10-2026 blog 23 minutes read (About 3501 words)
Implementing PyTorch Custom Operations In C++ and CUDA Using torch.library

 
CPP, 
Python, 
CUDA, 
PyTorch, 
AOTInductor  
  Read More

PyTorch Export

 03-31-2026 04-01-2026 blog 6 minutes read (About 857 words)
Exporting Graph-Representable PyTorch Models for Inference

 
CPP, 
Inference, 
PyTorch  
  Read More

C++ Latch and Barrier

 02-06-2026 02-06-2026 blog 8 minutes read (About 1154 words)
Scheduling and Synchronizing Threads Using std::latch and std::barrier

 
CPP, 
Multithreading, 
Parallel Programming  
  Read More

NVIDIA NVML GPU Statistics

 12-25-2025 12-25-2025 blog 15 minutes read (About 2214 words)
Mimicking nvidia-smi dmon Using NVIDIA NVML

 
CPP, 
CUDA, 
NVIDIA, 
GPU, 
NVML  
  Read More

Radix Sort

 12-18-2025 12-18-2025 blog 19 minutes read (About 2808 words)
A Non-Comparative Sorting Algorithm

 
CPP, 
Python, 
Algorithm  
  Read More

NVIDIA Tensor Core TN Layout MMA Instruction

 12-06-2025 12-06-2025 blog 16 minutes read (About 2389 words)
GEMM Layout, History, Performance, and Implementation

 
CPP, 
CUTLASS, 
CUDA, 
CuTe, 
NVIDIA, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Benchmarking NVIDIA Tensor Core MMA Instruction Peak Performances

 11-26-2025 11-26-2025 blog 11 minutes read (About 1646 words)
Reproducing NVIDIA Advertised GPU AI Peak Performances Using CUTLASS and CuTe

 
CPP, 
CUTLASS, 
CUDA, 
CuTe, 
NVIDIA, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Core Dump and GDB

 11-15-2025 11-15-2025 blog 7 minutes read (About 1029 words)
Analyzing Core Dump Files Using GDB

 
CPP, 
GDB, 
Core Dump  
  Read More

AddressSanitizer

 09-27-2025 09-27-2025 blog 21 minutes read (About 3161 words)
Compile-Time Instrumentation for Detecting Memory Errors

 
CPP, 
CMake, 
GCC, 
Memory Error  
  Read More

Illegal Memory Access and Segmentation Fault

 08-27-2025 08-27-2025 blog 9 minutes read (About 1381 words)
Memory Access Boundary Checking

 
CPP, 
Operating System, 
Memory Management, 
Memory Safety  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 11
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1495

Categories

8

Tags

850

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog595
  • essay377
  • life363
  • miscellaneous2
  • photography109
  • project20
  • reading8

follow.it

Recents

11-01-2026

老江湖

essay

10-31-2026

Alum Rock Park and Sierra Vista Open Space 徒步

life

10-31-2026

Alum Rock Park and Sierra Vista Open Space

photography

10-29-2026

艾泽拉斯幸存者

essay

10-27-2026

Triton Tensor Descriptor

blog

Archives

  • November 20261
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors369
California303
Hiking275
Photography128
CPP124
Mathematics104
Wildlife96
Bird89
Deep Learning87
CUDA86
Running86
Racing61
Movie51
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×