Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • CUDA

How Is FARS, The Fully Automated Research System?

 04-22-2026 04-22-2026 blog 5 minutes read (About 740 words)
The AI Just Tried To Fool People

 
Artificial Intelligence, 
CUDA, 
Research, 
CUDA Graphs, 
Mixture-of-Experts  
  Read More

Page Table for Page-Locked Host Memory

 04-12-2026 04-12-2026 blog 17 minutes read (About 2541 words)
Page Table GPU Memory Overhead and Sharing Page-Locked Host Memory Across Processes

 
CUDA, 
NVIDIA, 
Computer Architecture, 
GPU, 
Memory Management  
  Read More

CUDA_LAUNCH_BLOCKING=1

 03-20-2026 03-20-2026 blog 4 minutes read (About 599 words)
Debugging CUDA Applications

 
CUDA, 
Debug  
  Read More

CUDA Shared Memory Bank Conflict-Free Vectorized Access

 02-13-2026 02-13-2026 blog 14 minutes read (About 2060 words)
Instruction-Level Phase Based Bank Conflict-Free Execution

 
CUDA, 
NVIDIA, 
Parallel Computing, 
GPU  
  Read More

CUDA Rendezvous Stream

 01-26-2026 01-26-2026 blog 11 minutes read (About 1690 words)
Simplifying Synchronization Complexities Using CUDA Rendezvous Streams

 
CUDA, 
NVIDIA, 
Parallel Computing, 
GPU  
  Read More

PyTorch CUDA Graph Capture

 01-12-2026 08-07-2026 blog 23 minutes read (About 3479 words)
Using PyTorch CUDA Graph APIs

 
CUDA, 
PyTorch, 
CUDA Graph, 
Perfetto  
  Read More

NVIDIA NVML GPU Statistics

 12-25-2025 12-25-2025 blog 15 minutes read (About 2214 words)
Mimicking nvidia-smi dmon Using NVIDIA NVML

 
CPP, 
CUDA, 
NVIDIA, 
GPU, 
NVML  
  Read More

NVIDIA Tensor Core TN Layout MMA Instruction

 12-06-2025 12-06-2025 blog 16 minutes read (About 2389 words)
GEMM Layout, History, Performance, and Implementation

 
CPP, 
CUTLASS, 
CUDA, 
CuTe, 
NVIDIA, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Benchmarking NVIDIA Tensor Core MMA Instruction Peak Performances

 11-26-2025 11-26-2025 blog 11 minutes read (About 1646 words)
Reproducing NVIDIA Advertised GPU AI Peak Performances Using CUTLASS and CuTe

 
CPP, 
CUTLASS, 
CUDA, 
CuTe, 
NVIDIA, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Nsight Streamer

 11-04-2025 11-04-2025 blog 3 minutes read (About 515 words)
Nsight Systems and Nsight Compute GUIs In a Web Browser

 
CUDA, 
NVIDIA, 
Nsight Compute, 
Nsight Systems, 
Nsight Streamer  
  Read More

CuTe Arithmetic Tuple Tensor

 10-20-2025 10-20-2025 blog 16 minutes read (About 2388 words)
The Tensor Coordinate Generator In CuTe

 
Mathematics, 
Accelerated Computing, 
CUTLASS, 
CUDA, 
CuTe  
  Read More

CuTe Tiled Copy

 10-16-2025 10-16-2025 blog 28 minutes read (About 4216 words)
Understanding CuTe Tiled Copy

 
Mathematics, 
Accelerated Computing, 
CUTLASS, 
CUDA, 
CuTe  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • …
  • 8
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1495

Categories

8

Tags

850

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog595
  • essay377
  • life363
  • miscellaneous2
  • photography109
  • project20
  • reading8

follow.it

Recents

11-01-2026

老江湖

essay

10-31-2026

Alum Rock Park and Sierra Vista Open Space 徒步

life

10-31-2026

Alum Rock Park and Sierra Vista Open Space

photography

10-29-2026

艾泽拉斯幸存者

essay

10-27-2026

Triton Tensor Descriptor

blog

Archives

  • November 20261
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors369
California303
Hiking275
Photography128
CPP124
Mathematics104
Wildlife96
Bird89
Deep Learning87
CUDA86
Running86
Racing61
Movie51
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×