Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • CUDA

How Is FARS, The Fully Automated Research System?

 04-22-2026 04-22-2026 blog 5 minutes read (About 740 words)
The AI Just Tried To Fool People

 
Artificial Intelligence, 
CUDA, 
Research, 
CUDA Graphs, 
Mixture-of-Experts  
  Read More

Page Table for Page-Locked Host Memory

 04-12-2026 04-12-2026 blog 17 minutes read (About 2541 words)
Page Table GPU Memory Overhead and Sharing Page-Locked Host Memory Across Processes

 
CUDA, 
NVIDIA, 
Computer Architecture, 
GPU, 
Memory Management  
  Read More

CUDA_LAUNCH_BLOCKING=1

 03-20-2026 03-20-2026 blog 4 minutes read (About 599 words)
Debugging CUDA Applications

 
CUDA, 
Debug  
  Read More

CUDA Shared Memory Bank Conflict-Free Vectorized Access

 02-13-2026 02-13-2026 blog 14 minutes read (About 2060 words)
Instruction-Level Phase Based Bank Conflict-Free Execution

 
CUDA, 
NVIDIA, 
Parallel Computing, 
GPU  
  Read More

CUDA Rendezvous Stream

 01-26-2026 01-26-2026 blog 11 minutes read (About 1690 words)
Simplifying Synchronization Complexities Using CUDA Rendezvous Streams

 
CUDA, 
NVIDIA, 
Parallel Computing, 
GPU  
  Read More

PyTorch CUDA Graph Capture

 01-12-2026 01-12-2026 blog 23 minutes read (About 3454 words)
Using PyTorch CUDA Graph APIs

 
CUDA, 
PyTorch, 
CUDA Graph, 
Perfetto  
  Read More

NVIDIA NVML GPU Statistics

 12-25-2025 12-25-2025 blog 15 minutes read (About 2214 words)
Mimicking nvidia-smi dmon Using NVIDIA NVML

 
CPP, 
CUDA, 
NVIDIA, 
GPU, 
NVML  
  Read More

NVIDIA Tensor Core TN Layout MMA Instruction

 12-06-2025 12-06-2025 blog 16 minutes read (About 2389 words)
GEMM Layout, History, Performance, and Implementation

 
CPP, 
CUDA, 
NVIDIA, 
CUTLASS, 
CuTe, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Benchmarking NVIDIA Tensor Core MMA Instruction Peak Performances

 11-26-2025 11-26-2025 blog 11 minutes read (About 1646 words)
Reproducing NVIDIA Advertised GPU AI Peak Performances Using CUTLASS and CuTe

 
CPP, 
CUDA, 
NVIDIA, 
CUTLASS, 
CuTe, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Nsight Streamer

 11-04-2025 11-04-2025 blog 3 minutes read (About 515 words)
Nsight Systems and Nsight Compute GUIs In a Web Browser

 
CUDA, 
NVIDIA, 
Nsight Compute, 
Nsight Systems, 
Nsight Streamer  
  Read More

CuTe Arithmetic Tuple Tensor

 10-20-2025 10-20-2025 blog 16 minutes read (About 2388 words)
The Tensor Coordinate Generator In CuTe

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More

CuTe Tiled Copy

 10-16-2025 10-16-2025 blog 28 minutes read (About 4216 words)
Understanding CuTe Tiled Copy

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1348

Categories

8

Tags

810

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog571
  • essay343
  • life312
  • miscellaneous2
  • photography71
  • project20
  • reading8

follow.it

Recents

05-04-2026

《寻秦记》电影版

essay

05-03-2026

ICML 2026 Area Chair Experience

blog

05-02-2026

2026 Foster City 5K Fun Run 竞赛

life

04-30-2026

2026 年 3 月和 4 月该入手的模型手办

essay

04-29-2026

Docker Container GUI Display Using Wayland

blog

Archives

  • May 20263
  • April 202618
  • March 202618
  • February 202617
  • January 202616
  • See All >>

Tags

Outdoors317
California248
Hiking239
CPP121
Mathematics102
Deep Learning87
Photography85
CUDA74
Running71
Wildlife62
Bird56
Racing47
Movie38
Python36
Software Engineering36
Machine Learning35
China32
Linux32
NVIDIA32
Statistics32
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×