Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • CUDA

CUDA Shared Memory Bank Conflict-Free Vectorized Access

 02-13-2026 02-13-2026 blog 14 minutes read (About 2060 words)
Instruction-Level Phase Based Bank Conflict-Free Execution

 
CUDA, 
NVIDIA, 
Parallel Computing, 
GPU  
  Read More

CUDA Rendezvous Stream

 01-26-2026 01-26-2026 blog 11 minutes read (About 1690 words)
Simplifying Synchronization Complexities Using CUDA Rendezvous Streams

 
CUDA, 
NVIDIA, 
Parallel Computing, 
GPU  
  Read More

PyTorch CUDA Graph Capture

 01-12-2026 01-12-2026 blog 23 minutes read (About 3454 words)
Using PyTorch CUDA Graph APIs

 
CUDA, 
PyTorch, 
CUDA Graph, 
Perfetto  
  Read More

NVIDIA NVML GPU Statistics

 12-25-2025 12-25-2025 blog 15 minutes read (About 2214 words)
Mimicking nvidia-smi dmon Using NVIDIA NVML

 
CPP, 
CUDA, 
NVIDIA, 
GPU, 
NVML  
  Read More

NVIDIA Tensor Core TN Layout MMA Instruction

 12-06-2025 12-06-2025 blog 16 minutes read (About 2389 words)
GEMM Layout, History, Performance, and Implementation

 
CPP, 
CUDA, 
NVIDIA, 
CUTLASS, 
CuTe, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Benchmarking NVIDIA Tensor Core MMA Instruction Peak Performances

 11-26-2025 11-26-2025 blog 11 minutes read (About 1646 words)
Reproducing NVIDIA Advertised GPU AI Peak Performances Using CUTLASS and CuTe

 
CPP, 
CUDA, 
NVIDIA, 
CUTLASS, 
CuTe, 
MMA, 
GEMM, 
Tensor Core  
  Read More

Nsight Streamer

 11-04-2025 11-04-2025 blog 3 minutes read (About 515 words)
Nsight Systems and Nsight Compute GUIs In a Web Browser

 
CUDA, 
NVIDIA, 
Nsight Compute, 
Nsight Systems, 
Nsight Streamer  
  Read More

CuTe Arithmetic Tuple Tensor

 10-20-2025 10-20-2025 blog 16 minutes read (About 2388 words)
The Tensor Coordinate Generator In CuTe

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More

CuTe Tiled Copy

 10-16-2025 10-16-2025 blog 28 minutes read (About 4216 words)
Understanding CuTe Tiled Copy

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More

CuTe Thread-Value Layout

 10-13-2025 10-13-2025 blog 6 minutes read (About 955 words)
CuTe TV Layout, Inverse TV Layout, and TV Partition

 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More

Setting Up Environment Variables In SSH Sessions Over TCP On Runpod

 10-10-2025 10-10-2025 blog 12 minutes read (About 1785 words)
Fixing a Environment Variables Issue for Runpod

 
CUDA, 
NVIDIA, 
Docker, 
GPU, 
Cloud Computing, 
Runpod, 
IDE, 
SSH  
  Read More

Setting Up Remote Development Using Custom Template On Runpod

 10-08-2025 10-13-2025 blog 12 minutes read (About 1814 words)
Custom Remote Development Using GPUs on Runpod

 
CUDA, 
NVIDIA, 
Docker, 
GPU, 
Cloud Computing, 
Runpod, 
IDE, 
SSH  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 6
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1305

Categories

8

Tags

793

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog560
  • essay330
  • life299
  • miscellaneous2
  • photography65
  • project20
  • reading8

follow.it

Recents

02-23-2026

儿时的玩伴李峰

essay

02-21-2026

Marsh Creek Regional Trail 徒步

life

02-21-2026

Marsh Creek Regional Trail

photography

02-20-2026

Perfetto GPU Flow Artifacts

blog

02-18-2026

百万人推理

essay

Archives

  • February 202614
  • January 202616
  • December 202535
  • November 202525
  • October 202524
  • See All >>

Tags

Outdoors304
California235
Hiking233
CPP120
Mathematics102
Deep Learning84
Photography79
CUDA71
Running62
Wildlife56
Bird50
Racing40
Python36
Software Engineering36
Machine Learning34
Movie33
Statistics32
China31
NVIDIA31
Park31
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×