CuTe Tilers

CuTe Inverse Layout

08-13-202508-13-2025 blog 9 minutes read (About 1390 words)

Deriving Inverse Layout Mathematically

CuTe Blocked and Raked Products

08-07-202508-07-2025 blog 9 minutes read (About 1283 words)

Creating Tiled Layouts Using Blocked Product and Raked Product

CuTe Local Tile

08-01-202508-01-2025 blog 6 minutes read (About 865 words)

Elucidating CuTe Inner Partition and Local Tile

CuTe Local Partition

07-25-202508-01-2025 blog 15 minutes read (About 2291 words)

Elucidating CuTe Outer Partition and Local Partition

CuTe Index To Coordinate

07-19-202507-19-2025 blog 14 minutes read (About 2040 words)

Inverse Layout Function

Online Safe Softmax

06-23-202506-23-2025 blog 5 minutes read (About 741 words)

Safe and Efficient Online Softmax Calculation

Deep Learning,

Accelerated Computing

Roofline Performance Model

03-26-202503-26-2025 blog 7 minutes read (About 1078 words)

Understand the Performance Limitations and Gaps

High Performance Computing,

Computer Architecture,

Performance

CuTe Tiled MMA

01-09-202501-09-2025 blog 30 minutes read (About 4456 words)

Understanding CuTe Tiled MMA Using an Example

AWQ: Activation-Aware Weight Quantization

01-01-202501-01-2025 blog 18 minutes read (About 2738 words)

Same Performance as Group-Wise Weight-Only Quantization But with Better Accuracy

Deep Learning,

Quantization,

CUDA

cuBLAS GEMM API Usages for Column-Major and Row-Major Matrices

12-12-202412-12-2024 blog 7 minutes read (About 1012 words)

Calling cuBLAS GEMM API Correctly

cuBLAS

CuTe Swizzle

12-01-202403-04-2025 blog 19 minutes read (About 2808 words)

CuTe Shared Memory Swizzling Abstractions