Predicated Execution VS Conditional Execution

PyTorch,

TensorRT,

GPU,

AOTInductor,

TorchInductor,

JAX,

XLA,

TPU

CuTe Arithmetic Tuple Tensor

10-20-202510-20-2025 blog 16 minutes read (About 2388 words)

The Tensor Coordinate Generator In CuTe

CuTe Tiled Copy

10-16-202510-16-2025 blog 28 minutes read (About 4216 words)

Understanding CuTe Tiled Copy

CuTe Thread-Value Layout

10-13-202510-13-2025 blog 6 minutes read (About 955 words)

CuTe TV Layout, Inverse TV Layout, and TV Partition

CuTe ldmatrix

10-03-202510-03-2025 blog 22 minutes read (About 3357 words)

CUDA PTX ldmatrix Instruction and Its CuTe Wrapper

CuTe Tilers

09-15-202509-15-2025 blog 10 minutes read (About 1524 words)

Designing Tilers for Data Access

CuTe Inverse Layout

08-13-202508-13-2025 blog 9 minutes read (About 1390 words)

Deriving Inverse Layout Mathematically

CuTe Blocked and Raked Products

08-07-202508-07-2025 blog 9 minutes read (About 1283 words)

Creating Tiled Layouts Using Blocked Product and Raked Product

CuTe Local Tile

08-01-202508-01-2025 blog 6 minutes read (About 865 words)

Elucidating CuTe Inner Partition and Local Tile

CuTe Local Partition

07-25-202508-01-2025 blog 15 minutes read (About 2291 words)

Elucidating CuTe Outer Partition and Local Partition

CuTe Index To Coordinate

07-19-202507-19-2025 blog 14 minutes read (About 2040 words)

Inverse Layout Function

Online Safe Softmax

06-23-202506-23-2025 blog 5 minutes read (About 741 words)

Safe and Efficient Online Softmax Calculation

Deep Learning,