Performance Bottleneck from Hidden Atomic Operations 11-05-2026 11-05-2026 blog 11 minutes read (About 1592 words)Watch Out For Hidden Atomic Operations In Constructs Used In Concurrent Programs CPP, Performance Optimization, C, Atomics Read More
Triton Tensor Descriptor 10-27-2026 10-27-2026 blog 12 minutes read (About 1743 words)Simplifying Memory Access Arithmetic with Triton Tensor Descriptors Accelerated Computing, CUDA, Triton Read More
CUDA Memory Fence 10-20-2026 10-20-2026 blog 10 minutes read (About 1536 words)Enforcing a Sequentially-Consistent Ordering on Memory Accesses CPP, CUDA, NVIDIA, Computer Architecture, Memory Read More
CUDA Approximate Sigmoid 10-13-2026 10-13-2026 blog 17 minutes read (About 2541 words)Architecture-Dependent Instruction Efficiency for Sigmoid Operations CUDA, NVIDIA, Computer Architecture, GPU, Triton Read More
The Mathematics of Software Development Efficiency 10-06-2026 10-06-2026 blog 12 minutes read (About 1817 words)Trunk-Based Development VS Feature-Based Development Git, Mathematics, Software Engineering, Operation Research Read More
AOTInductor Triton SASS Inspection 10-02-2026 10-02-2026 blog 9 minutes read (About 1352 words)Triton Kernel Behavior Verification In AOTInductor Accelerated Computing, CUDA, PyTorch, AOTInductor, Triton, JIT Read More
CUDA Device Max Connections 09-26-2026 09-26-2026 blog 10 minutes read (About 1514 words)Unlocking GPU Concurrency CPP, Accelerated Computing, CUDA, NVIDIA, AMD Read More
CUDA Thread Block Swizzle 09-20-2026 09-20-2026 blog 36 minutes read (About 5405 words)Influencing L2 Cache Efficiency Using CUDA Thread Block Swizzle Accelerated Computing, CUDA, Triton Read More
Residual-Quantized Variational Autoencoder 09-14-2026 09-14-2026 blog 9 minutes read (About 1396 words)Hierarchical Semantic Encodings Quantization, Variational Autoencoder, VAE, RQ-VAE, VQ-VAE, Recommender System, Semantic Indexing Read More
CUDA Multi-Process Service 09-08-2026 09-08-2026 blog 8 minutes read (About 1199 words)Executing CUDA Kernels Concurrently From Multiple Processes Accelerated Computing, CUDA, PyTorch, MPS Read More
AOTInductor Input Mutation 09-01-2026 09-01-2026 blog 26 minutes read (About 3970 words)Enabling Inplace Input Mutation Optimizations In AOTInductor PyTorch, AOTInductor, Triton, TorchInductor Read More
AOTInductor External Weight Storage and Weight Streaming Update 08-27-2026 08-27-2026 blog 14 minutes read (About 2110 words)AOTInductor Weight Streaming from PyTorch Models PyTorch, AOTInductor, TorchInductor Read More