Roofline Performance Model 03-26-2025 03-26-2025 blog 7 minutes read (About 1078 words)Understand the Performance Limitations and Gaps Accelerated Computing, High Performance Computing, Computer Architecture, Performance Read More
Numerical Errors In HPC and Deep Learning 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)Numerical Errors are Evil Deep Learning, Numerical Errors, High Performance Computing Read More
Amdahl's Law VS Gustafson's Law 03-23-2022 03-23-2022 blog 3 minutes read (About 507 words)Strong Scaling VS Weak Scaling High Performance Computing, Parallel Computing Read More
Multi-Thread Single-Stream VS Single-Thread Multi-Stream CUDA 10-18-2021 05-12-2022 blog 13 minutes read (About 1946 words)CUDA Programming Choices for CUDA Stream Deep Learning, Mathematics, CUDA, High Performance Computing, Computer Architecture, Parallel Computing Read More
Tensor Physical Layouts on Memory 04-17-2019 08-23-2021 blog 3 minutes read (About 402 words)Know Your Tensor! Deep Learning, High Performance Computing Read More