Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • High Performance Computing

System Performance Optimizations

 02-16-2026 02-22-2026 article 16 minutes read (About 2338 words)
Principles and Techniques of System Performance Optimizations at Different Levels

 
Performance Optimization, 
High Performance Computing, 
Systems Engineering  
  Read More

Roofline Performance Model

 03-26-2025 03-26-2025 blog 7 minutes read (About 1078 words)
Understand the Performance Limitations and Gaps

 
Accelerated Computing, 
High Performance Computing, 
Computer Architecture, 
Performance  
  Read More

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Amdahl's Law VS Gustafson's Law

 03-23-2022 03-23-2022 blog 3 minutes read (About 507 words)
Strong Scaling VS Weak Scaling

 
High Performance Computing, 
Parallel Computing  
  Read More

Multi-Thread Single-Stream VS Single-Thread Multi-Stream CUDA

 10-18-2021 05-12-2022 blog 13 minutes read (About 1946 words)
CUDA Programming Choices for CUDA Stream

 
Deep Learning, 
Mathematics, 
High Performance Computing, 
CUDA, 
Computer Architecture, 
Parallel Computing  
  Read More

Tensor Physical Layouts on Memory

 04-17-2019 08-23-2021 blog 3 minutes read (About 402 words)
Know Your Tensor!

 
Deep Learning, 
High Performance Computing  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1495

Categories

8

Tags

850

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog595
  • essay377
  • life363
  • miscellaneous2
  • photography109
  • project20
  • reading8

follow.it

Recents

11-01-2026

老江湖

essay

10-31-2026

Alum Rock Park and Sierra Vista Open Space 徒步

life

10-31-2026

Alum Rock Park and Sierra Vista Open Space

photography

10-29-2026

艾泽拉斯幸存者

essay

10-27-2026

Triton Tensor Descriptor

blog

Archives

  • November 20261
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors369
California303
Hiking275
Photography128
CPP124
Mathematics104
Wildlife96
Bird89
Deep Learning87
CUDA86
Running86
Racing61
Movie51
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×