Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • High Performance Computing

System Performance Optimizations

 02-16-2026 02-22-2026 article 16 minutes read (About 2338 words)
Principles and Techniques of System Performance Optimizations at Different Levels

 
Performance Optimization, 
High Performance Computing, 
Systems Engineering  
  Read More

Roofline Performance Model

 03-26-2025 03-26-2025 blog 7 minutes read (About 1078 words)
Understand the Performance Limitations and Gaps

 
Accelerated Computing, 
High Performance Computing, 
Computer Architecture, 
Performance  
  Read More

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Amdahl's Law VS Gustafson's Law

 03-23-2022 03-23-2022 blog 3 minutes read (About 507 words)
Strong Scaling VS Weak Scaling

 
High Performance Computing, 
Parallel Computing  
  Read More

Multi-Thread Single-Stream VS Single-Thread Multi-Stream CUDA

 10-18-2021 05-12-2022 blog 13 minutes read (About 1946 words)
CUDA Programming Choices for CUDA Stream

 
Deep Learning, 
Mathematics, 
CUDA, 
High Performance Computing, 
Computer Architecture, 
Parallel Computing  
  Read More

Tensor Physical Layouts on Memory

 04-17-2019 08-23-2021 blog 3 minutes read (About 402 words)
Know Your Tensor!

 
Deep Learning, 
High Performance Computing  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1507

Categories

8

Tags

852

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog597
  • essay380
  • life368
  • miscellaneous2
  • photography111
  • project20
  • reading8

follow.it

Recents

11-21-2026

2026 Santa Cruz Turkey Trot 10K 竞赛

life

11-16-2026

AOTInductor Compile Cache

blog

11-16-2026

San Mateo County Parks Take A Hike Challenge 2026

essay

11-15-2026

2026 Morgan Hill Veterans Day Run 5K 竞赛

life

11-14-2026

Raptor Fest at Rancho San Vicente 参观

life

Archives

  • November 202613
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors375
California309
Hiking278
Photography130
CPP125
Mathematics104
Wildlife98
Bird91
Running89
CUDA87
Deep Learning87
Racing64
Movie52
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
PyTorch35
Accelerated Computing34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×