Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs

System Performance Optimizations

 02-16-2026 02-22-2026 article 16 minutes read (About 2338 words)
Principles and Techniques of System Performance Optimizations at Different Levels

 
Performance Optimization, 
High Performance Computing, 
Systems Engineering  
  Read More

CuTe Matrix Transpose

 11-20-2024 09-30-2025 article an hour read (About 10892 words)
Matrix Transpose CUDA Kernel Implementation Using CuTe

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More

CuTe Layout Algebra

 10-20-2024 07-14-2025 article 2 hours read (About 19874 words)
Mathematical Fundamentals to CUTLASS Computing

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe, 
Category Theory  
  Read More

CUDA Matrix Multiplication Optimization

 01-20-2024 01-20-2024 article 2 hours read (About 19282 words)
General Matrix Multiplication CUDA Performance Optimization

 
CPP, 
Accelerated Computing, 
CUDA, 
NVIDIA  
  Read More

How To Debug Deep Learning Inference Applications

 01-01-2024 01-01-2024 article 23 minutes read (About 3511 words)
First Principles of Evaluating Deep Learning Inference

 
Deep Learning, 
Software Engineering, 
Deep Learning Inference, 
Numerical Errors  
  Read More

Interpolation

 06-07-2023 06-07-2023 article 27 minutes read (About 4123 words)
One of the Most Widely Used Estimation Methods

 
Computer Vision, 
Mathematics, 
Signal Processing  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Hamming Code

 06-01-2022 06-01-2022 article 29 minutes read (About 4424 words)
Create Perfect Error-Correction Hamming Code From Scratch

 
Telecommunication, 
Computer Science  
  Read More

Automatic Differentiation

 02-21-2022 06-28-2023 article 34 minutes read (About 5117 words)
Mathematical Foundations to Neural Network Optimization

 
Machine Learning, 
Deep Learning, 
Mathematics, 
Mathematical Optimization  
  Read More

Pruning for Neural Networks

 03-01-2021 03-01-2021 article 14 minutes read (About 2172 words)
Mathematical Foundations to Neural Network Pruning

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Principal Component Analysis

 05-17-2020 05-17-2020 article 25 minutes read (About 3737 words)
Fundamentals to Principal Component Analysis

 
Mathematics, 
Principal Component Analysis  
  Read More
Previous
Next
  • 1
  • 2
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1365

Categories

8

Tags

818

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog575
  • essay347
  • life317
  • miscellaneous2
  • photography75
  • project20
  • reading8

follow.it

Recents

05-28-2026

PyTorch AOTInductor Hybrid Lowering

blog

05-23-2026

Carquinez Strait Regional Shoreline 徒步

life

05-23-2026

Carquinez Strait Regional Shoreline

photography

05-22-2026

PyTorch Triton Kernel Transparent Tracing and Compilation

blog

05-22-2026

脸庞

essay

Archives

  • May 202620
  • April 202618
  • March 202618
  • February 202617
  • January 202616
  • See All >>

Tags

Outdoors322
California253
Hiking242
CPP122
Mathematics102
Photography89
Deep Learning87
CUDA75
Running73
Wildlife66
Bird60
Racing49
Movie39
Python37
Software Engineering36
Machine Learning35
China33
Linux32
NVIDIA32
Statistics32
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×