Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayArchivesCategoriesTagsFAQs

CuTe Matrix Transpose

 11-20-2024 12-26-2024 article an hour read (About 10825 words)
Matrix Transpose CUDA Kernel Implementation Using CuTe

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe  
  Read More

CuTe Layout Algebra

 10-20-2024 10-20-2024 article 2 hours read (About 16932 words)
Mathematical Fundamentals to CUTLASS Computing

 
Mathematics, 
Accelerated Computing, 
CUDA, 
CUTLASS, 
CuTe, 
Category Theory  
  Read More

CUDA Matrix Multiplication Optimization

 01-20-2024 01-20-2024 article 2 hours read (About 19282 words)
General Matrix Multiplication CUDA Performance Optimization

 
CPP, 
Accelerated Computing, 
CUDA, 
NVIDIA  
  Read More

How To Debug Deep Learning Inference Applications

 01-01-2024 01-01-2024 article 23 minutes read (About 3511 words)
First Principles of Evaluating Deep Learning Inference

 
Deep Learning, 
Software Engineering, 
Deep Learning Inference, 
Numerical Errors  
  Read More

Interpolation

 06-07-2023 06-07-2023 article 27 minutes read (About 4123 words)
One of the Most Widely Used Estimation Methods

 
Computer Vision, 
Mathematics, 
Signal Processing  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Hamming Code

 06-01-2022 06-01-2022 article 29 minutes read (About 4424 words)
Create Perfect Error-Correction Hamming Code From Scratch

 
Telecommunication, 
Computer Science  
  Read More

Automatic Differentiation

 02-21-2022 06-28-2023 article 34 minutes read (About 5117 words)
Mathematical Foundations to Neural Network Optimization

 
Machine Learning, 
Deep Learning, 
Mathematics, 
Mathematical Optimization  
  Read More

Pruning for Neural Networks

 03-01-2021 03-01-2021 article 14 minutes read (About 2172 words)
Mathematical Foundations to Neural Network Pruning

 
Machine Learning, 
Deep Learning, 
Mathematics  
  Read More

Principal Component Analysis

 05-17-2020 05-17-2020 article 25 minutes read (About 3737 words)
Fundamentals to Principal Component Analysis

 
Mathematics, 
Principal Component Analysis  
  Read More

Quantization for Neural Networks

 05-17-2020 02-09-2023 article an hour read (About 6957 words)
Mathematical Foundations to Neural Network Quantization

 
Machine Learning, 
Deep Learning, 
Mathematics, 
Neural Network, 
Quantization, 
Matrix Multiplication  
  Read More
Previous
Next
  • 1
  • 2
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1056

Categories

7

Tags

687

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog508
  • essay269
  • life229
  • miscellaneous2
  • project20
  • reading8

follow.it

Recents

05-08-2025

Tensor Calculus Layout Conventions

blog

05-07-2025

幸运钥匙

essay

05-04-2025

人在湾区五月份长冻疮

essay

05-03-2025

ICML 2025 Area Chair Experience

blog

05-03-2025

Sunol Wilderness Regional Preserve 徒步

life

Archives

  • May 20255
  • April 202521
  • March 202525
  • February 202521
  • January 202523
  • See All >>

Tags

Outdoors232
Hiking177
California164
CPP108
Mathematics89
Deep Learning78
CUDA50
Running46
Software Engineering35
Machine Learning34
Python32
Statistics31
Park30
Linux29
Racing29
Docker26
Movie25
China23
Physics23
Museum22
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×