Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Mathematics

Optimal Brain Surgeon

 05-14-2025 05-14-2025 blog 40 minutes read (About 6047 words)
Derivation and Extension of The Classical Optimal Brain Surgeon Algorithm

 
Deep Learning, 
Mathematics, 
Neural Networks, 
Calculus, 
Neural Network Pruning  
  Read More

Tensor Calculus Layout Conventions

 05-08-2025 05-08-2025 blog 39 minutes read (About 5799 words)
Numerator Layout VS Denominator Layout

 
Mathematics, 
Calculus  
  Read More

TensorRT Implicit Weight Quantization

 04-29-2025 04-29-2025 blog 8 minutes read (About 1265 words)
TensorRT Implicit Weight Quantization Caveats and Tricks

 
Deep Learning, 
Mathematics, 
Quantization, 
TensorRT  
  Read More

Automatic Differentiation Revisited

 04-12-2025 04-12-2025 blog 15 minutes read (About 2198 words)
Jacobian Matrix, De Novo Chain Rule Expression, Jacobian-Vector Product, Vector-Jacobian Product

 
Deep Learning, 
Mathematics, 
Linear Algebra, 
Calculus, 
Automatic Differentiation  
  Read More

Chain Rule

 04-06-2025 04-06-2025 blog 14 minutes read (About 2153 words)
Chain Rule Using Jacobian Matrix Multiplications

 
Mathematics, 
Linear Algebra, 
Calculus, 
Jacobian, 
Chain Rule  
  Read More

Derivatives

 03-31-2025 03-31-2025 blog 17 minutes read (About 2585 words)
Derivatives, Partial Derivatives, Directional Derivatives, and Total Derivatives

 
Mathematics, 
Linear Algebra, 
Calculus, 
Jacobian  
  Read More

Field of View

 03-03-2025 03-03-2025 blog 4 minutes read (About 627 words)
Mathematical Derivation of Field of View Equation

 
Mathematics, 
Camera, 
Physics, 
Photography  
  Read More

Depth of Field

 02-23-2025 02-23-2025 blog 13 minutes read (About 2016 words)
Mathematical Derivation of Depth of Field Equation

 
Mathematics, 
Camera, 
Physics, 
Photography  
  Read More

AWQ: Activation-Aware Weight Quantization

 01-01-2025 01-01-2025 blog 18 minutes read (About 2738 words)
Same Performance as Group-Wise Weight-Only Quantization But with Better Accuracy

 
Deep Learning, 
Mathematics, 
Quantization, 
CUDA, 
Accelerated Computing  
  Read More

CuTe Swizzle

 12-01-2024 10-01-2025 blog 19 minutes read (About 2909 words)
CuTe Shared Memory Swizzling Abstractions

 
Mathematics, 
CUDA, 
Accelerated Computing, 
CUTLASS, 
CuTe  
  Read More

CuTe Matrix Transpose

 11-20-2024 09-30-2025 article an hour read (About 10892 words)
Matrix Transpose CUDA Kernel Implementation Using CuTe

 
Mathematics, 
CUDA, 
Accelerated Computing, 
CUTLASS, 
CuTe  
  Read More

CuTe Layout Algebra

 10-20-2024 07-14-2025 article 2 hours read (About 19874 words)
Mathematical Fundamentals to CUTLASS Computing

 
Mathematics, 
CUDA, 
Accelerated Computing, 
CUTLASS, 
CuTe, 
Category Theory  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • …
  • 9
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1269

Categories

8

Tags

782

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog555
  • essay322
  • life287
  • miscellaneous2
  • photography55
  • project20
  • reading8

follow.it

Recents

01-16-2026

拖车公司的大汉们

essay

01-12-2026

PyTorch CUDA Graph Capture

blog

01-10-2026

Brushy Peak Regional Preserve 徒步

life

01-10-2026

Brushy Peak Regional Preserve

photography

01-08-2026

《故事会》里我至今记忆犹新的两个笑话

essay

Archives

  • January 20267
  • December 202523
  • November 202525
  • October 202524
  • September 202515
  • See All >>

Tags

Outdoors292
Hiking224
California223
CPP119
Mathematics102
Deep Learning84
CUDA69
Photography69
Running59
Wildlife47
Bird42
Racing37
Python36
Software Engineering36
Machine Learning34
Movie33
Statistics32
Park31
Linux30
China29
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×