Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Mathematics

Online Safe Softmax

 06-23-2025 06-23-2025 blog 5 minutes read (About 741 words)
Safe and Efficient Online Softmax Calculation

 
Deep Learning, 
Mathematics, 
Accelerated Computing  
  Read More

Focus In Landscape Photography

 06-08-2025 06-08-2025 blog 7 minutes read (About 1038 words)
Deriving Depth of Field for Landscape Photography

 
Photography, 
Landscape, 
Mathematics, 
Physics, 
Camera  
  Read More

Computing Hessian Matrix Via Automatic Differentiation

 05-22-2025 05-22-2025 blog 18 minutes read (About 2664 words)
Computing Higher-Order Derivatives Using Automatic Differentiation

 
Deep Learning, 
Mathematics, 
Neural Networks, 
Calculus, 
Automatic Differentiation  
  Read More

Optimal Brain Surgeon

 05-14-2025 05-14-2025 blog 40 minutes read (About 6047 words)
Derivation and Extension of The Classical Optimal Brain Surgeon Algorithm

 
Deep Learning, 
Mathematics, 
Neural Networks, 
Calculus, 
Neural Network Pruning  
  Read More

Tensor Calculus Layout Conventions

 05-08-2025 05-08-2025 blog 39 minutes read (About 5799 words)
Numerator Layout VS Denominator Layout

 
Mathematics, 
Calculus  
  Read More

TensorRT Implicit Weight Quantization

 04-29-2025 04-29-2025 blog 8 minutes read (About 1265 words)
TensorRT Implicit Weight Quantization Caveats and Tricks

 
Deep Learning, 
Mathematics, 
Quantization, 
TensorRT  
  Read More

Automatic Differentiation Revisited

 04-12-2025 04-12-2025 blog 15 minutes read (About 2198 words)
Jacobian Matrix, De Novo Chain Rule Expression, Jacobian-Vector Product, Vector-Jacobian Product

 
Deep Learning, 
Mathematics, 
Linear Algebra, 
Calculus, 
Automatic Differentiation  
  Read More

Chain Rule

 04-06-2025 04-06-2025 blog 14 minutes read (About 2153 words)
Chain Rule Using Jacobian Matrix Multiplications

 
Mathematics, 
Linear Algebra, 
Calculus, 
Jacobian, 
Chain Rule  
  Read More

Derivatives

 03-31-2025 03-31-2025 blog 17 minutes read (About 2585 words)
Derivatives, Partial Derivatives, Directional Derivatives, and Total Derivatives

 
Mathematics, 
Linear Algebra, 
Calculus, 
Jacobian  
  Read More

Field of View

 03-03-2025 03-03-2025 blog 4 minutes read (About 627 words)
Mathematical Derivation of Field of View Equation

 
Photography, 
Mathematics, 
Physics, 
Camera  
  Read More

Depth of Field

 02-23-2025 02-23-2025 blog 13 minutes read (About 2016 words)
Mathematical Derivation of Depth of Field Equation

 
Photography, 
Mathematics, 
Physics, 
Camera  
  Read More

AWQ: Activation-Aware Weight Quantization

 01-01-2025 01-01-2025 blog 18 minutes read (About 2738 words)
Same Performance as Group-Wise Weight-Only Quantization But with Better Accuracy

 
Deep Learning, 
Mathematics, 
Quantization, 
Accelerated Computing, 
CUDA  
  Read More
Previous
Next
  • 1
  • 2
  • …
  • 8
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1127

Categories

8

Tags

712

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog520
  • essay282
  • life251
  • miscellaneous2
  • photography24
  • project20
  • reading8

follow.it

Recents

07-04-2025

2025 Alameda July 4th Parade Race 5K 竞赛

life

07-04-2025

2025 Alameda July 4th Parade 观摩

life

06-30-2025

June 2025 Random Photos

photography

06-30-2025

Load CUDA Kernel at Runtime Using CUDA Driver APIs

blog

06-30-2025

2025 年 5 月和 6 月该入手的模型手办

essay

Archives

  • July 20252
  • June 202547
  • May 202527
  • April 202521
  • March 202525
  • See All >>

Tags

Outdoors255
Hiking191
California186
CPP111
Mathematics93
Deep Learning82
CUDA51
Running49
Software Engineering35
Machine Learning34
Python33
Racing32
Statistics31
Linux30
Movie30
Park30
Photography30
Docker26
China25
Museum25
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×