Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Deep Learning

LoRA and LoRAPrune

 07-11-2024 07-11-2024 blog 11 minutes read (About 1664 words)
Fine-Tuning and Pruning of Large Language Models Using Low-Rank Adaptation

 
Deep Learning, 
Neural Network, 
Neural Network Pruning, 
LoRA, 
LoRAPrune  
  Read More

Parameter Importance Approximation Via Taylor Expansion In Neural Network Pruning

 06-20-2024 07-07-2024 blog 12 minutes read (About 1778 words)
Scoring Neural Network Parameter Importance Faster

 
Deep Learning, 
Mathematics, 
Neural Network Pruning, 
Taylor Expansion  
  Read More

PyTorch Variational Autoencoder

 06-14-2024 06-14-2024 blog 19 minutes read (About 2921 words)
Implementing Variational Autoencoder in PyTorch

 
Deep Learning, 
Statistics, 
Probability, 
Mathematics, 
Neural Network, 
Bayesian Inference, 
PyTorch, 
Variational Autoencoder, 
VAE  
  Read More

PyTorch Automatic Mixed Precision Training

 06-08-2024 06-08-2024 blog 3 minutes read (About 492 words)
Accelerating PyTorch Deep Learning Training with Automatic Mixed Precision

 
Deep Learning, 
Neural Network, 
PyTorch, 
Mixed Precision Training, 
Automatic Mixed Precision Training  
  Read More

PyTorch Eager Mode Quantization TensorRT Acceleration

 05-24-2024 05-24-2024 blog 7 minutes read (About 1051 words)
TensorRT Acceleration for PyTorch Native Eager Mode Quantization Models

 
Deep Learning, 
Python, 
Inference, 
Quantization, 
Accelerated Computing, 
NVIDIA, 
TensorRT, 
PyTorch, 
GPU  
  Read More

TensorRT Python Inference

 05-18-2024 05-18-2024 blog 12 minutes read (About 1843 words)
TensorRT Python Inference Example

 
Deep Learning, 
Python, 
Inference, 
NVIDIA, 
TensorRT, 
GPU  
  Read More

Reparameterization Trick

 05-08-2024 05-08-2024 blog 12 minutes read (About 1749 words)
How Distribution of a Random Variable Changes when the Variable is Transformed in a Deterministic Way

 
Deep Learning, 
Statistics, 
Probability, 
Mathematics, 
Jacobian, 
Variational Autoencoder  
  Read More

Quantization Unit Test

 03-25-2024 03-25-2024 blog 5 minutes read (About 748 words)
How To Unit Test Quantization Implementation

 
Deep Learning, 
Mathematics, 
Quantization, 
Software Engineering, 
Unit Test  
  Read More

PyTorch Custom ONNX Operator Export

 02-11-2024 02-11-2024 blog 10 minutes read (About 1573 words)
Easier PyTorch to TensorRT Custom Plugin Integration

 
Deep Learning, 
Software Engineering, 
TensorRT, 
PyTorch, 
ONNX  
  Read More

How To Debug Deep Learning Inference Applications

 01-01-2024 01-01-2024 article 23 minutes read (About 3511 words)
First Principles of Evaluating Deep Learning Inference

 
Deep Learning, 
Software Engineering, 
Deep Learning Inference, 
Numerical Errors  
  Read More

Numerical Errors In HPC and Deep Learning

 12-26-2023 12-26-2023 blog 4 minutes read (About 575 words)
Numerical Errors are Evil

 
Deep Learning, 
Numerical Errors, 
High Performance Computing  
  Read More

Deformable Attention

 12-16-2023 12-16-2023 blog 34 minutes read (About 5063 words)
Attention with Learned Spatial Feature Sampling

 
Deep Learning, 
Computer Vision, 
Transformer, 
Attention  
  Read More
Previous
Next
  • 1
  • 2
  • 3
  • …
  • 7
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1133

Categories

8

Tags

718

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog521
  • essay284
  • life253
  • miscellaneous2
  • photography25
  • project20
  • reading8

follow.it

Recents

07-10-2025

California Fresno 自驾游

life

07-08-2025

湾区的食品安全和鼠患问题

essay

07-06-2025

Garin Regional Park West

photography

07-06-2025

Hotel Wi-Fi Connection and Authentication Fix

blog

07-06-2025

Garin Regional Park West 徒步

life

Archives

  • July 20258
  • June 202547
  • May 202527
  • April 202521
  • March 202525
  • See All >>

Tags

Outdoors257
Hiking193
California188
CPP111
Mathematics93
Deep Learning82
CUDA51
Running49
Software Engineering35
Machine Learning34
Python33
Photography32
Racing32
Statistics31
Linux30
Movie30
Park30
Docker26
China25
Museum25
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×