Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Inference

PyTorch Eager Mode Quantization TensorRT Acceleration

 05-24-2024 05-24-2024 blog 7 minutes read (About 1051 words)
TensorRT Acceleration for PyTorch Native Eager Mode Quantization Models

 
Deep Learning, 
Python, 
Inference, 
Quantization, 
Accelerated Computing, 
NVIDIA, 
TensorRT, 
PyTorch, 
GPU  
  Read More

TensorRT Python Inference

 05-18-2024 05-18-2024 blog 12 minutes read (About 1843 words)
TensorRT Python Inference Example

 
Deep Learning, 
Python, 
Inference, 
NVIDIA, 
TensorRT, 
GPU  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

ONNX Runtime JavaScript

 11-28-2022 11-28-2022 blog 16 minutes read (About 2458 words)
Front-End Neural Network Inference

 
Artificial Intelligence, 
Deep Learning, 
Inference, 
ONNX, 
Neural Networks  
  Read More

Simple Inference Server

 12-30-2020 12-30-2020 project 7 minutes read (About 979 words)
Running Machine Learning Inference as Service from Scratch

 
Machine Learning, 
Deep Learning, 
Python, 
Inference  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1066

Categories

8

Tags

694

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog510
  • essay272
  • life233
  • miscellaneous2
  • photography1
  • project20
  • reading8

follow.it

Recents

05-18-2025

Benchmade Grizzly Creek Folding Knife

blog

05-18-2025

第一次生态摄影的一些感受、不足和反思

essay

05-17-2025

Quarry Lakes Regional Recreation Area

photography

05-17-2025

目击者

essay

05-17-2025

Quarry Lakes Regional Recreation Area 徒步

life

Archives

  • May 202515
  • April 202521
  • March 202525
  • February 202521
  • January 202523
  • See All >>

Tags

Outdoors237
Hiking179
California168
CPP108
Mathematics90
Deep Learning79
CUDA50
Running47
Software Engineering35
Machine Learning34
Python32
Statistics31
Park30
Racing30
Linux29
Docker26
Movie26
China23
Museum23
Physics23
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×