Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Inference

PyTorch Graph Symbolic Integer

 04-05-2026 06-09-2026 blog 11 minutes read (About 1602 words)
Graph Shape Inference with Symbolic Integers for Dynamic Shapes

 
Deep Learning, 
Inference, 
PyTorch, 
Neural Network Compiler  
  Read More

PyTorch Export

 03-31-2026 04-01-2026 blog 6 minutes read (About 857 words)
Exporting Graph-Representable PyTorch Models for Inference

 
CPP, 
Inference, 
PyTorch  
  Read More

PyTorch Eager Mode Quantization TensorRT Acceleration

 05-24-2024 05-24-2024 blog 7 minutes read (About 1051 words)
TensorRT Acceleration for PyTorch Native Eager Mode Quantization Models

 
Deep Learning, 
Python, 
Inference, 
Quantization, 
Accelerated Computing, 
NVIDIA, 
TensorRT, 
PyTorch, 
GPU  
  Read More

TensorRT Python Inference

 05-18-2024 05-18-2024 blog 12 minutes read (About 1843 words)
TensorRT Python Inference Example

 
Deep Learning, 
Python, 
Inference, 
NVIDIA, 
TensorRT, 
GPU  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

ONNX Runtime JavaScript

 11-28-2022 11-28-2022 blog 16 minutes read (About 2458 words)
Front-End Neural Network Inference

 
Artificial Intelligence, 
Deep Learning, 
Inference, 
ONNX, 
Neural Networks  
  Read More

Simple Inference Server

 12-30-2020 12-30-2020 project 7 minutes read (About 979 words)
Running Machine Learning Inference as Service from Scratch

 
Machine Learning, 
Deep Learning, 
Python, 
Inference  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1501

Categories

8

Tags

852

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog596
  • essay379
  • life365
  • miscellaneous2
  • photography110
  • project20
  • reading8

follow.it

Recents

11-10-2026

群体

essay

11-07-2026

Coyote Creek Trail

photography

11-07-2026

2026 Annual Celebration Of Life 5K 竞赛

life

11-07-2026

Coyote Creek Trail 徒步

life

11-05-2026

Performance Bottleneck from Hidden Atomic Operations

blog

Archives

  • November 20267
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors371
California305
Hiking276
Photography129
CPP125
Mathematics104
Wildlife97
Bird90
Deep Learning87
Running87
CUDA86
Racing62
Movie52
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×