Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Optimization

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Solving 0-1 Knapsack Problems

 02-13-2023 02-13-2023 blog 11 minutes read (About 1582 words)
Recursion, Dynamic Programming, and Linear Programming

 
Python, 
Optimization, 
Linear Programming, 
Recursion, 
Dynamic Programming  
  Read More

Maximum Likelihood Estimation VS Maximum A Posteriori Estimation

 07-02-2021 07-02-2021 blog 6 minutes read (About 941 words)
MLE VS MAP

 
Mathematics, 
Optimization  
  Read More

Hessian Matrix of Convex Functions

 06-24-2021 06-23-2023 blog 19 minutes read (About 2922 words)
Verification of Convex Functions using Hessian Matrix

 
Mathematics, 
Optimization  
  Read More

Minimax Game for Training Generative Adversarial Networks

 10-07-2020 05-07-2023 blog 10 minutes read (About 1426 words)
Some Intuitions to Training Generative Adversarial Networks

 
Deep Learning, 
Generative Adversarial Networks, 
Optimization, 
GAN, 
Neural Networks  
  Read More

Newton-Raphson Method

 09-27-2020 09-27-2020 blog 5 minutes read (About 771 words)
Approximate Algorithm for Finding Roots to Real-Valued Function

 
Optimization  
  Read More

Cross Entropy Loss VS Log Loss VS Sum of Log Loss

 07-18-2020 07-18-2020 blog 23 minutes read (About 3404 words)
Conventional Classification Loss Functions Elucidated

 
Machine Learning, 
Mathematics, 
Optimization  
  Read More

Population Based Training

 06-28-2020 06-28-2020 blog 14 minutes read (About 2061 words)
Model Optimization with Genetically Evolved Hyperparameters

 
Machine Learning, 
Optimization, 
Genetics Algorithm  
  Read More

Word2Vec Models Revisited

 08-23-2019 08-23-2019 article 24 minutes read (About 3525 words)
A Review on the Classic Word2Vec Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read More

Hierarchical Softmax

 08-17-2019 08-17-2019 article 8 minutes read (About 1194 words)
Orchestrated Softmax for Fast Language Model Training

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read More

Label Smoothing

 08-11-2019 12-26-2020 blog 6 minutes read (About 956 words)
Regularization for Classification Models

 
Machine Learning, 
Optimization, 
Regularization  
  Read More

Noise Contrastive Estimation

 07-26-2019 04-17-2024 article 33 minutes read (About 4917 words)
Accelerate the Training of Neural Language Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1386

Categories

8

Tags

821

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog578
  • essay352
  • life324
  • miscellaneous2
  • photography81
  • project20
  • reading8

follow.it

Recents

06-20-2026

The City Eats & Stack Run Club - Hayward 5K 竞赛

life

06-19-2026

Las Trampas Wilderness Regional Preserve 徒步

life

06-19-2026

Las Trampas Wilderness Regional Preserve

photography

06-16-2026

2026 FIFA World Cup 备受嘲讽的会徽

essay

06-14-2026

Python Debugging Via VS Code In Docker Container

blog

Archives

  • June 202617
  • May 202624
  • April 202618
  • March 202618
  • February 202617
  • See All >>

Tags

Outdoors329
California260
Hiking247
CPP122
Mathematics102
Photography96
Deep Learning87
CUDA75
Running75
Wildlife72
Bird66
Racing51
Movie41
Python38
Software Engineering36
Machine Learning35
China33
Linux32
NVIDIA32
Statistics32
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×