Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayArchivesCategoriesTagsFAQs
  • Tags
  • Optimization

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read more

Solving 0-1 Knapsack Problems

 02-13-2023 02-13-2023 blog 11 minutes read (About 1582 words)
Recursion, Dynamic Programming, and Linear Programming

 
Python, 
Optimization, 
Linear Programming, 
Recursion, 
Dynamic Programming  
  Read more

Maximum Likelihood Estimation VS Maximum A Posteriori Estimation

 07-02-2021 07-02-2021 blog 6 minutes read (About 941 words)
MLE VS MAP

 
Mathematics, 
Optimization  
  Read more

Hessian Matrix of Convex Functions

 06-24-2021 06-23-2023 blog 19 minutes read (About 2921 words)
Verification of Convex Functions using Hessian Matrix

 
Mathematics, 
Optimization  
  Read more

Minimax Game for Training Generative Adversarial Networks

 10-07-2020 05-07-2023 blog 9 minutes read (About 1413 words)
Some Intuitions to Training Generative Adversarial Networks

 
Deep Learning, 
Generative Adversarial Networks, 
Optimization, 
GAN, 
Neural Networks  
  Read more

Newton-Raphson Method

 09-27-2020 09-27-2020 blog 5 minutes read (About 770 words)
Approximate Algorithm for Finding Roots to Real-Valued Function

 
Optimization  
  Read more

Cross Entropy Loss VS Log Loss VS Sum of Log Loss

 07-18-2020 07-18-2020 blog 23 minutes read (About 3404 words)
Conventional Classification Loss Functions Elucidated

 
Machine Learning, 
Mathematics, 
Optimization  
  Read more

Population Based Training

 06-28-2020 06-28-2020 blog 14 minutes read (About 2059 words)
Model Optimization with Genetically Evolved Hyperparameters

 
Machine Learning, 
Optimization, 
Genetics Algorithm  
  Read more

Word2Vec Models Revisited

 08-23-2019 08-23-2019 article 23 minutes read (About 3524 words)
A Review on the Classic Word2Vec Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read more

Hierarchical Softmax

 08-17-2019 08-17-2019 article 8 minutes read (About 1191 words)
Orchestrated Softmax for Fast Language Model Training

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read more
Previous
Next
  • 1
  • 2
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

661

Categories

7

Tags

415

  Follow   Sponsor

Categories

  • article16
  • blog399
  • essay119
  • life98
  • miscellaneous2
  • project19
  • reading8

follow.it

Advertisement


Recents

10-01-2023

How Camera Lens Works

blog

09-28-2023

文学少女

essay

09-27-2023

Hexo Deployment on GitHub Using GitHub Fine-Grained Tokens

blog

09-25-2023

C++ Bind VS Lambda Expression

blog

09-22-2023

Function Approximation Using Lookup Table and Interpolation

blog

Archives

  • October 20231
  • September 202317
  • August 202316
  • July 202318
  • June 202317
  • See All >>

Tags

Outdoors101
CPP86
Hiking74
Mathematics62
Deep Learning57
Machine Learning35
CUDA28
Software Engineering28
California26
Linux24
Python24
Statistics24
Physics20
Jogging19
Docker17
Park17
JavaScript16
C15
Computer Vision15
Ubuntu13
See All >>
Lei Mao's Log Book

© 2017-2023 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×