Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsItemsLifeEssayArchivesCategoriesTagsFAQs
  • Tags
  • Optimization

Maximum Likelihood Estimation VS Maximum A Posteriori Estimation

 07-02-2021 07-02-2021 blog 6 minutes read (About 941 words)
MLE VS MAP

 
Optimization, 
Mathematics  
  Read more

Hessian Matrix of Convex Functions

 06-24-2021 02-21-2022 blog 19 minutes read (About 2787 words)
Verification of Convex Functions using Hessian Matrix

 
Optimization  
  Read more

Minmax Game for Training Generative Adversarial Networks

 10-07-2020 10-08-2020 blog 8 minutes read (About 1206 words)
Some Intuitions to Training Generative Adversarial Networks

 
Deep Learning, 
Optimization, 
Generative Adversarial Networks, 
GAN  
  Read more

Newton-Raphson Method

 09-27-2020 09-27-2020 blog 5 minutes read (About 770 words)
Approximate Algorithm for Finding Roots to Real-Valued Function

 
Optimization  
  Read more

Cross Entropy Loss VS Log Loss VS Sum of Log Loss

 07-18-2020 07-18-2020 blog 23 minutes read (About 3404 words)
Conventional Classification Loss Functions Elucidated

 
Machine Learning, 
Optimization, 
Mathematics  
  Read more

Population Based Training

 06-28-2020 06-28-2020 blog 14 minutes read (About 2059 words)
Model Optimization with Genetically Evolved Hyperparameters

 
Machine Learning, 
Optimization, 
Genetics Algorithm  
  Read more

Word2Vec Models Revisited

 08-23-2019 08-23-2019 article 23 minutes read (About 3524 words)
A Review on the Classic Word2Vec Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read more

Hierarchical Softmax

 08-17-2019 08-17-2019 article 8 minutes read (About 1191 words)
Orchestrated Softmax for Fast Language Model Training

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read more

Label Smoothing

 08-11-2019 12-26-2020 blog 6 minutes read (About 956 words)
Regularization for Classification Models

 
Machine Learning, 
Optimization, 
Regularization  
  Read more

Noise Contrastive Estimation

 07-26-2019 07-26-2019 article 30 minutes read (About 4509 words)
Accelerate the Training of Neural Language Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read more
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

402

Categories

8

Tags

246

  Follow   Sponsor

Categories

  • article13
  • blog303
  • essay25
  • item8
  • life31
  • miscellaneous2
  • project12
  • reading8

follow.it

Advertisement


Recents

07-15-2022

再谈反对自由主义

essay

07-15-2022

C++ Universal Reference and Perfect Forwarding

blog

07-11-2022

美国鸦片复兴运动

essay

07-11-2022

Wine on Docker

blog

07-07-2022

Flash Player Emulation

blog

Archives

  • July 20229
  • June 202228
  • May 202221
  • April 202214
  • March 202220
  • See All >>

Tags

CPP57
Mathematics47
Deep Learning46
Outdoors36
Machine Learning33
Software Engineering27
Linux24
Statistics22
Hiking20
CUDA18
Physics18
Python18
Park14
Docker13
Computer Vision12
Ubuntu12
C11
Jogging10
Optimization10
PyTorch10
See All >>
Lei Mao's Log Book

© 2022 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×