Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Natural Language Processing

Autonomous Driving Trinity: Vision, Natural Language, and Action

 09-15-2023 09-15-2023 blog 4 minutes read (About 555 words)
Vision, Natural Language, and Action Closed-Loop Driving Model Proposal from Wayve

 
Computer Vision, 
Natural Language Processing, 
Autonomous Driving  
  Read More

OpenAI GPT Models

 04-15-2023 04-15-2023 article 28 minutes read (About 4168 words)
Generative Pre-Trained Transformer Models From OpenAI

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Reinforcement Learning, 
OpenAI, 
GPT, 
ChatGPT, 
InstructGPT  
  Read More

Transformer Autoregressive Inference Optimization

 04-06-2023 04-06-2023 article 27 minutes read (About 4084 words)
Principles for Faster Transformer Inference

 
Deep Learning, 
Inference, 
Natural Language Processing, 
Optimization, 
Transformer, 
Accelerated Computing  
  Read More

Gated Linear Units (GLU) and Gated CNN

 03-09-2020 03-09-2020 blog 6 minutes read (About 827 words)
Gated Linear Units and Gated CNN Explained

 
Machine Learning, 
Deep Learning, 
Natural Language Processing  
  Read More

Evolved Transformer Explained

 03-07-2020 03-07-2020 blog 5 minutes read (About 777 words)
Evolution Search on Transformer Neural Network Architectures

 
Machine Learning, 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Neural Architecture Search, 
Evolution Algorithm  
  Read More

Bilingual Evaluation Understudy (BLEU)

 11-17-2019 11-17-2019 blog 11 minutes read (About 1644 words)
Elucidating the Machine Translation BLEU Scoring Mechanism

 
Natural Language Processing, 
Machine Translation  
  Read More

Word2Vec Models Revisited

 08-23-2019 08-23-2019 article 24 minutes read (About 3525 words)
A Review on the Classic Word2Vec Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read More

Hierarchical Softmax

 08-17-2019 08-17-2019 article 8 minutes read (About 1194 words)
Orchestrated Softmax for Fast Language Model Training

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read More

Noise Contrastive Estimation

 07-26-2019 04-17-2024 article 33 minutes read (About 4917 words)
Accelerate the Training of Neural Language Models

 
Machine Learning, 
Natural Language Processing, 
Optimization  
  Read More

Byte Pair Encoding

 07-19-2019 07-19-2019 blog 16 minutes read (About 2377 words)
Common Tokenization Method for Natural Language Processing

 
Natural Language Processing, 
Information Theory, 
Byte Pair Encoding  
  Read More

Transformer Explained In One Single Page

 06-01-2019 02-09-2023 blog 23 minutes read (About 3454 words)
Attention is All You Need Mathematically

 
Deep Learning, 
Natural Language Processing, 
Transformer, 
Machine Translation  
  Read More

Maximum Likelihood Estimation of N-Gram Model Parameters

 06-09-2018 04-30-2025 blog 9 minutes read (About 1417 words)
Mathematical Proof of the Maximum Likelihood Estimation of N-Gram Model Parameters

 
Probability, 
Natural Language Processing  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1260

Categories

8

Tags

779

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog554
  • essay320
  • life284
  • miscellaneous2
  • photography52
  • project20
  • reading8

follow.it

Recents

01-06-2026

Disqus Affiliate Links URL Hijacking

blog

01-01-2026

California Point Reyes 自驾游

life

12-31-2025

Inspecting and Visualizing Torch FX Graph

blog

12-31-2025

2025 年 11 月和 12 月该入手的模型手办

essay

12-26-2025

指甲盖下的淤血

essay

Archives

  • January 20262
  • December 202519
  • November 202525
  • October 202524
  • September 202515
  • See All >>

Tags

Outdoors289
Hiking221
California220
CPP119
Mathematics102
Deep Learning84
CUDA68
Photography66
Running59
Wildlife44
Bird39
Racing37
Python36
Software Engineering36
Machine Learning34
Movie33
Statistics32
Park31
Linux30
China29
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×