Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Information Theory

Optimal Codeword Length

 08-18-2024 08-18-2024 blog 8 minutes read (About 1255 words)
Information Content, Shannon Entropy, and Optimal Codeword Length

 
Information Theory, 
Shannon Entropy, 
Shannon Information, 
Optimal Codeword Length, 
Code  
  Read More

Cross Entropy, KL Divergence, and Maximum Likelihood Estimation

 08-10-2019 08-10-2019 blog 6 minutes read (About 942 words)
Some Theories for Machine Learning Optimization

 
Machine Learning, 
Information Theory, 
Cross Entropy, 
KL Divergence, 
Maximum Likelihood Estimation  
  Read More

Byte Pair Encoding

 07-19-2019 07-19-2019 blog 16 minutes read (About 2377 words)
Common Tokenization Method for Natural Language Processing

 
Natural Language Processing, 
Information Theory, 
Byte Pair Encoding  
  Read More

Entropy, Perplexity and Its Applications

 07-17-2019 12-21-2023 blog 15 minutes read (About 2316 words)
Foundations of Information Theory to Machine Learning

 
Information Theory, 
Shannon Entropy, 
Perplexity, 
Entropy  
  Read More

Prefix-Free Code and Huffman Coding

 03-17-2018 03-17-2018 blog 9 minutes read (About 1322 words)
Understand Prefix-Free Code, Huffman Coding, and Try it Using Library Tools

 
Information Theory  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1177

Categories

8

Tags

742

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog532
  • essay298
  • life262
  • miscellaneous2
  • photography35
  • project20
  • reading8

follow.it

Recents

09-09-2025

2025 年再次感染 COVID-19

essay

09-08-2025

TensorRT Plugin Version and Namespace

blog

08-31-2025

August 2025 Random Photos

photography

08-27-2025

Illegal Memory Access and Segmentation Fault

blog

08-24-2025

Alviso Marina County Park

photography

Archives

  • September 20252
  • August 202526
  • July 202523
  • June 202547
  • May 202527
  • See All >>

Tags

Outdoors266
Hiking201
California197
CPP113
Mathematics98
Deep Learning83
CUDA57
Running51
Photography42
Software Engineering36
Machine Learning34
Python34
Racing33
Movie32
Statistics31
Linux30
Park30
China29
Bird26
Docker26
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×