Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs
  • Tags
  • Information Theory

Optimal Codeword Length

 08-18-2024 08-18-2024 blog 8 minutes read (About 1255 words)
Information Content, Shannon Entropy, and Optimal Codeword Length

 
Information Theory, 
Shannon Entropy, 
Shannon Information, 
Optimal Codeword Length, 
Code  
  Read More

Cross Entropy, KL Divergence, and Maximum Likelihood Estimation

 08-10-2019 08-10-2019 blog 6 minutes read (About 942 words)
Some Theories for Machine Learning Optimization

 
Machine Learning, 
Information Theory, 
Cross Entropy, 
KL Divergence, 
Maximum Likelihood Estimation  
  Read More

Byte Pair Encoding

 07-19-2019 07-19-2019 blog 16 minutes read (About 2377 words)
Common Tokenization Method for Natural Language Processing

 
Natural Language Processing, 
Information Theory, 
Byte Pair Encoding  
  Read More

Entropy, Perplexity and Its Applications

 07-17-2019 12-21-2023 blog 15 minutes read (About 2316 words)
Foundations of Information Theory to Machine Learning

 
Information Theory, 
Shannon Entropy, 
Perplexity, 
Entropy  
  Read More

Prefix-Free Code and Huffman Coding

 03-17-2018 03-17-2018 blog 9 minutes read (About 1322 words)
Understand Prefix-Free Code, Huffman Coding, and Try it Using Library Tools

 
Information Theory  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1075

Categories

8

Tags

695

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog513
  • essay274
  • life235
  • miscellaneous2
  • photography3
  • project20
  • reading8

follow.it

Recents

05-29-2025

Processing Raw Images Using RawTherapee

blog

05-28-2025

“更加好”素三层肉

essay

05-26-2025

Robert W. Crown Memorial State Beach

photography

05-26-2025

Robert W. Crown Memorial State Beach 徒步

life

05-25-2025

Braly Park

photography

Archives

  • May 202524
  • April 202521
  • March 202525
  • February 202521
  • January 202523
  • See All >>

Tags

Outdoors239
Hiking181
California170
CPP109
Mathematics91
Deep Learning80
CUDA50
Running47
Software Engineering35
Machine Learning34
Python32
Statistics31
Linux30
Park30
Racing30
Movie27
Docker26
China23
Museum23
Physics23
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×