Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayPhotographyArchivesCategoriesTagsFAQs

Get Available Versions for Python Pip Package

 02-10-2025 02-10-2025 blog 3 minutes read (About 387 words)
The Python Officially Supported Approaches

 
Python, 
Pip  
  Read More

Grouped Query Attention Performance Theoretical Analysis

 02-03-2025 03-02-2025 blog 11 minutes read (About 1612 words)
Sharing Key and Value Tensors for a Group of Query Tensors to Mitigate Transformer Attention Layer Performance Bottleneck

 
Deep Learning, 
Neural Network, 
Transformer, 
Performance Optimization, 
Computer Architecture, 
Large Language Model  
  Read More

Fix NVIDIA Driver After Ubuntu Unattended Upgrade

 01-30-2025 01-30-2025 blog 2 minutes read (About 303 words)
A Quick and Safe Log for Fixing NVIDIA Driver

 
NVIDIA, 
Ubuntu, 
Driver  
  Read More

Transformer Vanilla Attention Performance Theoretical Analysis

 01-27-2025 03-02-2025 blog 9 minutes read (About 1275 words)
Performance Bottleneck for Serving Transformer Models

 
Deep Learning, 
Neural Network, 
Transformer, 
Performance Optimization, 
Computer Architecture, 
Large Language Model  
  Read More

iPad Battery Health

 01-22-2025 01-22-2025 blog 3 minutes read (About 498 words)
Check iPad Battery Remaining Capacity

 
Apple, 
iPad  
  Read More

CS2 Mouse Fix

 01-14-2025 01-14-2025 blog 4 minutes read (About 599 words)
Making Mouse Working Again In Counter-Strike 2

 
Game, 
Counter-Strike, 
Mouse, 
CS, 
CS2, 
Monitor, 
Steam  
  Read More

CuTe Tiled MMA

 01-09-2025 10-19-2025 blog 30 minutes read (About 4482 words)
Understanding CuTe Tiled MMA Using an Example

 
Accelerated Computing, 
CUTLASS, 
CUDA, 
CuTe  
  Read More

NVIDIA GPU Compute Capability

 01-02-2025 01-22-2026 blog 15 minutes read (About 2202 words)
A Table of NVIDIA GPUs and Their Compute Capabilities

 
CUDA, 
NVIDIA, 
GPU  
  Read More

AWQ: Activation-Aware Weight Quantization

 01-01-2025 01-01-2025 blog 18 minutes read (About 2738 words)
Same Performance as Group-Wise Weight-Only Quantization But with Better Accuracy

 
Deep Learning, 
Mathematics, 
Quantization, 
Accelerated Computing, 
CUDA  
  Read More

NeurIPS 2024 Area Chair Experience

 12-26-2024 12-26-2024 blog 9 minutes read (About 1389 words)
First Time Serving as NeurIPS Area Chair

 
Deep Learning, 
Conference, 
NeurIPS  
  Read More

C++ Compile-Time Type Map

 12-22-2024 12-22-2025 blog 6 minutes read (About 921 words)
C++ Select Types Based On Template Types

 
CPP, 
CPP17, 
Metaprogramming  
  Read More

Ubuntu 24.04 LTS GUI File Operation Slowness

 12-14-2024 12-14-2024 blog a minute read (About 217 words)
Ubuntu 24.04 LTS GUI Severe Issue Workaround

 
Ubuntu  
  Read More
Previous
Next
  • 1
  • …
  • 9
  • 10
  • 11
  • …
  • 50
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Menlo Park, California

Posts

1497

Categories

8

Tags

852

  Follow   Sponsor

Advertisement


Categories

  • article21
  • blog596
  • essay378
  • life363
  • miscellaneous2
  • photography109
  • project20
  • reading8

follow.it

Recents

11-05-2026

Performance Bottleneck from Hidden Atomic Operations

blog

11-05-2026

PokéBonk

essay

11-01-2026

老江湖

essay

10-31-2026

Alum Rock Park and Sierra Vista Open Space 徒步

life

10-31-2026

Alum Rock Park and Sierra Vista Open Space

photography

Archives

  • November 20263
  • October 202632
  • September 202624
  • August 202625
  • July 202623
  • See All >>

Tags

Outdoors369
California303
Hiking275
Photography128
CPP125
Mathematics104
Wildlife96
Bird89
Deep Learning87
CUDA86
Running86
Racing61
Movie51
Python38
Software Engineering37
China36
Machine Learning35
NVIDIA35
Accelerated Computing34
PyTorch34
See All >>
Lei Mao's Log Book

© 2017-2026 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×