Lei Mao's Log Book
Lei Mao's Log BookCurriculumBlogArticlesProjectsPublicationsReadingsLifeEssayArchivesCategoriesTagsFAQs
  • Tags
  • Computer Architecture

Roofline Performance Model

 03-26-2025 03-26-2025 blog 7 minutes read (About 1078 words)
Understand the Performance Limitations and Gaps

 
Accelerated Computing, 
High Performance Computing, 
Computer Architecture, 
Performance  
  Read More

Grouped Query Attention Performance Theoretical Analysis

 02-03-2025 03-02-2025 blog 11 minutes read (About 1612 words)
Sharing Key and Value Tensors for a Group of Query Tensors to Mitigate Transformer Attention Layer Performance Bottleneck

 
Deep Learning, 
Neural Network, 
Transformer, 
Computer Architecture, 
Performance Optimization, 
Large Language Model  
  Read More

Transformer Vanilla Attention Performance Theoretical Analysis

 01-27-2025 03-02-2025 blog 9 minutes read (About 1275 words)
Performance Bottleneck for Serving Transformer Models

 
Deep Learning, 
Neural Network, 
Transformer, 
Computer Architecture, 
Performance Optimization, 
Large Language Model  
  Read More

Function Approximation Using Lookup Table and Interpolation

 09-22-2023 09-22-2023 blog 7 minutes read (About 1001 words)
Using Motorola CPU32 as an Example

 
Deep Learning, 
Quantization, 
Computer Architecture  
  Read More

Row-Major VS Column-Major

 05-12-2023 05-12-2023 blog 28 minutes read (About 4154 words)
Ways of Packing Matrix in Memory and Its Consequence for Matrix Multiplication

 
CPP, 
CUDA, 
Computer Architecture, 
Memory  
  Read More

Multi-Thread Single-Stream VS Single-Thread Multi-Stream CUDA

 10-18-2021 05-12-2022 blog 13 minutes read (About 1946 words)
CUDA Programming Choices for CUDA Stream

 
Deep Learning, 
Mathematics, 
CUDA, 
High Performance Computing, 
Computer Architecture, 
Parallel Computing  
  Read More

Math-Bound VS Memory-Bound Operations

 10-11-2021 09-18-2023 blog 8 minutes read (About 1188 words)
Computation Bandwidth, Memory Bandwidth, and Data Reuse

 
Deep Learning, 
Mathematics, 
Computer Architecture  
  Read More

Binary VS Text Mode for File I/O Operations

 12-22-2019 09-16-2022 blog 9 minutes read (About 1395 words)
Some Fundamental Concepts for Reading and Writing Files

 
Software Engineering, 
Computer Architecture  
  Read More
Lei Mao

Lei Mao

Artificial Intelligence Machine Learning Computer Science

Santa Clara, California

Posts

1056

Categories

7

Tags

687

  Follow   Sponsor

Advertisement


Categories

  • article20
  • blog508
  • essay269
  • life229
  • miscellaneous2
  • project20
  • reading8

follow.it

Recents

05-08-2025

Tensor Calculus Layout Conventions

blog

05-07-2025

幸运钥匙

essay

05-04-2025

人在湾区五月份长冻疮

essay

05-03-2025

ICML 2025 Area Chair Experience

blog

05-03-2025

Sunol Wilderness Regional Preserve 徒步

life

Archives

  • May 20255
  • April 202521
  • March 202525
  • February 202521
  • January 202523
  • See All >>

Tags

Outdoors232
Hiking177
California164
CPP108
Mathematics89
Deep Learning78
CUDA50
Running46
Software Engineering35
Machine Learning34
Python32
Statistics31
Park30
Linux29
Racing29
Docker26
Movie25
China23
Physics23
Museum22
See All >>
Lei Mao's Log Book

© 2017-2025 Lei Mao  Powered by Hexo & Icarus
Site UV:  Site PV:

×