Sharing Key and Value Tensors for a Group of Query Tensors to Mitigate Transformer Attention Layer Performance Bottleneck

Performance Bottleneck for Serving Transformer Models

Same Performance as Group-Wise Weight-Only Quantization But with Better Accuracy

First Time Serving as NeurIPS Area Chair

Scene Representation and Differentiable Rendering with Neural Radiance Fields

Fine-Tuning and Pruning of Large Language Models Using Low-Rank Adaptation

Scoring Neural Network Parameter Importance Faster

Implementing Variational Autoencoder in PyTorch

Accelerating PyTorch Deep Learning Training with Automatic Mixed Precision

TensorRT Acceleration for PyTorch Native Eager Mode Quantization Models

TensorRT Python Inference Example

How Distribution of a Random Variable Changes when the Variable is Transformed in a Deterministic Way