Cody Yu

We Ran Over Half a Million Evaluations on Quantized LLMs: Here's What We Found

Introducing Machete, a Mixed-Input GEMM Kernel Optimized for NVIDIA Hopper GPUs

LLM Compressor is Here: Faster Inference with vLLM