Join our bi-weekly vLLM Office Hours. Learn about vLLM, ask questions, and engage with the community.
Products
nm-vllm
Enterprise inference server for LLMs on GPUs.
DeepSparse
Sparsity-aware inference server for LLMs, CV and NLP models on CPUs.
Developers
Community
Join our community and innovate together.
SparseML
Optimize LLMs, CV and NLP models with our open-source libraries.
SparseZoo
Get started faster with our open-source model repository.
Hugging Face
Deliver fast inference with our pre-optimized, open-source LLMs.
GitHub
Look under the hood and contribute to our open-source code.
Docs
Access the tutorials, guides, examples, and more.
Blog
Resources
Research Papers
Learn more about the magic behind Neural Magic.
Support
Get the answers you need.
Company
About Us
Who's Neural Magic?
Our Technology
How does it work?
Careers
Interested in joining our team?
Contact
Have a question for us?
Book a Demo
Get Started
Aug 14, 2024
Spread the Word
Stay Up to Date
SUBMIT
Join the Conversation
slack
Continue Reading
Open Source
LLM Compressor is Here: Faster Inference with vLLM
Jul 15, 2024
vLLM Brings FP8 Inference to the Open-Source Community
Thought Leadership
Jun 18, 2024
Deploy Llama 3 8B with vLLM
view all blogs
