Join Us Every Other Week For
vLLM Office Hours
As a leading contributor to vLLM, Neural Magic partners with vLLM project committers and the vLLM team at UC Berkeley to host bi-weekly office hours. Join us to give feedback, ask questions, and hear about cutting-edge developments to accelerate your inference. Typical office hours agenda:
- 20-minute vLLM update
- 20-minute special guest topic; see below for details 👇
- 20-minute open discussion, feedback loop, and Q&A
[vLLM Office Hours #26] Intro to torch.compile and how it works with vLLM
Join Red Hat's vLLM and Meta's PyTorch experts to learn about torch.compile and how it works with vLLM. We'll share what torch.compile is, why use it, how it works, how vLLM uses it, performance benchmarks, and more. Join us to learn and to ask questions!
Register for future office hours here: https://neuralmagic.com/community-office-hours/ ...