Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Hugging Face announces llama.cpp and vLLM quantization workshop livestream

AI summary

Hugging Face announced a quantization workshop livestream for “next Tuesday,” focused on shrinking models so they fit on a laptop. In a Reddit post, Merve from Hugging Face said the session would cover how quantization works, modern techniques such as double quantization and calibration, and llama.cpp quantizations including k-quants and i-quants. The program also features practical guidance on quantization with llama.cpp and vLLM. The announcement listed Merve, Maxime Labonne, Aditya Tadimeti, Michael Goin and Colin Kealty as participants. The livestream is planned for Hugging Face’s YouTube, X and LinkedIn accounts, where viewers can set reminders.

Hey folks, it's Merve from Hugging Face. Title of this post is super self explanatory, we are doing a quantization workshop livestream with Michael Goin (lead maintainer of vLLM at RedHat), Colin Kealty (aka bartowski at RedHat), Maxime Labonne and Aditya Tadimeti. I will shortly teach you how quantization works, modern ideas (double quantization, calibration) and llama.cpp quants (k-quants, i-quants) so even if you don't have an idea, feel free to chime in. Everything is on Hugging Face YT, X, LI where you can set reminders. Looking forward to see y'all! submitted by /u/unofficialmerve [link] [comments]

#Hugging Face#llama.cpp#vLLM#Red Hat#Michael Goin#Colin Kealty#Maxime Labonne#Aditya Tadimeti#Merve Noyan#Hugging Face YouTube

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.