Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Qualcomm CEO: AI companies ask for phones running 100B-parameter LLMs locally by 2028

AI summary

Qualcomm president and CEO Cristiano Amon said in an interview with Sources that several companies at the forefront of AI are asking Qualcomm to support smartphones that run at least a 100-billion-parameter language model locally and continuously by 2028, adding that "AI companies are starting to do phones." He did not name those companies, and Qualcomm has not published a complete hardware plan or commercial phone roadmap for reaching that goal. The report notes a 4-bit quantized 100B model would need roughly 50GB of memory for its weights alone, before room for the OS, apps and context cache, while flagship phones typically offer 12GB to 16GB and DRAM supply is tight and expensive. Possible workarounds include more aggressive quantization, MoE expert offloading or keeping weights in flash storage loaded on demand, each with quality or speed trade-offs; Amon said a more realistic near-term step is distilled 20B-to-30B models, with thermals and battery life still limiting always-on operation.

In-depth insight

If phones can run ever-larger models continuously on-device, they could shift from occasional cloud AI clients to always-on local inference devices, though memory cost and thermals will set the pace.

QualcommCristiano AmonSnapdragon

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.