MiniCPM-V 4.7 1B
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ModelBuilder says optimized MiniCPM-V 4.7 35B-A3B exceeds 30 tokens/s on phones
At a ModelBuilder (面壁智能) on-device multimodal model event, co-chief scientist Yao Yuan said a newly optimized MiniCPM-V 4.7 35B-A3B can exceed 30 tokens/s on phones while using about 3GB of memory, with almost no accuracy loss. Zhidx measured about 25 tokens/s while testing the model on an iPhone Duo, below the vendor's figure. Earlier team data showed speeds above 13 tokens/s on an iPhone 17 Pro Max and above 17 tokens/s on an iPad Pro M4 16GB. ModelBuilder released and open-sourced the MiniCPM-V 4.7 series on October 13, including 35B-A3B and 1B versions. Its Lookahead Expert Scheduling (LES) predicts which experts the next layer will need and loads their weights from flash storage while the current layer computes. The company says LES preserves model output and increased generation speed by about fivefold on an iPad Pro M4 16GB.
智东西 · 🔥 4
Experience and discussion from the community
Share my MiniCPM-V 4.7 1B experienceAsk about MiniCPM-V 4.7 1B
Nobody has shared their experience with MiniCPM-V 4.7 1B yet.