Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Self-Replay Fine-Tuning

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. ModelBuilder says optimized MiniCPM-V 4.7 35B-A3B exceeds 30 tokens/s on phones

    At a ModelBuilder (面壁智能) on-device multimodal model event, co-chief scientist Yao Yuan said a newly optimized MiniCPM-V 4.7 35B-A3B can exceed 30 tokens/s on phones while using about 3GB of memory, with almost no accuracy loss. Zhidx measured about 25 tokens/s while testing the model on an iPhone Duo, below the vendor's figure. Earlier team data showed speeds above 13 tokens/s on an iPhone 17 Pro Max and above 17 tokens/s on an iPad Pro M4 16GB. ModelBuilder released and open-sourced the MiniCPM-V 4.7 series on October 13, including 35B-A3B and 1B versions. Its Lookahead Expert Scheduling (LES) predicts which experts the next layer will need and loads their weights from flash storage while the current layer computes. The company says LES preserves model output and increased generation speed by about fivefold on an iPad Pro M4 16GB.

    智东西 · 🔥 4

Experience and discussion from the community

Share my Self-Replay Fine-Tuning experienceAsk about Self-Replay Fine-Tuning

Nobody has shared their experience with Self-Replay Fine-Tuning yet.