MiniCPM-V 4.7 35a3

Headlines · 1

1. Oct 20
   Developer introduces source-available RK3588 NPU inference runtime

   Developer happyme531 introduced open_rknpu2_lm_infer, a local LLM inference engine for the Rockchip RK3588 NPU that runs without Rockchip's proprietary userspace inference libraries. Its host code is written in Rust and its NPU operators in C++. The project supports Qwen3.5-4B image input, optional MTP speculative decoding, an OpenAI-compatible API, streaming, tool calling and prefix caching. In a developer-published comparison, the engine with MTP1 recorded 10.61 tokens per second for decoding after 512 tokens, compared with 5.54 tokens per second for RKLLM 1.3.1. The report does not specify the test board, RAM configuration or driver versions and invites comparisons across boards and configurations.

   r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my MiniCPM-V 4.7 35a3 experienceAsk about MiniCPM-V 4.7 35a3