Ruisizhilian
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- ModelSphere open-source platform targets production-grade AI deployment
On October 16, Paradigm Intelligence (范式智能) and Beijing Ruisizhilian Technology (睿思智联) announced ModelSphere (模域), a one-stop production-grade AI deployment platform that is free and open source for enterprise users under Apache 2.0 and is already available on GitHub. The platform combines compute management, model deployment and runtime optimization in one workflow, offering a graphical console, preset deployments, automatic elastic scaling, prefill-decode disaggregation, three-tier KV caching, high-availability load balancing and automatic service-resumption after stream interruptions, plus AutoTune scheduling intended to speed up first-token response. The vendors claim about 285% higher peak throughput and roughly 4x performance versus a baseline, figures that are company-stated and not independently verified; the platform bundles the EngineX inference engine to schedule heterogeneous Chinese accelerators from Huawei Ascend, Iluvatar CoreX, Moore Threads and Hygon DCU, and says it has optimized support for models such as DeepSeek-V4/V4-Flash, Qwen, Kimi, MiniMax and GLM.
InfoQ 中文 AI&大模型 · 🔥 8
Experience and discussion from the community
Share my Ruisizhilian experienceAsk about Ruisizhilian
Nobody has shared their experience with Ruisizhilian yet.