TokenPilot

Headlines · 1

1. Oct 20
   METASTONE launches TokenFleet inference cluster scheduling framework

   At the 2026 CCF National High Performance Computing conference, METASTONE (是石科技) released TokenFleet, a distributed scheduling framework focused on request routing, cross-datacenter capacity coordination and mixed-workload governance. The framework combines TokenPilot for instance selection, FleetMind for cross-datacenter capacity coordination and SLOMax for admission, queue governance and capacity allocation by service tier. METASTONE says that on its GLM5.3 tuning data, under the tested GPU cluster and workload, predictive-latency routing cut P95 time-to-first-token by 32.4% and P50 by 71.3%, while an SLOMax example estimated about 29.4% higher goodput; the report notes these are vendor measurements and that lower latency does not directly mean lower cost.

   量子位（原生 RSS） · 🔥 0

Experience and discussion from the community

Share my TokenPilot experienceAsk about TokenPilot