Edge0开源145B与120B端侧模型
Edge0开源了Edge0-145B和Edge0-120B模型,并提供统一推理框架与部署工具。Edge0称Edge0-145B采用稀疏架构,拥有1450亿总参数、约100亿激活参数,可在兼容的笔记本上本地运行,峰值内存为29GB,解码速度超过80 tokens/s。一篇 commentary 报告介绍了对本地3D建模、游戏制作和PPT工作流的实测,并指出对标评测采用了Edge0公布的结果。
此次发布开放了模型权重和本地部署工具栈,为编码、推理和智能体工作流提供可评估、微调和集成的本地方案,并可减少对云端推理、部分API费用和网络的依赖,同时让数据留在电脑上。不过,该方案需要合适的硬件,厂商披露的性能与对标评测尚未得到独立验证。
Today, we're open-sourcing Edge0-145B and Edge0-120B, together with our unified inference framework and deployment tools. Edge0-145B is the world's first open-source on-device AI model with 145 billion parameters. It brings coding, reasoning, and agent capabilities that rival frontier cloud models to your own computer.
On-device AI has long forced a tradeoff between model capability and what the hardware can run. Larger models demand more memory, bandwidth, and power; smaller models can struggle with complex work. Moving that work to the cloud adds model-provider fees, data-handling constraints, and a dependence on connectivity.
This release addresses those constraints in four ways:
| The constraint | What Edge0-145B makes possible |
|---|---|
| Large models are difficult to run on personal hardware. | A 145B model runs locally on a compatible laptop, with reported peak memory of 29GB and decoding above 80 tokens/s. |
| Small on-device models can fall short on demanding tasks. | Coding, reasoning, and instruction-following results are competitive with specific frontier cloud models, as the comparisons below show. |
| A useful assistant needs to finish work, not just answer questions. | The model plans, writes and runs code, debugs errors, and checks results visually for projects such as 3D scenes, games, hardware programs, and PCB designs. |
| Cloud workflows bring recurring fees, sensitive-data restrictions, and network dependence. | Local inference incurs no corresponding cloud-model token or API fees; data can stay on the computer, and core capabilities keep working offline. Hardware and electricity still cost money. |