创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Edge0开源145B与120B端侧模型

AI 总结

Edge0开源了Edge0-145B和Edge0-120B模型,并提供统一推理框架与部署工具。Edge0称Edge0-145B采用稀疏架构,拥有1450亿总参数、约100亿激活参数,可在兼容的笔记本上本地运行,峰值内存为29GB,解码速度超过80 tokens/s。一篇 commentary 报告介绍了对本地3D建模、游戏制作和PPT工作流的实测,并指出对标评测采用了Edge0公布的结果。

深度见解

此次发布开放了模型权重和本地部署工具栈,为编码、推理和智能体工作流提供可评估、微调和集成的本地方案,并可减少对云端推理、部分API费用和网络的依赖,同时让数据留在电脑上。不过,该方案需要合适的硬件,厂商披露的性能与对标评测尚未得到独立验证。

Today, we're open-sourcing Edge0-145B and Edge0-120B, together with our unified inference framework and deployment tools. Edge0-145B is the world's first open-source on-device AI model with 145 billion parameters. It brings coding, reasoning, and agent capabilities that rival frontier cloud models to your own computer.

On-device AI has long forced a tradeoff between model capability and what the hardware can run. Larger models demand more memory, bandwidth, and power; smaller models can struggle with complex work. Moving that work to the cloud adds model-provider fees, data-handling constraints, and a dependence on connectivity.

This release addresses those constraints in four ways:

The constraintWhat Edge0-145B makes possible
Large models are difficult to run on personal hardware.A 145B model runs locally on a compatible laptop, with reported peak memory of 29GB and decoding above 80 tokens/s.
Small on-device models can fall short on demanding tasks.Coding, reasoning, and instruction-following results are competitive with specific frontier cloud models, as the comparisons below show.
A useful assistant needs to finish work, not just answer questions.The model plans, writes and runs code, debugs errors, and checks results visually for projects such as 3D scenes, games, hardware programs, and PCB designs.
Cloud workflows bring recurring fees, sensitive-data restrictions, and network dependence.Local inference incurs no corresponding cloud-model token or API fees; data can stay on the computer, and core capabilities keep working offline. Hardware and electricity still cost money.

#Edge0#Edge0-145B#Edge0-120B#Edge0 App

原文约 16 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。