SupraLabs 发布 Supra2.5-65M 系列
AI 总结
SupraLabs 宣布推出 Supra2.5-65M Base 和 Instruct 模型,相关模型已在 Hugging Face 上架。公司称,该模型使用两块 RTX A6000 训练四天,训练数据规模为 1000 亿 token,并提供适用于 llama.cpp、Ollama 和 Unsloth 的 F16、Q8_0 与 Q4_K_M GGUF 文件。SupraLabs 声称该模型优于此前 5000 万和 1 亿参数版本,但现有报告没有提供独立基准验证。
深度见解
这次发布为本地运行提供了一款具备基座和指令微调版本的小型模型,并公开了训练规模与量化格式,方便相关用户直接下载测试。
| https://preview.redd.it/s6afqz7og02i1.png?width=2607&format=png&auto=webp&s=8ad68f90e67c06f989e152ac5cffefc93eed60e1 hey guys! It's Supra-time! 🤗 🔥 🎉 It has been quite quite at SupraLabs' model foundry for a long time but we have been testing, training, developing and much more. And we can finally present you a new model! Key facts: - better than our previous 50M and 100M model - very small, runs on every toaster: 65M params - base model and instruction tuned version on HF We trained it locally in 4 days on 2x RTX A6000 on big 100B tokens of high-quality data. Benchmarks are in the attached image! Have fun to try it out, give us feedback, roast us, whatever! Community, we will cook! Supra3 coming early next year! 🔥 Give us a like, upvote or follow if you want - and try out our model. We can't wait to hear what you're building with it. Link to the collection on HF: https://huggingface.co/collections/SupraLabs/supra25 We hope you like the model! :D GGUFs in F16, Q8_0 and Q4_K_M are also available for llama.cpp, Ollama, Unsloth, etc. 🥳 submitted by /u/LH-Tech_AI [link] [comments] |
#SupraLabs#Supra2.5-65M Base#Supra2.5-65M Instruct#Hugging Face#llama.cpp#Ollama#Unsloth#RTX A6000