Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

SupraLabs releases 65M-parameter Supra2.5 Base and Instruct models

AI summary

SupraLabs announced the Supra2.5-65M Base and Instruct model family, with the models available on Hugging Face. The company says it trained the model for four days on two RTX A6000 GPUs using 100 billion tokens of high-quality data, with F16, Q8_0, and Q4_K_M GGUF files available for llama.cpp, Ollama, and Unsloth. SupraLabs claims the 65M-parameter model outperforms its earlier 50M- and 100M-parameter models, but the supplied report includes no independent benchmark verification.

In-depth insight

The release provides a downloadable 65M-parameter base and instruction-tuned option for local use across several lightweight inference tools, alongside detailed training and quantization information.

https://preview.redd.it/s6afqz7og02i1.png?width=2607&format=png&auto=webp&s=8ad68f90e67c06f989e152ac5cffefc93eed60e1 hey guys! It's Supra-time! 🤗 🔥 🎉 It has been quite quite at SupraLabs' model foundry for a long time but we have been testing, training, developing and much more. And we can finally present you a new model! Key facts: - better than our previous 50M and 100M model - very small, runs on every toaster: 65M params - base model and instruction tuned version on HF We trained it locally in 4 days on 2x RTX A6000 on big 100B tokens of high-quality data. Benchmarks are in the attached image! Have fun to try it out, give us feedback, roast us, whatever! Community, we will cook! Supra3 coming early next year! 🔥 Give us a like, upvote or follow if you want - and try out our model. We can't wait to hear what you're building with it. Link to the collection on HF: https://huggingface.co/collections/SupraLabs/supra25 We hope you like the model! :D GGUFs in F16, Q8_0 and Q4_K_M are also available for llama.cpp, Ollama, Unsloth, etc. 🥳 submitted by /u/LH-Tech_AI [link] [comments]

#SupraLabs#Supra2.5-65M Base#Supra2.5-65M Instruct#Hugging Face#llama.cpp#Ollama#Unsloth#RTX A6000

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.