SpeakLeash and ACC Cyfronet AGH release Bielik-11B-v3.1-Instruct
AI summary
SpeakLeash and ACC Cyfronet AGH announced Bielik-11B-v3.1-Instruct, an 11-billion-parameter generative text model under the Apache 2.0 license. The developers say it was trained on corpora covering 56 languages, with emphasis on European languages and Polish, using 500 billion pretraining tokens, 26 million supervised fine-tuning samples, and modified GRPO reinforcement learning across 14 environments. A chat interface is available, while no independent evaluation is provided in the report.
In-depth insight
The release adds a multilingual instruction model focused on Polish and other European languages, with post-training designed for instruction following, tool use, and reasoning.
| https://huggingface.co/speakleash/Bielik-11B-v3.1-Instruct-GGUF https://www.bielik.ai/blog/premiera-modeli-bielik-11b-v31-dflash-i-rodziny-bielik-one (decision models and dflash are coming next) Bielik-11B-v3.1-Instruct Bielik-11B-v3.1-Instruct is a generative text model featuring 11 billion parameters. It is an update to the Bielik 11B v3 line that expands multilingual continual pre-training and strengthens post-training for instruction following, tool use, and reasoning. Forementioned model stands as a testament to the unique collaboration between the open-science/open-source project SpeakLeash and the High Performance Computing (HPC) center: ACC Cyfronet AGH. Developed and trained on multilingual text corpora covering 56 languages, with an emphasis on European languages and Polish, which have been cherry-picked and processed by the SpeakLeash team, this endeavor leverages Polish large-scale computing infrastructure of the ACC Cyfronet AGH HPC center. The creation and training of Bielik-11B-v3.1-Instruct was propelled by resources provided within the PLGrid environment under computational grant number [PLG/2026/019559], conducted on the Athena and Helios supercomputers, and within the Gaia AI Factory, funded by the European Union through the EuroHPC Joint Undertaking. As a result, the model exhibits an exceptional ability to understand and process the Polish language and other European languages, providing accurate responses and performing a variety of linguistic tasks with high precision. 🗣️ Chat: https://chat.bielik.ai/ Model The model was trained on carefully curated, high-quality datasets that underwent extensive cleaning and rigorous quality assessment to ensure data consistency, reliability, and relevance. The training pipeline consisted of three stages: pretraining on 500B tokens, SFT on 26M samples, and RL (modified GRPO) across 14 diverse environments. This multi-stage training approach was designed to enhance the model's language understanding, instruction-following capabilities, and ability to perform effectively across a broad range of tasks. Bielik instruct models have been trained with the use of an original open source framework called ALLaMo implemented by Krzysztof Ociepa. Model description: submitted by /u/jacek2023 [link] [comments] |
#Bielik-11B-v3.1-Instruct#SpeakLeash#ACC Cyfronet AGH#ALLaMo#PLGrid