Hugging Face Releases FineDNA for DNA-Focused Language Models
AI summary
Hugging Face announced FineDNA, the dataset used to adapt Qwen3-14B into the DNA-focused Carbon-X model. The release includes more than 300 billion tokens of genomic and DNA-rich text for midtraining, about 200,000 supervised fine-tuning conversations, and roughly 98,000 verifiable reinforcement-learning prompts. The associated code and training recipe are also open for use with other language models.
In-depth insight
FineDNA packages midtraining, supervised fine-tuning, and reinforcement-learning data at substantial scale into an openly available resource for DNA-related language-model development.
| Hi everyone, we're releasing FineDNA, all the data we used to turn Qwen3-14B into Carbon-X, the strongest open language model on DNA. It contains: Code and recipe are open too, so you can apply it to other LLMs. Dataset: https://huggingface.co/datasets/HuggingFaceBio/FineDNA Code: https://github.com/huggingface/carbon submitted by /u/loubnabnl [link] [comments] |