创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

BULaMU推出低资源语言微型模型

AI 总结

BULaMU 创作者 mwebazarick 发布了包含 20M、47M 和 110M 参数版本的模型,均为卢干达语从头训练。创作者称,扩展后的语料库达 400 亿 token,涵盖斯瓦希里语、老挝语、阿姆哈拉语、索马里语、卢旺达语和英语,东非语言占比接近 90%;其中 47M 模型经过微调,可生成跨语言故事。相关模型已发布至 Hugging Face,但手机离线运行且无需 GPU 或网络连接的说法尚未得到验证。

深度见解

这些可下载的微型模型为在有限硬件上探索低资源语言和代码切换生成提供了实践路径,但目前尚无独立性能评估。

Hi Everybody, I am just writing to share some progress I have made on my project. I am the creator of BULaMU, a family of language models (20M, 47M, 110M) trained completely from scratch for a low resource language: Luganda. The models are small and compute-efficient enough to run offline on a phone without requiring a GPU or internet connection. Over the last few months, I increased the corpus ten fold (to 40 billion tokens) by including text from 5 other East African Languages (Swahili, Lao, Amharic, Somali, Kinyaranda) and English. East African Languages make up nearly 90% of the new training corpus. I trained a 47M parameter model on this corpus and then fine-tuned it to be able to generate responses (stories) between the different languages. I have attached a link below if you would like to try a demo of it. I also made the models available on Huggingface if you would like to experiment with them on your own. Demo: https://tinyafricanstories.streamlit.app/ Base Model: https://huggingface.co/mwebazarick/BULaMU-3-42M-Base Fine-tuned ("Story-telling") model: https://huggingface.co/mwebazarick/BULaMU-3-42M-Story submitted by /u/AgencyInside407 [link] [comments]

#BULaMU-3#BULaMU-3-42M-Base#BULaMU-3-42M-Story#Hugging Face

原文约 1 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。