Claude生成的DOS模型可装入软盘
AI 总结
Reddit开发者称,Fable 5.2编写了一个DOS语言模型的Transformer,Opus 5.5则生成了约3500条事实以及闲聊和数学训练数据。该模型据称有37.3万个参数,采用8位整数权重,连同程序共约435 KB,可在DOS内存中运行并装入软盘。开发者表示,它对见过的词汇和事实表现尚可,但面对复杂或过长的提示时会输出无意义内容。
深度见解
这则报告展示了一个由Claude模型协助构建和训练、且可在Intel Pentium上的DOS环境中运行的小型语言模型,但目前没有独立基准结果加以验证。
| I let Fable 5.2 write its own transformer. Opus 5.5 generated the training data: about 3500 facts (and small talk + math), each asked and answered in different ways. It has 367K parameters and runs on an Intel Pentium. The weights are stored as 8bit integers with one scale per row, so the program and weights together come to about 435 KB and fit in DOS memory and on a floppy. It reads and writes one letter at a time. It does pretty well on words and facts it has seen, but if I ask something complex or too long, it spits out utter nonsense. Edit: https://github.com/WollyMonjac/Tiny-2.1 submitted by /u/wollymonjac [link] [comments] |