llama2.c
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- llama2.c TinyStories Runs on a 2006 iPod
Reddit user r0tlier0 reported building a Rockbox plugin that runs Karpathy's llama2.c TinyStories models on an iPod Video 5.5G. The device has an 80 MHz ARM7TDMI processor, 64 MB of RAM and no FPU, so the developer ported llama2.c's int8 inference code to integer-only mathematics with lookup tables for exponential and softmax operations. The 15M-parameter model is 17 MB and loads from the iPod's hard drive into its music buffer, although music cannot play while inference is underway.
r/LocalLLaMA · 🔥 0
Experience and discussion from the community
Share my llama2.c experienceAsk about llama2.c
Nobody has shared their experience with llama2.c yet.