Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

llama2.c

AI overview

Sign in and the AI will write an overview from our coverage.

Headlines · 1

  1. llama2.c TinyStories Runs on a 2006 iPod

    Reddit user r0tlier0 reported building a Rockbox plugin that runs Karpathy's llama2.c TinyStories models on an iPod Video 5.5G. The device has an 80 MHz ARM7TDMI processor, 64 MB of RAM and no FPU, so the developer ported llama2.c's int8 inference code to integer-only mathematics with lookup tables for exponential and softmax operations. The 15M-parameter model is 17 MB and loads from the iPod's hard drive into its music buffer, although music cannot play while inference is underway.

    r/LocalLLaMA · 🔥 0

Experience and discussion from the community

Share my llama2.c experienceAsk about llama2.c

Nobody has shared their experience with llama2.c yet.