Reddit developer reports offline LFM3-Omni-2B on iPhone
AI summary
A Reddit developer reported running LFM3-Omni-2B fully offline on an iPhone 18 Pro Max at approximately 80 tokens per second. According to the post, the implementation used custom WebGPU kernels in a React Native app.
| submitted by /u/xenovatech [link] [comments] |