LFM3-Omni-2B亮相WebGPU浏览器演示
AI 总结
Reddit用户/u/xenovatech称，LFM3-Omni-2B已可通过WebGPU完全在浏览器本地运行，并链接了可供查看的Hugging Face演示。帖子称，自定义WebGPU内核在Apple M4 Max上可达到约每秒280个token，首token和首音频延迟分别为90毫秒和140毫秒，但这些性能数据尚未得到验证。
深度见解
据帖子介绍，这一演示可让2B模型在浏览器本地处理视觉、音频和文本输入，无需单独使用ASR或TTS模型。
| The first true omni model that can run 100% locally in a browser... fully end-to-end, with no separate ASR or TTS models needed. With custom WebGPU kernels, we're able to run LFM3-Omni-2B at ~280 tok/s on an M4 Max, accepting visual, audio, or text and producing interleaved text and audio tokens. Just 90 ms to the first token and 140 ms to the first audio. Link to the demo: https://huggingface.co/spaces/LiquidAI/LFM3-Omni-2B-WebGPU submitted by /u/xenovatech [link] [comments] |