Software Mansion

Headlines · 1

1. 2d
   Private Mind adds offline LFM3 inference on iOS and Android

   The developer of the open-source Private Mind app reports that it now runs LFM3 models fully offline on iOS and Android, including the LFM3-VL-2B vision model. They also published ExecuTorch exports for LFM3 and reported iPhone 16 Pro results of about 40 tokens per second for 4-bit LFM3-1.7B, versus about 20 tokens per second for LFM3-VL-2B after an approximately nine-second first-token delay. The exports use MLX for Apple GPUs and XNNPACK for mobile CPUs, with reported model sizes of 1.07 GB and 1.17 GB respectively.

   r/LocalLLaMA · 🔥 2

Experience and discussion from the community

Share my Software Mansion experienceAsk about Software Mansion