FishSnapper Brings Offline Fish Identification to iPhone
AI summary
A developer reports releasing FishSnapper, an iPhone app for real-time fish identification during scuba diving and snorkelling. It runs entirely offline with a fine-tuned YOLO v9 model for animal detection and a fine-tuned BioCLIP model for classification, using mostly iNaturalist data plus developer-labelled examples. The developer says Claude and Codex assisted with dataset assembly, labelling interfaces, cloud training and iOS iteration, but the app's accuracy has not been independently measured.
In-depth insight
FishSnapper is a concrete example of AI coding and model-tuning tools supporting an end-to-end offline mobile vision application, although its reported identification accuracy remains unverified.
| I recently made a real time fish identification app for scuba diving and snorkelling with the help of Claude and Codex! The app works completely offline using on-device models that I fine tuned, since reception doesn’t travel underwater. It’s called FishSnapper and is available on iPhone. I had vibe coded a lot of stuff before, but this was my first time vibe training ML models. FishSnapper uses a pipeline of two models: a fine-tune of YOLO v9 for animal detection, and a fine-tune of BioCLIP 2.5 huge, which is a visual transformer, for classification. The data is largely from iNaturalist and includes some data I labelled for this project. Something like this would’ve taken me way more time without AI coding tools. I could focus on research and user experience, and offloaded most of the operational work to Claude and Codex: assembling datasets, building data labelling UIs, renting GPUs, training models in the cloud, iterating on the iOS app, and more. I initially had low expectations, but was quite surprised at how accurate it was. I wouldn’t bet on it getting the answer right every time, but it’s been reliable enough to make it easy to confirm and has already taught me a bunch of new species. submitted by /u/yayimahuman123 [link] [comments] |