Struna launches open-source browser rhythm game with four local neural networks
Developer /u/MrFelliks released Struna, an MIT-licensed browser rhythm runner that turns user-supplied MP3s into playable levels using BeatNet, Basic Pitch, Spleeter, and SwiftF0. The developer says all four models run locally through ONNX Runtime Web with WebAssembly, while regular DSP handles onsets, loudness, and drops; a DSP fallback keeps the game playable when models cannot run in time. The project includes published code and a playable web demo.
Struna demonstrates a compact, browser-based application of four neural networks for real-time audio analysis without a remote inference service, though the developer's privacy and performance claims have not been independently verified.
| not an llm post exactly, but it's all local inference so i figured people here might like it i made a browser rhythm runner where the song builds the world you run through. you can throw in your own mp3s and the whole "listening" happens on your device, inside the tab. nothing gets uploaded the models, all running locally on onnxruntime-web (wasm, each in its own web worker), and what the game does with each: all four are about 22 mb together and get cached after the first load. if a device can't run them in time, the game falls back to plain dsp and still works on top of the models it's regular dsp: onsets, loudness of every bar, where the drops hit. that picks the world and the weather, and when the drop hits the world goes crazy. same song always gives the same world, so you can learn it the video is the whole of Cannibal by Pendulum & WARGASM, played by the game's own bot code (MIT): https://github.com/Felliks/Struna play it: https://struna.ai (works on phone too) english isn't my first language so i used ai to help word this post. a lot of the code was also written with ai help (claude code), not hiding that anyone else running audio models in the browser? curious what you use for beat tracking, mine still sometimes reads a fast song at half its tempo submitted by /u/MrFelliks [link] [comments] |
#Struna#BeatNet#Basic Pitch#Spleeter#SwiftF0#ONNX Runtime Web