Struna开源浏览器节奏游戏发布
AI 总结
开发者/u/MrFelliks发布了采用MIT许可的浏览器节奏跑酷游戏Struna,可利用BeatNet、Basic Pitch、Spleeter和SwiftF0将用户提供的MP3转化为关卡。开发者称四个模型均通过ONNX Runtime Web和WebAssembly在本地运行,并由常规DSP处理起音、响度和drop;设备性能不足时仍可回退到DSP继续游戏。项目已公开源代码并提供网页试玩。
深度见解
Struna展示了四个神经网络在浏览器内实时分析音频且不依赖远程推理服务的应用方式,但开发者提出的隐私和性能声明尚无独立验证。
| not an llm post exactly, but it's all local inference so i figured people here might like it i made a browser rhythm runner where the song builds the world you run through. you can throw in your own mp3s and the whole "listening" happens on your device, inside the tab. nothing gets uploaded the models, all running locally on onnxruntime-web (wasm, each in its own web worker), and what the game does with each: all four are about 22 mb together and get cached after the first load. if a device can't run them in time, the game falls back to plain dsp and still works on top of the models it's regular dsp: onsets, loudness of every bar, where the drops hit. that picks the world and the weather, and when the drop hits the world goes crazy. same song always gives the same world, so you can learn it the video is the whole of Cannibal by Pendulum & WARGASM, played by the game's own bot code (MIT): https://github.com/Felliks/Struna play it: https://struna.ai (works on phone too) english isn't my first language so i used ai to help word this post. a lot of the code was also written with ai help (claude code), not hiding that anyone else running audio models in the browser? curious what you use for beat tracking, mine still sometimes reads a fast song at half its tempo submitted by /u/MrFelliks [link] [comments] |
#Struna#BeatNet#Basic Pitch#Spleeter#SwiftF0#ONNX Runtime Web