开发者发布3.8亿参数本地AI低质文本检测器
AI 总结
开发者推出 voi-slop-detect-380M,这是一种基于 UltraBERT 的分类器,可为文本的 AI“低质内容”特征打分。项目提供基于 ONNX、WebGPU/WASM 的浏览器演示和公开训练数据,并附有与 Pangram、GPTZero、Originality 的自测比较。开发者同时表示正在训练 4B 和 27B 版本,但承认其在部分重写文本、旧模型、诗歌和非英语文本上表现较弱。
深度见解
该项目提供了一种在本地评估 AI 生成文本的小型隐私友好工具,但其基准结果均为开发者自述,面对部分域外重写内容时效果明显下降。
| I've fine-tuned an UltraBERT-380M classifier to score how much your text feels like AI slop. Demo: https://voightkampfflabs.github.io/slop-detector-demo/ (runs fully in browser via ONNX + WebGPU/WASM) Why? Got tired guessing if I'm reading human or slop on twitter/linkedin/reddit, so trained my own AI detector. Like Pangram, but local - so all your perverted texts stay on your device. Because I can (and because I bought 2x 5090 when they were cheap). Training As it was made for learning purposes, I made my own dataset based on the Pangram v4 recipe: The target label is how many words/ngrams were changed by the LLM. So it's not a yes/no, but more like a slopification rate guessing. My personal texts land around 0.1-0.2. Trained with HF Transformers on 2x RTX 5090. Considering the model size and hardware, the whole training run is ~3h. Training data is public: https://huggingface.co/datasets/VoightKampffLabs/slop-detect-dataset-v6 Results Not as good as Pangram (yet), but as good as GPTZero and Originality on most things I could compare. HF model card has more details and more benchmarks. Where it's bad I'd rather tell you upfront: So what I'm currently training bigger 4B/27B brothers of this one. Yes they're much smarter, but good luck running them via WebGPU/WASM on device. And yes, the end goal is to have a browser extension which marks AI slop on reddit completely on device. PS. the text above scores ~0.1 in the detector (to save you a click). submitted by /u/InvadersMustLive [link] [comments] |
#voi-slop-detect-380M#UltraBERT-380M#ONNX#WebGPU#WASM#Pangram#GPTZero#Originality#EditLens#EpochAI