Reddit用户称ChatGPT网页端可直接理解音频
AI 总结
一名Reddit用户称，ChatGPT网页端在未运行代码的情况下，正确识别了上传测试音为持续的高频电子音。该用户还称，ChatGPT使用Python和soundfile分析了一段上传的俄语emo-rap歌曲，全程未使用Whisper或ASR，并较准确地描述了副歌、乐器、结构和歌词主题。用户无法通过API或Codex复现音频输入，网页端工具也曾返回不支持音频的消息。
深度见解
这一报告显示ChatGPT网页端可能具备实际的上传音频分析能力，但其内部处理路径尚未得到验证，而且API与Codex似乎无法使用该能力。
| Been poking at this for a few days and wondering if anyone else noticed. First I uploaded a generated beep (test-2.wav, literally nothing else in it) and told it to describe it without python or any code. It said steady high-pitched electronic tone, like a test signal, no voices. Correct, and no code ran at all. Then a Russian emo-rap track, heavy autotune, 808s, renamed to shfm.mp3 so the filename gives nothing away. It opened python, read the first 26 seconds with soundfile and just did display(Audio(chunk)). No whisper, no ASR, nothing else in that cell. After that it got the hook pretty much right and described the song correctly: instruments, structure, what the lyrics are about. The parts it got wrong were exactly the parts I can't make out myself either, which is not what you'd expect if it just remembered the song. On another track it even replayed a chunk at 0.9x speed, like it was trying to catch a fast verse, and ended up with around 70% of the words right. The weird part: the model itself doesn't support audio input. Through the API it just doesn't take audio, and in Codex I couldn't get it to listen to anything. Even in the web version the tool once returned "you do not support audio" to it mid conversation. So whatever does the listening lives only in the ChatGPT web harness. The help page for the new audio uploads mentions "audio understanding and transcription" and says it depends on the selected model, but nothing about how it actually works. Anyone know what's going on under the hood? Is there a separate audio model handing the main one a description, or some audio path the API doesn't expose? Has anyone gotten anything similar working through the API or Codex? And if you've tested it on music, how good is it for you? (model: gpt-6, Extra High) submitted by /u/Possible_Statement84 [link] [comments] |