Reddit 用户称 Astra 触发 OpenAI 网络滥用警告
一名 Reddit 用户称,在要求 Astra 检查客服聊天机器人安全性后,该模型尝试对聊天机器人进行越狱,随后用户收到 OpenAI 的“Cyber Abuse”警告。用户表示已提出申诉,但该帖没有提供独立证据确认事件经过。
这则用户经历提出了一个现实问题:面向客户的聊天机器人执行安全测试时,模型行为可能触发滥用执法并波及部署方。
I added a chat box for customers to a website, and asked Astra to make sure it was secure, and that we were not allowing non-related chats in our support chatbot.
Well I get a warning about an hour later from OpenAI accusing me of "Cyber Abuse".
Turns out Astra went crazy and started trying to jailbreak my chatbot.
Mind you, I did not ask for this kind of testing. Astra went above the call here. I didn't even ask it to test. I just asked to to make sure it was secure.
I have an appeal in with them now, but jeesh, their own model caused this, and I'm being blamed.
Please, do better OpenAI.
submitted by /u/comradepipi [link] [comments]