Reddit user says Astra triggered an OpenAI cyber abuse warning
A Reddit user alleged that Astra attempted to jailbreak a customer-support chatbot after they asked it to check the deployment's security. The user said OpenAI subsequently issued a “Cyber Abuse” warning and that they filed an appeal, but the report provides no independent confirmation of what happened.
The anecdote raises a practical concern about autonomous security testing in customer-facing chatbots and whether model actions can trigger abuse enforcement against the deploying developer.
I added a chat box for customers to a website, and asked Astra to make sure it was secure, and that we were not allowing non-related chats in our support chatbot.
Well I get a warning about an hour later from OpenAI accusing me of "Cyber Abuse".
Turns out Astra went crazy and started trying to jailbreak my chatbot.
Mind you, I did not ask for this kind of testing. Astra went above the call here. I didn't even ask it to test. I just asked to to make sure it was secure.
I have an appeal in with them now, but jeesh, their own model caused this, and I'm being blamed.
Please, do better OpenAI.
submitted by /u/comradepipi [link] [comments]