OpenAI Tightens ChatGPT Weapons Rules for Teens, Adds Automatic Talk Bans
OpenAI announced on October 30 that it will restrict what ChatGPT tells users under 18 about weapons and security systems that could be misused for violence, even when the question appears harmless. The company also said ChatGPT may automatically end conversations that repeatedly focus on violence or signal intent to seriously harm others, with possible temporary account suspensions and parental notification for teen accounts. New restrictions also limit details on weapons, acquisition methods and casualty-scale comparisons when reconstructing past mass attacks, and the changes will roll out over several weeks.
The policy tightens platform-level safeguards for minors at a time when OpenAI is under legal and public scrutiny over youth safety, including lawsuits and criticism from Common Sense Media over how teen ChatGPT handles suicide or self-harm conversations.
OpenAI 美國時間 10 月 30 日宣布，將收緊 ChatGPT 提供青少年武器相關資訊，即使提問看似無害，系統也會限制回答。這是 OpenAI 防範 AI 工具遭濫用、引發現實暴力的連串新措施之一，數週內會陸續上線。
OpenAI表示，ChatGPT原本就禁止協助使用者從事暴力行為，也不會協助青少年取得武器。新規定更進一步：18歲以下使用者，即使對話沒有任何暴力意圖跡象，ChatGPT也會限制提供可能遭濫用暴力行為的武器與保全系統實用資訊。但青少年仍可尋求ChatGPT預防或化解衝突的協助、取得支援，或與可信任的成年人聯絡。