创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

OpenAI发布CSAM分类器及ChatGPT警示

AI 总结

OpenAI发布图像分类器,为疑似儿童性虐待材料(CSAM)评分,并提供影像可能由AI生成的信号。经审核的特定机构可申请免费API接入。模型卡指出,该分类器可能产生误报和漏报,尚未针对视频帧测试;它应与哈希匹配、语境及行为滥用检测和受训人员复核结合使用,不能单独确认素材性质。OpenAI还为ChatGPT新增警示、删除被标记对话和暂停账号24小时等措施,用于处理寻找或生成儿童性化素材的请求,并发布开发者指南及儿童安全执法支持工具。

深度见解

OpenAI称,初期合作测试显示,该分类器在识别到相同数量虐待影像的情况下,标记影像数量减少了48%,可能降低审核人员的工作量。模型卡警告,OpenAI流量上的表现并不保证其他平台具有同等效果,因此部署方必须使用自身平台的代表性流量进行测试并设定适当阈值。

The classifier can produce both false-positive and false-negative errors. The following limitations should inform how results are interpreted and how the classifier is deployed.

Data

  • Generalization beyond OpenAI traffic. Our online evaluation used a sample of ChatGPT traffic. Performance and suitable operating thresholds may differ on other platforms, where content distributions, abuse patterns, and the prevalence of CSAM can be different. Results on OpenAI traffic should not be treated as a guarantee of performance on another service. Deployers should benchmark on appropriate representative traffic from their own service and select thresholds for their use case.
  • Residual overlap between datasets. Perceptual deduplication reduces overlap from duplicate or near-duplicate images but does not address all related material. CSAM can contain different images of the same children over multiple years, and we currently lack the data needed to prevent this form of overlap between training and evaluation sets. Evaluation results should therefore be interpreted in light of this remaining risk of data leakage.
  • Limited availability of evaluation data. Meaningful false-positive evaluation should include adult sexual content that is not CSAM, because this content can be visually similar to CSAM. However, there are not many academic or benchmark datasets containing adult sexual content for use in classifier creation. Additionally, filtering a dataset to remove CSAM also does not establish that every remaining image is non-CSAM.

#OpenAI#ChatGPT#OpenAI CSAM image classifier#National Center for Missing and Exploited Children#Tech Coalition#ROOST#Protect Children#Lucy Faithfull Foundation#Anthropic#Google

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。