创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

OpenAI披露GPT-Image-2.6安全体系

AI 总结

OpenAI Deployment Safety发布ChatGPT Images 2.6系统卡,说明GPT-Image-2.6 Sunburst采用的多层图像安全防护。该体系在生成前使用基于LLM的策略检查,以安全多模态模型审查文本和图像输入,并在展示前拦截违反政策的输出。OpenAI还加入了同步CSAM分类,并扩大线上与线下监控。

深度见解

系统卡具体披露了OpenAI在图像生成产品中组合生成前拒答、多模态输入拦截与最终输出审核的机制。

GPT-Image-2.6 Sunburst includes multiple layers of image-specific safety protection. Upstream, LLM-based policy checks are designed to block potentially violative image requests before image generation begins. Downstream, we use safety-focused image classifiers designed to block potentially violative input images from being fed into the final generation, combined analysis of input images and prompts to evaluate potential malicious edits, and a final step where we analyze whether the generated image violates our policies before we show the image to the user.

Below we explain each of these safety layers in a bit more detail:

  • Upstream Refusals: Before a request is sent to the image generation model, we run LLM-based policy checks to evaluate whether the request violates policy. Requests deemed to violate policy are refused at this stage.
  • Downstream Blocking: After a request reaches the image generation system, we use a safety reasoning model as a monitor to moderate both image inputs to the image generation model and the generated output. This model is a safety-focused multimodal model trained to reason about prompt intent and content policies.
  • Input blocking: The monitor checks all text and image input provided to the image generation tool. If the monitor determines that any input violates policy, generation is blocked.
  • Output blocking: The monitor also checks the final output image before it is shown to the user. If the monitor determines that the output image violates policy, it is blocked.

#OpenAI#GPT-Image-2.6 Sunburst#ChatGPT Images 2.6

原文约 2 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。