Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

OpenAI bans Russian and Iranian 'false front' influence operations

AI summary

OpenAI said it recently banned two influence operations, one Russian and one Iranian, that combined its models with traditional techniques to support sophisticated “false front” entities. According to OpenAI’s report, the Iranian operation used seven “journalist” personas to pitch long-form articles to small and medium online outlets worldwide, while the Russian operation appeared to co-opt unwitting people in Latin America to run a think tank on the ground. The Decoder reported that the Russian effort, called Dark Clark, spread disinformation across Latin America and that OpenAI rated it Category 5 on the Breakout Scale because politicians reacted; it said the Iranian operation, Bogus Bylines, placed nearly 100 articles. The supplied OpenAI excerpt rated the Iranian operation’s social-media replies Category 2 and its journalist-persona work Category 4. Techmeme summarized NBC News as reporting a Russian campaign tied to the Politology network that targeted schools, media and foreign officials and received a 5/6 score; the supplied material does not establish how it relates to Dark Clark.

In-depth insight

OpenAI says the operations closely resembled pre-AI influence campaigns but used its models to make some workflows easier, including drafting internal reports and supporting false-front entities.

Over the past two and a half years, we’ve reportedonmanyofthewaysinwhichthreatactors tried to use our models to conduct cyber attacks, covert influence operations (IO), scams, and other violations of our Usage Policies. We publish these reports to inform regulators, our industry peers, and wider society of how we see threat actors trying to leverage AI, and to shine a light on the vulnerabilities they try to exploit.

We recently banned two IO—one from Russia and one from Iran—that used our models in combination with more traditional techniques and technologies to support sophisticated “false front” entities. They used those entities to launder geopolitical, conflict-related messaging into their target audiences. The Iranian operation included a stable of seven “journalist” personas which it used to pitch long-form articles to small and medium online outlets around the world; the Russian operation appears to have co-opted unwitting people in Latin America to run a “think tank” on the ground.

Both operations were multi-dimensional, trying a range of different tactics to achieve their goals. As well as long-form articles, the Iranian operation generated batches of social media comments, generally on topics related to the US-Iran war. As well as controlling the “think tank,” the Russian operation created fake “leaked” documents and audio scripts, some of which we identified being spread online. Both operations also made heavy use of AI to draft internal reports (the Russian operation did this more than anything else); in both cases, the actors used questionable or outright deceitful methodologies to exaggerate the operators’ effectiveness.

#OpenAI#ChatGPT#Dark Clark#Bogus Bylines#Social Research Center#Politology network

Original · 24 min readRead the original
Group chat

No comments yet. Start the conversation.