Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Coding agents reproduce selected functions of biological AI tools

AI summary

The UK AI Security Institute reports that its ReproBAIT evaluation enabled Claude Opus 5, GPT-5.6 Sol, Kimi K3 and Qwen3.8-2.4T to reproduce selected functions of three biological AI tools; the simplest tools were reproduced within four hours and under $20 in compute. Claude Opus 5 reached 96.5% reproduction fidelity on ProteinMPNN, while no agent fully reproduced the most complex target, RFdiffusion3. AISI says the results are not a full reproduction and presents evidence of memorization as a directional signal rather than proof.

In-depth insight

The evaluation indicates that withholding code or limiting a biological AI tool’s published methodology does not by itself prevent agents from reconstructing selected capabilities, supporting further examination of training-data governance for dual-use tools.

Biological AI tools (BAITs) are AI models that are increasingly used to drive advances across biology, from predicting protein structures to designing new molecules. Many are openly released, but some developers choose to release only partial information about a tool's methodology, architecture, and data. This can be driven by a desire to protect commercial value, but also to limit misuse of dual-use tools, where the same capabilities that advance legitimate research can also be deployed in the pursuit of harmful outcomes.

AISI's Chem-Bio team conducts cutting-edge research to understand, evaluate, and mitigate chemical and biological risks associated with frontier AI systems. We assess the extent to which advanced models may enable harmful capabilities, develop methods for evaluating these risks rigorously, and share our findings directly with leading AI companies, UK officials and allied governments to inform deployment, research and policy decisions.

As frontier LLM-based AI agents become more capable at tasks such as research, coding, and scientific reasoning, we expect their ability to reproduce BAITs to improve. If a closed-source BAIT can be reverse-engineered from limited public information, then approaches to safeguard against its misuse may be undermined.

#ReproBAIT#UK AI Security Institute#SecureBio#Claude Opus 5#GPT-5.6 Sol#Kimi K3#Qwen3.8-2.4T#ProteinMPNN#RFdiffusion3#CMD1

Original · 7 min readRead the original
Group chat

No comments yet. Start the conversation.