ESM-2
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- AISI: Data Filtering Is Not Durable for Open-Weight Protein Models
The UK AI Security Institute pretrained ESM-2 protein language models after excluding viral protein sequences, finding that filtering reduced performance on viral proteins while largely preserving performance on non-viral proteins. However, fine-tuning on the withheld public sequences fully restored viral-protein performance, requiring about $80 of H100 compute even for the largest 3B-parameter model. AISI says the approach therefore needs additional measures, such as data access controls, to form a robust safeguard.
UK AI Security Institute · 🔥 0
Experience and discussion from the community
Share my ESM-2 experienceAsk about ESM-2
Nobody has shared their experience with ESM-2 yet.