Base Labs

Headlines · 1

1. Oct 8
   Goodfire launches inside-out monitors for AI agents

   Interpretability startup Goodfire released "inside-out" agent monitors that read a model's internal activations via probes rather than having a second AI reread every output, and they are available to Baseten customers. In Goodfire's tests on Kimi K3, monitoring about 1,500 sessions cost roughly $51, versus about $233 for a cheaper model checking every step and about $10,000 for a top-tier one; the probes caught 94% of malicious hacking sessions while flagging 8.7% of harmless ones for a second look, and running four probes added under 2% to response start time. Customers choose which risks to monitor, including offensive hacking, chemical and biological weapons misuse and reward hacking, and set the response: log, send for human review, or refuse the request.

   TechCrunch AI · 🔥 0

Experience and discussion from the community

Share my Base Labs experienceAsk about Base Labs