Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

LangSmith adds AI Search to find agent traces by described behavior

AI summary

LangChain introduced AI Search in LangSmith, letting users describe a behavior in plain language — such as whether the user got frustrated or PII leaked — and get back the sessions where it happened. Per LangChain, structured filters narrow the candidates first, then a fast decision model reads each normalized "trajectory" and streams matches as they are found; SmithDB, the vendor's database built for trace data, builds those trajectories on arrival and normalizes formats from the OpenAI and Anthropic SDKs, LangChain, LangGraph, the Vercel AI SDK and OpenTelemetry, while removing repeated conversation history to cut context bloat. AI Search is in public beta on LangSmith Cloud in the GCP US, EU and APAC regions at no additional cost, and org admins must enable it in settings.

In-depth insight

LangChain says questions like whether PII leaked or a user got frustrated cannot be answered by tags, metadata or full-text search, which is why it built model-based search over trace contents.

Observability & Evals

Search agent traces by behavior with AI Search in LangSmith

Arjun Natarajan

#LangSmith#LangChain#SmithDB#AI Search#Open SWE

Original · 7 min readRead the original
Group chat

No comments yet. Start the conversation.