LangSmith LLM Gateway

Headlines · 1

1. Oct 13
   LangChain adds ScaleDown context middleware for long-running agents

   LangChain's blog introduced the langchain-scaledown integration and said ScaleDown's constrained decoding models are now a direct model provider in the LangSmith LLM Gateway. The package ships with three middlewares for summarizing old history, compressing large tool results and extracting structured data, covering ScaleDown's four single-task models: Summarize, Compress, Extract and Classify. LangChain says each model accepts up to 1M tokens of input and that some handle images and scanned PDFs; ScaleDown's own benchmarks claim large speed and cost advantages over frontier models on narrow tasks, without independent verification in the post.

   LangChain Blog · 🔥 0

Experience and discussion from the community

Share my LangSmith LLM Gateway experienceAsk about LangSmith LLM Gateway