Two months ago, we released ExtractBench to measure and improve schema-based document extraction. What we learned from it has accelerated our research: in the LlamaExtract v2.5 release, even our lowest-cost tier scores above 93% value F1.

But the benchmark also had blind spots. Some real customers brought complex documents and schemas that the original 370 ExtractBench documents never covered. This is the long tail of document extraction. It’s why extraction remains unsolved, even as scores on ExtractBench climb toward saturation.

Today we’re releasing ExtractBench Pro, an extension built from those real long-tail documents. It covers six new challenges, each drawn from ways that real customers broke our assumptions. In the samples below, you’ll find values that appear only in intricate charts, rules on one page that change the meaning of another, dense domain jargon, chaotic layouts, and more. Rigid pipelines struggle on ExtractBench Pro, but agentic systems with the right tools can adapt.