ExtractBench

Headlines · 1

1. Oct 15
   LlamaIndex releases ExtractBench Pro for document extraction's long tail

   LlamaIndex has released ExtractBench Pro, an extension of the ExtractBench benchmark it launched two months earlier, built to cover long-tail customer documents and schemas the original 370-document set never covered. All 100 documents are synthesized by deterministic pipelines from seeds and configs, and are split into six challenges: document conventions, house vocabulary, house counting rules, drawn relations, charts inside documents and long chart sheets. LlamaIndex says it tested twelve systems — four extraction APIs, five coding agents and its three LlamaExtract tiers — and added a metric for the proportion of documents with perfect 100% Value F1; the results are vendor-run with no independent replication supplied.

   LlamaIndex Blog · 🔥 0

Experience and discussion from the community

Share my ExtractBench experienceAsk about ExtractBench