CMNIE
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- NUDT releases CMNIE, a joint-annotated Chinese military-news IE benchmark
According to a Juejin AI report citing the National University of Defense Technology, CMNIE contains 13,000 instances of Chinese military news jointly annotated under a single schema covering 7 event types, 10 argument roles, 7 entity types and 8 relations, with batches accepted only after four quality metrics all reach 95%. The benchmark compares supervised information-extraction models, zero-shot LLMs and fine-tuned LLMs on the same test set: zero-shot LLMs generally locate the relevant semantic units but lose substantial accuracy on exact span boundaries, while schema-conditioned fine-tuned generation performs best on relation extraction and explicit span models stay competitive on precise argument extraction. The report also cautions that the 13,000 instances are moderate in size, sufficient for fine-tuning but not for training from scratch, and that the military domain limits how far the schema and conclusions generalize.
掘金 · 人工智能 · 🔥 0
Experience and discussion from the community
Share my CMNIE experienceAsk about CMNIE
Nobody has shared their experience with CMNIE yet.