Trident

Headlines · 1

1. Oct 7
   Study finds mixed-modality retrievers favour text, proposes Trident

   An arXiv paper systematically evaluates dense retrievers across architectures and finds their performance is highly sensitive to modality composition, following a pronounced V-shaped curve as image documents are progressively replaced with semantically corresponding text: strong on single-modality corpora but substantially degraded when modalities coexist. The authors call the finding "Chaos in the Text," noting that irrelevant text causes more severe degradation than an equal number of irrelevant images, because text representations receive systematically higher similarity scores and can outrank relevant images. They propose Trident, which builds text, image and fused text-image views of each document as co-equal positives and jointly optimizes relevance discrimination and positive-view balance via Multi-Positive View InfoNCE.

   Hugging Face · Papers · 🔥 0

Experience and discussion from the community

Share my Trident experienceAsk about Trident