English
Related papers

Related papers: DocRetriever: A Plug-and-Play Framework for Multim…

200 papers

Comprehending long visual documents, where information is distributed across extensive pages of text and visual elements, is a critical but challenging task for modern Vision-Language Models (VLMs). Existing approaches falter on a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Dawei Zhu , Rui Meng , Jiefeng Chen , Sujian Li , Tomas Pfister , Jinsung Yoon

In the real world, where information is abundant and diverse across different modalities, understanding and utilizing various data types to improve retrieval systems is a key focus of research. Multimodal composite retrieval integrates…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Suyan Li , Fuxiang Huang , Lei Zhang

Current medical retrieval benchmarks primarily emphasize lexical or shallow semantic similarity, overlooking the reasoning-intensive demands that are central to clinical decision-making. In practice, physicians often retrieve authoritative…

Information Retrieval · Computer Science 2026-04-07 Xiangxu Zhang , Lei Li , Xiao Zhou , Zheng Liu

Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedical tasks but still challenging due to the deficiency of sufficient publicly annotated biomedical data and computational resources. We…

Computation and Language · Computer Science 2024-10-07 Ran Xu , Wenqi Shi , Yue Yu , Yuchen Zhuang , Yanqiao Zhu , May D. Wang , Joyce C. Ho , Chao Zhang , Carl Yang

Recent progress in deep learning has continuously improved the accuracy of dialogue response selection. In particular, sophisticated neural network architectures are leveraged to capture the rich interactions between dialogue context and…

Computation and Language · Computer Science 2022-04-26 Tian Lan , Deng Cai , Yan Wang , Yixuan Su , Heyan Huang , Xian-Ling Mao

Code search has usually been evaluated as first-stage retrieval, even though production systems rely on broader pipelines with reranking and developer-style queries. Existing benchmarks also suffer from data contamination, label noise, and…

Software Engineering · Computer Science 2026-05-11 Siqiao Xue , Zihan Liao , Jin Qin , Ziyin Zhang , Yixiang Mu , Fan Zhou , Hang Yu

Sparse document representations have been widely used to retrieve relevant documents via exact lexical matching. Owing to the pre-computed inverted index, it supports fast ad-hoc search but incurs the vocabulary mismatch problem. Although…

Information Retrieval · Computer Science 2023-10-06 Eunseong Choi , Sunkyung Lee , Minjin Choi , Hyeseon Ko , Young-In Song , Jongwuk Lee

In any ranking system, the retrieval model outputs a single score for a document based on its belief on how relevant it is to a given search query. While retrieval models have continued to improve with the introduction of increasingly…

Information Retrieval · Computer Science 2021-05-12 Daniel Cohen , Bhaskar Mitra , Oleg Lesota , Navid Rekabsaz , Carsten Eickhoff

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing the capabilities of large language models. However, existing RAG evaluation predominantly focuses on text retrieval and relies on opaque, end-to-end…

Information Retrieval · Computer Science 2025-05-19 Chuan Xu , Qiaosheng Chen , Yutong Feng , Gong Cheng

Knowledge-intensive tasks, particularly open-domain question answering (ODQA), document reranking, and retrieval-augmented language modeling, require a balance between retrieval accuracy and generative flexibility. Traditional retrieval…

Computation and Language · Computer Science 2025-02-28 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Mohammed Ali , Adam Jatowt

Multimodal large language models (MLLMs) achieve strong performance on benchmarks that evaluate text, image, or video understanding separately. However, these settings do not assess a critical real-world requirement, which involves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Dannong Xu , Zhongyu Yang , Jun Chen , Yingfang Yuan , Ming Hu , Lei Sun , Luc Van Gool , Danda Pani Paudel , Chun-Mei Feng

Evaluating whether Multimodal Large Language Models can produce trustworthy, verifiable reasoning over long, visually rich documents requires evaluation beyond end-to-end answer accuracy. We introduce DocScope, a benchmark that formulates…

Computation and Language · Computer Science 2026-05-15 Xiang Feng , Jiawei Zhou , Zhangfeng Huang , Kewei Wang , Shanshan Ye , Jinxin Hu , Zulong Chen , Yong Luo , Jing Zhang

This study introduces De-DSI, a novel framework that fuses large language models (LLMs) with genuine decentralization for information retrieval, particularly employing the differentiable search index (DSI) concept in a decentralized…

Information Retrieval · Computer Science 2024-04-22 Petru Neague , Marcel Gregoriadis , Johan Pouwelse

Dense retrieval systems increasingly need to handle complex queries. In many realistic settings, users express intent through long instructions or task-specific descriptions, while target documents remain relatively simple and static. This…

Information Retrieval · Computer Science 2026-04-07 Seiji Maekawa , Moin Aminnaseri , Pouya Pezeshkpour , Estevam Hruschka

Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-driven, relying…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Dongyang Chen , Chaoyang Wang , Dezhao Su , Xi Xiao , Zeyu Zhang , Jing Xiong , Qing Li , Yuzhang Shang , Shichao Kan

Multi-modal retrieval becomes increasingly popular in practice. However, the existing retrievers are mostly text-oriented, which lack the capability to process visual information. Despite the presence of vision-language models like CLIP,…

Information Retrieval · Computer Science 2024-06-07 Junjie Zhou , Zheng Liu , Shitao Xiao , Bo Zhao , Yongping Xiong

As queries in retrieval-augmented generation (RAG) pipelines powered by large language models (LLMs) become increasingly complex and diverse, dense retrieval models have demonstrated strong performance in semantic matching. Nevertheless,…

Information Retrieval · Computer Science 2025-09-30 Shaoxiong Zhan , Hai Lin , Hongming Tan , Xiaodong Cai , Hai-Tao Zheng , Xin Su , Zifei Shan , Ruitong Liu , Hong-Gee Kim

Visual-language models (VLMs) excel at data mappings, but real-world document heterogeneity and unstructuredness disrupt the consistency of cross-modal embeddings. Recent late-interaction methods enhance image-text alignment through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Weiqing Li , Jinyue Guo , Yaqi Wang , Haiyang Xiao , Yuewei Zhang , Guohua Liu , Hao Henry Wang

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Lanyun Zhu , Deyi Ji , Tianrun Chen , Haiyang Wu , Shiqi Wang

Scientific document retrieval is a critical task for enabling knowledge discovery and supporting research across diverse domains. However, existing dense retrieval methods often struggle to capture fine-grained scientific concepts in texts…

Information Retrieval · Computer Science 2026-01-27 Wonbin Kweon , Runchu Tian , SeongKu Kang , Pengcheng Jiang , Zhiyong Lu , Jiawei Han , Hwanjo Yu