English
Related papers

Related papers: Augmenting Document Representations for Dense Retr…

200 papers

Dense retrieval has achieved impressive advances in first-stage retrieval from a large-scale document collection, which is built on bi-encoder architecture to produce single vector representation of query and document. However, a document…

Computation and Language · Computer Science 2022-03-17 Shunyu Zhang , Yaobo Liang , Ming Gong , Daxin Jiang , Nan Duan

Sparse annotation poses persistent challenges to training dense retrieval models; for example, it distorts the training signal when unlabeled relevant documents are used spuriously as negatives in contrastive learning. To alleviate this…

Information Retrieval · Computer Science 2023-10-24 George Zerveas , Navid Rekabsaz , Carsten Eickhoff

Document retrieval techniques are essential for developing large-scale information systems. The common approach involves using a bi-encoder to compute the semantic similarity between a query and documents. However, the scalar similarity…

Information Retrieval · Computer Science 2025-06-02 Haoyu Liu , Shaohan Huang , Jianfeng Liu , Yuefeng Zhan , Hao Sun , Weiwei Deng , Feng Sun , Furu Wei , Qi Zhang

Incorporating external knowledge bases in traditional retrieval-augmented generation (RAG) relies on parsing the document, followed by querying a language model with the parsed information via in-context learning. While effective for…

Computation and Language · Computer Science 2026-02-03 Jacob Si , Mike Qu , Michelle Lee , Marek Rei , Yingzhen Li

We present a novel deep neural model for text detection in document images. For robust text detection in noisy scanned documents, the advantages of multi-task learning are adopted by adding an auxiliary task of text enhancement. Namely, our…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Eun-Soo Jung , HyeongGwan Son , Kyusam Oh , Yongkeun Yun , Soonhwan Kwon , Min Soo Kim

Dense retrieval conducts text retrieval in the embedding space and has shown many advantages compared to sparse retrieval. Existing dense retrievers optimize representations of queries and documents with contrastive training and map them to…

Information Retrieval · Computer Science 2021-07-19 Yizhi Li , Zhenghao Liu , Chenyan Xiong , Zhiyuan Liu

Dense retrieval is a crucial task in Information Retrieval (IR), serving as the basis for downstream tasks such as re-ranking and augmenting generation. Recently, large language models (LLMs) have demonstrated impressive semantic…

Information Retrieval · Computer Science 2025-08-20 Hengran Zhang , Keping Bi , Jiafeng Guo , Xiaojie Sun , Shihao Liu , Daiting Shi , Dawei Yin , Xueqi Cheng

Document set expansion aims to identify relevant documents from a large collection based on a small set of documents that are on a fine-grained topic. Previous work shows that PU learning is a promising method for this task. However, some…

Machine Learning · Computer Science 2024-01-23 Haiyang Zhang , Qiuyi Chen , Yuanjie Zou , Yushan Pan , Jia Wang , Mark Stevenson

Universal Multimodal Retrieval (UMR) seeks any-to-any search across text and vision, yet modern embedding models remain brittle when queries require latent reasoning (e.g., resolving underspecified references or matching compositional…

Information Retrieval · Computer Science 2026-02-10 Jianrui Zhang , Anirudh Sundara Rajan , Brandon Han , Soochahn Lee , Sukanta Ganguly , Yong Jae Lee

Neural networks with deep architectures have demonstrated significant performance improvements in computer vision, speech recognition, and natural language processing. The challenges in information retrieval (IR), however, are different…

Information Retrieval · Computer Science 2021-03-23 Bhaskar Mitra

While retrieval techniques are widely used in practice, they still face significant challenges in cross-domain scenarios. Recently, generation-augmented methods have emerged as a promising solution to this problem. These methods enhance raw…

Computation and Language · Computer Science 2025-02-18 Chaofan Li , Zheng Liu , Jianlyv Chen , Defu Lian , Yingxia Shao

Document expansion is a classical technique for improving retrieval quality, and is attractive since it shifts computation offline, avoiding additional query-time processing. However, when applied to modern retrievers, it has been shown to…

Computation and Language · Computer Science 2026-04-08 Omri Uzan , Ron Polonsky , Douwe Kiela , Christopher Potts

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Recent advance in Dense Retrieval (DR) techniques has significantly improved the effectiveness of first-stage retrieval. Trained with large-scale supervised data, DR models can encode queries and documents into a low-dimensional dense space…

Information Retrieval · Computer Science 2022-08-18 Jingtao Zhan , Qingyao Ai , Yiqun Liu , Jiaxin Mao , Xiaohui Xie , Min Zhang , Shaoping Ma

Dense retrieval systems increasingly need to handle complex queries. In many realistic settings, users express intent through long instructions or task-specific descriptions, while target documents remain relatively simple and static. This…

Information Retrieval · Computer Science 2026-04-07 Seiji Maekawa , Moin Aminnaseri , Pouya Pezeshkpour , Estevam Hruschka

Image captioning models often suffer from performance degradation when applied to novel datasets, as they are typically trained on domain-specific data. To enhance generalization in out-of-domain scenarios, retrieval-augmented approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hao Wu , Zhihang Zhong , Xiao Sun

It is challenging to train a robust object detector under the supervised learning setting when the annotated data are scarce. Thus, previous approaches tackling this problem are in two categories: semi-supervised learning models that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Guanghan Ning , Guang Chen , Chaowei Tan , Si Luo , Liefeng Bo , Heng Huang

Dense neural text retrieval has achieved promising results on open-domain Question Answering (QA), where latent representations of questions and passages are exploited for maximum inner product search in the retrieval process. However,…

Information Retrieval · Computer Science 2021-11-01 Ye Liu , Kazuma Hashimoto , Yingbo Zhou , Semih Yavuz , Caiming Xiong , Philip S. Yu

Named entity recognition (NER) models often struggle with noisy inputs, such as those with spelling mistakes or errors generated by Optical Character Recognition processes, and learning a robust NER model is challenging. Existing robust NER…

Computation and Language · Computer Science 2024-07-29 Chaoyi Ai , Yong Jiang , Shen Huang , Pengjun Xie , Kewei Tu

Learning recipe and food image representation in common embedding space is non-trivial but crucial for cross-modal recipe retrieval. In this paper, we propose a new perspective for this problem by utilizing foundation models for data…

Information Retrieval · Computer Science 2024-07-18 Fangzhou Song , Bin Zhu , Yanbin Hao , Shuo Wang