English
Related papers

Related papers: ECLIPSE: Contrastive Dimension Importance Estimati…

200 papers

This paper revisits cluster-based retrieval that partitions the inverted index into multiple groups and skips the index partially at cluster and document levels during online inference using a learned sparse representation. It proposes an…

Information Retrieval · Computer Science 2024-04-16 Yifan Qiao , Shanxiu He , Yingrui Yang , Parker Carlson , Tao Yang

Access to diverse perspectives is essential for understanding real-world events, yet most news retrieval systems prioritize textual relevance, leading to redundant results and limited viewpoint exposure. We propose NEWSCOPE, a two-stage…

Computation and Language · Computer Science 2025-09-01 Yixuan Tang , Yuanyuan Shi , Yiqun Sun , Anthony Kum Hoe Tung

Traditional information retrieval is based on sparse bag-of-words vector representations of documents and queries. More recent deep-learning approaches have used dense embeddings learned using a transformer-based large language model. We…

Information Retrieval · Computer Science 2024-01-09 Priyanka Mandikal , Raymond Mooney

Dense retrieval compresses texts into single embeddings ranked by cosine similarity. While efficient for recall, this interface is brittle for identity-level matching: minimal compositional edits (negation, role swaps) flip meaning yet…

Information Retrieval · Computer Science 2026-04-21 Radoslav Ralev , Aditeya Baral , Iliya Zhechev , Jen Agarwal , Srijith Rajamohan

The identification of relevance with little textual context is a primary challenge in passage retrieval. We address this problem with a representation-based ranking approach that: (1) explicitly models the importance of each term using a…

Information Retrieval · Computer Science 2020-05-22 Sean MacAvaney , Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto , Nazli Goharian , Ophir Frieder

In open-domain Question Answering (QA), dense retrieval is crucial for finding relevant passages for answer generation. Typically, contrastive learning is used to train a retrieval model that maps passages and queries to the same semantic…

Computation and Language · Computer Science 2024-01-17 Shiqi Wang , Yeqin Zhang , Cam-Tu Nguyen

Explaining why dense retrievers assign high relevance scores remains challenging because retrieval decisions are made through opaque high-dimensional embeddings. Existing explanations often focus on surface signals, such as lexical matches,…

Artificial Intelligence · Computer Science 2026-05-29 Zhixin Cai , Jun Bai , Yang Liu , Jiaqi Li , Yichi Zhang , Taichuan Li , Zhuofan Chen , Zixia Jia , Zilong Zheng , Wenge Rong

Classical multidimensional scaling is an important dimension reduction technique. Yet few theoretical results characterizing its statistical performance exist. This paper provides a theoretical framework for analyzing the quality of…

Statistics Theory · Mathematics 2020-07-09 Anna Little , Yuying Xie , Qiang Sun

This paper introduces a new approach to patch-based image restoration based on external datasets and importance sampling. The Minimum Mean Squared Error (MMSE) estimate of the image patches, the computation of which requires solving a…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Milad Niknejad , Jose M. Bioucas-Dias , Mario A. T. Figueiredo

Neural networks with deep architectures have demonstrated significant performance improvements in computer vision, speech recognition, and natural language processing. The challenges in information retrieval (IR), however, are different…

Information Retrieval · Computer Science 2021-03-23 Bhaskar Mitra

While dense retrieval models, which embed queries and documents into a shared low-dimensional space, have gained widespread popularity, they were shown to exhibit important theoretical limitations and considerably lag behind traditional…

Information Retrieval · Computer Science 2026-04-09 Adrian Bracher , Svitlana Vakulenko

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existing pipelines often…

Information Retrieval · Computer Science 2025-11-25 Roksana Goworek , Olivia Macmillan-Scott , Eda B. Özyiğit

Research has been devoted in the past few years to relevance feedback as an effective solution to improve performance of information retrieval systems. Relevance feedback refers to an interactive process that helps to improve the retrieval…

Information Retrieval · Computer Science 2012-09-12 Reza Tavoli , Fariborz Mahmoudi

The main aspects of XML retrieval are identified by analysing and comparing the following two behaviours: the behaviour of the assessor when judging the relevance of returned document components; and the behaviour of users when interacting…

Information Retrieval · Computer Science 2019-05-01 Jovan Pehcevski , James A. Thom , Anne-Marie Vercoustre

Phrase-level dense retrieval has shown many appealing characteristics in downstream NLP tasks by leveraging the fine-grained information that phrases offer. In our work, we propose a new task formulation of dense retrieval, cross-lingual…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Deng Cai , Zhi Qu , Qu Cui , Hidetaka Kamigaito , Lemao Liu , Taro Watanabe

Many image retrieval studies use metric learning to train an image encoder. However, metric learning cannot handle differences in users' preferences, and requires data to train an image encoder. To overcome these limitations, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Ryoya Nara , Yu-Chieh Lin , Yuji Nozawa , Youyang Ng , Goh Itoh , Osamu Torii , Yusuke Matsui

Clustering algorithms are used extensively in data analysis for data exploration and discovery. Technological advancements lead to continually growth of data in terms of volume, dimensionality and complexity. This provides great…

Machine Learning · Computer Science 2024-02-20 Miles McCrory , Spencer A. Thomas

Multimodal representations that enable cross-modal retrieval are widely used. However, these often lack interpretability making it difficult to explain the retrieved results. Solutions such as learning sparse disentangled representations…

Information Retrieval · Computer Science 2025-06-25 Prachi J , Sumit Bhatia , Srikanta Bedathur

Building effective dense retrieval systems remains difficult when relevance supervision is not available. Recent work has looked to overcome this challenge by using a Large Language Model (LLM) to generate hypothetical documents that can be…

Information Retrieval · Computer Science 2024-10-29 Nour Jedidi , Yung-Sung Chuang , Leslie Shing , James Glass

Retrieval module can be plugged into many downstream NLP tasks to improve their performance, such as open-domain question answering and retrieval-augmented generation. The key to a retrieval system is to calculate relevance scores to query…

Computation and Language · Computer Science 2024-10-22 Lu Dai , Hao Liu , Hui Xiong