English
Related papers

Related papers: Explain like I am BM25: Interpreting a Dense Model…

200 papers

Recently, information retrieval has seen the emergence of dense retrievers, using neural networks, as an alternative to classical sparse methods based on term-frequency. These models have obtained state-of-the-art results on datasets and…

Information Retrieval · Computer Science 2022-08-30 Gautier Izacard , Mathilde Caron , Lucas Hosseini , Sebastian Riedel , Piotr Bojanowski , Armand Joulin , Edouard Grave

Universal Multimodal Retrieval (UMR) seeks any-to-any search across text and vision, yet modern embedding models remain brittle when queries require latent reasoning (e.g., resolving underspecified references or matching compositional…

Information Retrieval · Computer Science 2026-02-10 Jianrui Zhang , Anirudh Sundara Rajan , Brandon Han , Soochahn Lee , Sukanta Ganguly , Yong Jae Lee

Generative Retrieval (GR), autoregressively decoding relevant document identifiers given a query, has been shown to perform well under the setting of small-scale corpora. By memorizing the document corpus with model parameters, GR…

Information Retrieval · Computer Science 2024-01-22 Peiwen Yuan , Xinglin Wang , Shaoxiong Feng , Boyuan Pan , Yiwei Li , Heda Wang , Xupeng Miao , Kan Li

We study the utility of the lexical translation model (IBM Model 1) for English text retrieval, in particular, its neural variants that are trained end-to-end. We use the neural Model1 as an aggregator layer applied to context-free or…

Computation and Language · Computer Science 2021-03-19 Leonid Boytsov , Zico Kolter

As an alternative to question answering methods based on feature engineering, deep learning approaches such as convolutional neural networks (CNNs) and Long Short-Term Memory Models (LSTMs) have recently been proposed for semantic matching…

Information Retrieval · Computer Science 2019-06-04 Liu Yang , Qingyao Ai , Jiafeng Guo , W. Bruce Croft

The nuclear norm minimization (NNM) is commonly used to approximate the matrix rank by shrinking all singular values equally. However, the singular values have clear physical meanings in many practical problems, and NNM may not be able to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Zhiyuan Zha , Bihan Wen , Jiachao Zhang , Jiantao Zhou , Ce Zhu

Interpretability research often adopts a neuron-centric lens, treating individual neurons as the fundamental units of explanation. However, neuron-level explanations can be undermined by superposition, where single units respond to mixtures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Julien Colin , Lore Goetschalckx , Thomas Fel , Victor Boutin , Thomas Serre , Nuria Oliver

Dense retrieval methods have shown great promise over sparse retrieval methods in a range of NLP problems. Among them, dense phrase retrieval-the most fine-grained retrieval unit-is appealing because phrases can be directly used as the…

Computation and Language · Computer Science 2021-09-17 Jinhyuk Lee , Alexander Wettig , Danqi Chen

Distributional models provide a convenient way to model semantics using dense embedding spaces derived from unsupervised learning algorithms. However, the dimensions of dense embedding spaces are not designed to resemble human semantic…

Computation and Language · Computer Science 2018-11-15 Steven Derby , Paul Miller , Brian Murphy , Barry Devereux

Learning from a real-world data stream and continuously updating the model without explicit supervision is a new challenge for NLP applications with machine learning components. In this work, we have developed an adaptive learning system…

Computation and Language · Computer Science 2018-06-22 Seid Muhie Yimam , Chris Biemann

Machine learning (ML) model explainability has received growing attention, especially in the area related to model risk and regulations. In this paper, we reviewed and compared some popular ML model explainability methodologies, especially…

Artificial Intelligence · Computer Science 2021-06-15 Shafie Gholizadeh , Nengfeng Zhou

Advances in machine reading comprehension (MRC) rely heavily on the collection of large scale human-annotated examples in the form of (question, paragraph, answer) triples. In contrast, humans are typically able to generalize with only a…

Computation and Language · Computer Science 2020-10-15 Qinyuan Ye , Xiao Huang , Elizabeth Boschee , Xiang Ren

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

In this paper, we investigate the tendency of end-to-end neural Machine Reading Comprehension (MRC) models to match shallow patterns rather than perform inference-oriented reasoning on RC benchmarks. We aim to test the ability of these…

Computation and Language · Computer Science 2018-05-11 Soumya Wadhwa , Varsha Embar , Matthias Grabmair , Eric Nyberg

Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities…

Information Retrieval · Computer Science 2026-05-04 Yiyang Wei , Tingyu Song , Siyue Zhang , Yilun Zhao

As the first step in automated natural language processing, representing words and sentences is of central importance and has attracted significant research attention. Different approaches, from the early one-hot and bag-of-words…

Computation and Language · Computer Science 2019-11-06 Wenye Li , Senyue Hao

Recently, the reasoning capabilities of large reasoning models (LRMs), such as DeepSeek-R1, have seen significant advancements through the slow thinking process. Despite these achievements, the substantial computational demands of LRMs…

Artificial Intelligence · Computer Science 2025-04-15 Chengyu Wang , Taolin Zhang , Richang Hong , Jun Huang

E-commerce recommendation and search commonly rely on sparse keyword matching (e.g., BM25), which breaks down under vocabulary mismatch when user intent has limited lexical overlap with product metadata. We cast content-based recommendation…

Machine Learning · Computer Science 2026-02-03 Mritunjay Pandey

Learned sparse text embeddings have gained popularity due to their effectiveness in top-k retrieval and inherent interpretability. Their distributional idiosyncrasies, however, have long hindered their use in real-world retrieval systems.…

Information Retrieval · Computer Science 2025-01-22 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini , Leonardo Venuta

This report presents our participation to the WSDM Cup 2026 shared task on multilingual document retrieval from English queries. The task provides a challenging benchmark for cross-lingual generalization. It also provides a natural testbed…

Information Retrieval · Computer Science 2026-02-25 Thibault Formal , Maxime Louis , Hervé Déjean , Stéphane Clinchant