English
Related papers

Related papers: Declarative Experimentation in Information Retriev…

200 papers

Conversational search provides a natural interface for information retrieval (IR). Recent approaches have demonstrated promising results in applying dense retrieval to conversational IR. However, training dense retrievers requires large…

Computation and Language · Computer Science 2023-09-14 Chao-Wei Huang , Chen-Yu Hsu , Tsu-Yuan Hsu , Chen-An Li , Yun-Nung Chen

Document spanners have been proposed as a formal framework for declarative Information Extraction (IE) from text, following IE products from the industry and academia. Over the past decade, the framework has been studied thoroughly in terms…

Databases · Computer Science 2024-09-05 Dean Light , Ahmad Aiashy , Mahmoud Diab , Daniel Nachmias , Stijn Vansummeren , Benny Kimelfeld

Recent work has shown that directly fine-tuning large language models (LLMs) for dense retrieval yields strong performance, but their substantial parameter counts make them computationally inefficient. While prior studies have revealed…

Information Retrieval · Computer Science 2025-12-24 Yibin Lei , Shwai He , Ang Li , Andrew Yates

Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to robustly represent…

Information Retrieval · Computer Science 2024-04-23 Kelong Mao , Chenlong Deng , Haonan Chen , Fengran Mo , Zheng Liu , Tetsuya Sakai , Zhicheng Dou

Information retrieval is a core component of many intelligent systems as it enables conditioning of outputs on new and large-scale datasets. While effective, the standard practice of encoding data into high-dimensional representations for…

Information Retrieval · Computer Science 2026-02-16 Shubham Gupta , Zichao Li , Tianyi Chen , Cem Subakan , Siva Reddy , Perouz Taslakian , Valentina Zantedeschi

Motivated by algorithmic information theory, the problem of program discovery can help find candidates of underlying generative mechanisms of natural and artificial phenomena. The uncomputability of such inverse problem, however,…

Information Theory · Computer Science 2021-12-29 Vladimir Lemusa , Eduardo Acuña , Víctor Zamora , Francisco Hernandez-Quiroz , Hector Zenil

Recent research has shown that transformer networks can be used as differentiable search indexes by representing each document as a sequences of document ID tokens. These generative retrieval models cast the retrieval problem to a document…

Information Retrieval · Computer Science 2023-11-16 Hansi Zeng , Chen Luo , Bowen Jin , Sheikh Muhammad Sarwar , Tianxin Wei , Hamed Zamani

We present PyTorch Frame, a PyTorch-based framework for deep learning over multi-modal tabular data. PyTorch Frame makes tabular deep learning easy by providing a PyTorch-based data structure to handle complex tabular data, introducing a…

Machine Learning · Computer Science 2024-12-17 Weihua Hu , Yiwen Yuan , Zecheng Zhang , Akihiro Nitta , Kaidi Cao , Vid Kocijan , Jinu Sunil , Jure Leskovec , Matthias Fey

The longitudinal evaluation of retrieval systems aims to capture how information needs and documents evolve over time. However, classical Cranfield-style retrieval evaluations only consist of a static set of queries and documents and…

Information Retrieval · Computer Science 2025-09-23 Jüri Keller , Maik Fröbe , Gijs Hendriksen , Daria Alexander , Martin Potthast , Philipp Schaer

We propose methods to infer properties of the execution environment of machine learning pipelines by tracing characteristic numerical deviations in observable outputs. Results from a series of proof-of-concept experiments obtained on local…

Machine Learning · Computer Science 2021-02-19 Alexander Schlögl , Tobias Kupek , Rainer Böhme

Effective information retrieval requires reasoning over partial evidence and refining strategies as information emerges. Yet current approaches fall short: neural retrievers lack reasoning capabilities, large language models (LLMs) provide…

Artificial Intelligence · Computer Science 2025-11-12 Supriti Vijay , Aman Priyanshu , Anu Vellore , Baturay Saglam , Amin Karbasi

The rapidly growing size of deep neural network (DNN) models and datasets has given rise to a variety of distribution strategies such as data, tensor-model, pipeline parallelism, and hybrid combinations thereof. Each of these strategies…

Machine Learning · Computer Science 2021-11-11 Keshav Santhanam , Siddharth Krishna , Ryota Tomioka , Tim Harris , Matei Zaharia

Information retrieval (IR) systems need to constantly update their knowledge as target objects and user queries change over time. Due to the power-law nature of linguistic data, learning lexical concepts is a problem resisting standard…

Artificial Intelligence · Computer Science 2019-11-01 Jacopo Tagliabue , Reuben Cohn-Gordon

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

We propose a novel approach to interactive theorem-proving (ITP) using deep reinforcement learning. The proposed framework is able to learn proof search strategies as well as tactic and arguments prediction in an end-to-end manner. We…

Machine Learning · Computer Science 2021-06-18 Minchao Wu , Michael Norrish , Christian Walder , Amir Dezfouli

Cross-modal retrieval is an important functionality in modern search engines, as it increases the user experience by allowing queries and retrieved objects to pertain to different modalities. In this paper, we focus on the image-sentence…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Nicola Messina , Giuseppe Amato , Fabrizio Falchi , Claudio Gennaro , Stéphane Marchand-Maillet

To extract answers from a large corpus, open-domain question answering (QA) systems usually rely on information retrieval (IR) techniques to narrow the search space. Standard inverted index methods such as TF-IDF are commonly used as thanks…

Computation and Language · Computer Science 2021-02-22 Wenhan Xiong , Hong Wang , William Yang Wang

Over the last few years, contextualized pre-trained transformer models such as BERT have provided substantial improvements on information retrieval tasks. Recent approaches based on pre-trained transformer models such as BERT, fine-tune…

Information Retrieval · Computer Science 2021-09-23 Negar Arabzadeh , Xinyi Yan , Charles L. A. Clarke

Recent developments in representational learning for information retrieval can be organized in a conceptual framework that establishes two pairs of contrasts: sparse vs. dense representations and unsupervised vs. learned representations.…

Information Retrieval · Computer Science 2021-06-29 Jimmy Lin , Xueguang Ma

Document retrieval has greatly benefited from the advancements of large-scale pre-trained language models (PLMs). However, their effectiveness is often limited in theme-specific applications for specialized areas or industries, due to…

Information Retrieval · Computer Science 2024-03-08 SeongKu Kang , Shivam Agarwal , Bowen Jin , Dongha Lee , Hwanjo Yu , Jiawei Han