English
Related papers

Related papers: Streamlining Conformal Information Retrieval via S…

200 papers

Dense retrieval has shown promise in the first-stage retrieval process when trained on in-domain labeled datasets. However, previous studies have found that dense retrieval is hard to generalize to unseen domains due to its weak modeling of…

Information Retrieval · Computer Science 2023-05-19 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng

Complex information needs may involve set-compositional queries using conjunction, disjunction, and exclusion, yet it remains unclear whether current retrieval paradigms genuinely satisfy such constraints or exploit `semantic shortcuts'. We…

Computation and Language · Computer Science 2026-05-07 Vincent Degenhart , Dewi Timman , Arjen P. de Vries , Faegheh Hasibi , Mohanna Hoveyda

We introduce the \textit{Extract-Refine-Retrieve-Read} (ERRR) framework, a novel approach designed to bridge the pre-retrieval information gap in Retrieval-Augmented Generation (RAG) systems through query optimization tailored to meet the…

Computation and Language · Computer Science 2025-09-22 Youan Cong , Pritom Saha Akash , Cheng Wang , Kevin Chen-Chuan Chang

Data quality is critical for multimedia tasks, while various types of systematic flaws are found in image benchmark datasets, as discussed in recent work. In particular, the existence of the semantic gap problem leads to a many-to-many…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Fausto Giunchiglia , Xiaolei Diao , Mayukh Bagchi

Conformal prediction is a framework for predictive inference with a distribution-free, finite-sample guarantee. However, it tends to provide uninformative prediction sets when calibration data are scarce. This paper introduces…

Machine Learning · Computer Science 2025-06-17 Meshi Bashari , Roy Maor Lotan , Yonghoon Lee , Edgar Dobriban , Yaniv Romano

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this can lead to local "hill climbing" rather than more radical…

Information Retrieval · Computer Science 2023-01-31 Mehmet Deniz Türkmen , Matthew Lease , Mucahid Kutlu

Information retrieval (IR) systems traditionally aim to maximize metrics built on rankings, such as precision or NDCG. However, the non-differentiability of the ranking operation prevents direct optimization of such metrics in…

Information Retrieval · Computer Science 2021-05-04 Thibaut Thonet , Yagmur Gizem Cinar , Eric Gaussier , Minghan Li , Jean-Michel Renders

Pre-trained multimodal models have achieved significant success in retrieval-based question answering. However, current multimodal retrieval question-answering models face two main challenges. Firstly, utilizing compressed evidence features…

Artificial Intelligence · Computer Science 2023-10-17 Shuwen Yang , Anran Wu , Xingjiao Wu , Luwei Xiao , Tianlong Ma , Cheng Jin , Liang He

Legal document retrieval and judgment prediction are crucial tasks in intelligent legal systems. In practice, determining whether two documents share the same judgments is essential for establishing their relevance in legal retrieval.…

Information Retrieval · Computer Science 2024-04-16 Weicong Qin , Zelin Cao , Weijie Yu , Zihua Si , Sirui Chen , Jun Xu

Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye , Ichiro Takeuchi

Generative Retrieval (GR) is an emerging paradigm in information retrieval that leverages generative models to directly map queries to relevant document identifiers (DocIDs) without the need for traditional query processing or document…

Information Retrieval · Computer Science 2024-06-05 Tzu-Lin Kuo , Tzu-Wei Chiu , Tzung-Sheng Lin , Sheng-Yang Wu , Chao-Wei Huang , Yun-Nung Chen

Conformal prediction constructs a set of labels instead of a single point prediction, while providing a probabilistic coverage guarantee. Beyond the coverage guarantee, adaptiveness to example difficulty is an important property. It means…

Machine Learning · Computer Science 2025-11-18 Sooyong Jang , Insup Lee

Inference methods are often formulated as variational approximations: these approximations allow easy evaluation of statistics by marginalization or linear response, but these estimates can be inconsistent. We show that by introducing…

Machine Learning · Statistics 2017-04-27 Jack Raymond , Federico Ricci-Tersenghi

Information retrieval (IR) is a user approach to obtain relevant information which meets needs with the help of a IR system (IRS). However, the IRS shows certain differences between user relevance and system relevance. These gaps are…

Information Retrieval · Computer Science 2009-10-27 Azza Harbaoui , Malek Ghenima , Sahbi Sidhom

Benchmarking the performance of information retrieval (IR) is mostly conducted with a fixed set of documents (static corpora). However, in realistic scenarios, this is rarely the case and the documents to be retrieved are constantly updated…

Information Retrieval · Computer Science 2024-10-08 Chaeeun Kim , Soyoung Yoon , Hyunji Lee , Joel Jang , Sohee Yang , Minjoon Seo

Specific to Math Information Retrieval is combining text with mathematical formulae both in documents and in queries. Rigorous evaluation of query expansion and merging strategies combining math and standard textual keyword terms in a query…

Information Retrieval · Computer Science 2015-08-11 Martin Líška , Petr Sojka , Michal Růžička

Hierarchical time series are common in several applied fields. The forecasts for these time series are required to be coherent, that is, to satisfy the constraints given by the hierarchy. The most popular technique to enforce coherence is…

Machine Learning · Statistics 2023-10-13 Lorenzo Zambon , Dario Azzimonti , Giorgio Corani

This paper outlines a conceptual framework for understanding recent developments in information retrieval and natural language processing that attempts to integrate dense and sparse retrieval methods. I propose a representational approach…

Information Retrieval · Computer Science 2021-12-30 Jimmy Lin

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou