English
Related papers

Related papers: Reliable Evaluation Protocol for Low-Precision Ret…

200 papers

Large Language Model (LLM) agents can increasingly automate complex reasoning through Test-Time Scaling (TTS), iterative refinement guided by reward signals. However, many real-world tasks involve multi-stage pipeline whose final outcomes…

Machine Learning · Computer Science 2025-12-30 Shuyu Gan , James Mooney , Pan Hao , Renxiang Wang , Mingyi Hong , Qianwen Wang , Dongyeop Kang

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

Query performance prediction (QPP) aims to estimate the retrieval quality of a search system for a query without human relevance judgments. Previous QPP methods typically return a single scalar value and do not require the predicted values…

Information Retrieval · Computer Science 2025-05-27 Chuan Meng , Negar Arabzadeh , Arian Askari , Mohammad Aliannejadi , Maarten de Rijke

Hard Thresholding Pursuit (HTP) is an iterative greedy selection procedure for finding sparse solutions of underdetermined linear systems. This method has been shown to have strong theoretical guarantee and impressive numerical performance.…

Machine Learning · Computer Science 2013-11-26 Xiao-Tong Yuan , Ping Li , Tong Zhang

Recent large language models (LLMs) achieve near-saturation accuracy on many established mathematical reasoning benchmarks, raising concerns about their ability to diagnose genuine reasoning competence. This saturation largely stems from…

Modern neural networks have greatly improved performance across speech recognition benchmarks. However, gains are often driven by frequent words with limited semantic weight, which can obscure meaningful differences in word error rate, the…

Computation and Language · Computer Science 2026-04-21 Lasse Borgholt , Jakob Havtorn , Christian Igel , Lars Maaløe , Zheng-Hua Tan

High Recall Retrieval (HRR), such as eDiscovery and medical systematic review, is a search problem that optimizes the cost of retrieving most relevant documents in a given collection. Iterative approaches, such as iterative relevance…

Information Retrieval · Computer Science 2024-05-08 Eugene Yang

Hard thresholding pursuit (HTP) is a recently proposed iterative sparse recovery algorithm which is a result of combination of a support selection step from iterated hard thresholding (IHT) and an estimation step from the orthogonal…

Information Theory · Computer Science 2020-06-03 Samrat Mukhopadhyay , Mrityunjoy Chakraborty

In recent years, the dominant accuracy metric for vector search is the recall of a result list of fixed size (top-k retrieval), considering as ground truth the exact vector retrieval results. Although convenient to compute, this metric is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Gergely Szilvasy , Pierre-Emmanuel Mazaré , Matthijs Douze

Large Language Models (LLMs) are prone to hallucination, especially during multi-hop and reasoning-intensive tasks such as mathematical problem solving. While Outcome Reward Models verify only final answers, Process Reward Models (PRMs)…

Computation and Language · Computer Science 2025-05-27 Tej Deep Pala , Panshul Sharma , Amir Zadeh , Chuan Li , Soujanya Poria

We study how to utilize (possibly erroneous) predictions in a model for computing under uncertainty in which an algorithm can query unknown data. Our aim is to minimize the number of queries needed to solve the minimum spanning tree…

Data Structures and Algorithms · Computer Science 2022-07-01 Thomas Erlebach , Murilo Santos de Lima , Nicole Megow , Jens Schlöter

Should we trust Large Language Models (LLMs) with high accuracy? LLMs achieve high accuracy on reasoning benchmarks, but correctness alone does not reveal the quality of the reasoning used to produce it. This highlights a fundamental…

Computation and Language · Computer Science 2026-04-15 Manas Pathak , Xingyao Chen , Shuozhe Li , Amy Zhang , Liu Leqi

Machine Reading at Scale (MRS) is a challenging task in which a system is given an input query and is asked to produce a precise output by "reading" information from a large knowledge base. The task has gained popularity with its natural…

Computation and Language · Computer Science 2019-09-19 Yixin Nie , Songhe Wang , Mohit Bansal

Objective: Medical relations are the core components of medical knowledge graphs that are needed for healthcare artificial intelligence. However, the requirement of expert annotation by conventional algorithm development processes creates a…

Machine Learning · Computer Science 2020-09-09 Yucong Lin , Keming Lu , Yulin Chen , Chuan Hong , Sheng Yu

Typical retrieval systems have three requirements: a) Accurate retrieval i.e., the method should have high precision, b) Diverse retrieval, i.e., the obtained set of points should be diverse, c) Retrieval time should be small. However, most…

Information Retrieval · Computer Science 2020-08-25 Vidyadhar Rao , Prateek Jain , C. V Jawahar

Pairwise comparison methods, such as Fuzzy Preference Relations and Saaty's Multiplicative Preference Relations, are widely used to model expert judgments in multi-criteria decision-making. However, their application is limited by the high…

Artificial Intelligence · Computer Science 2025-10-10 Diego García-Zamora , Álvaro Labella , José Rui Figueira

Advanced relevance models, such as those that use large language models (LLMs), provide highly accurate relevance estimations. However, their computational costs make them infeasible for processing large document corpora. To address this,…

Information Retrieval · Computer Science 2025-05-08 Mandeep Rathee , V Venktesh , Sean MacAvaney , Avishek Anand

In the competitive landscape of sponsored search, balancing retrieval quality with production latency is a critical challenge. While large retrieval models based on Small Language Models (SLMs) such as Qwen3-Embedding-4B/8B set strong upper…

Information Retrieval · Computer Science 2026-05-25 Vipul Gupta , Shikhar Mohan , Lakshya Kumar , Pranjal Chitale , Nikit Begwani , Amit Singh , Manik Varma

Robust optimization provides a principled and unified framework to model many problems in modern operations research and computer science applications, such as risk measures minimization and adversarially robust machine learning. To use a…

Optimization and Control · Mathematics 2024-10-04 Hao Hao , Peter Zhang

The text retrieval is the task of retrieving similar documents to a search query, and it is important to improve retrieval accuracy while maintaining a certain level of retrieval speed. Existing studies have reported accuracy improvements…

Information Retrieval · Computer Science 2023-11-15 Yuichi Sasazawa , Kenichi Yokote , Osamu Imaichi , Yasuhiro Sogawa