English
Related papers

Related papers: Reliable Evaluation Protocol for Low-Precision Ret…

200 papers

Traditional pairwise sequence alignment is based on matching individual samples from two sequences, under time monotonicity constraints. However, in many application settings matching subsequences (segments) instead of individual samples…

Databases · Computer Science 2016-09-28 Shahriar Shariat , Vladimir Pavlovic

Efficiently reranking documents retrieved from information retrieval (IR) pipelines to enhance overall quality of Retrieval-Augmented Generation (RAG) system remains an important yet challenging problem. Recent studies have highlighted the…

Computation and Language · Computer Science 2025-11-12 Jingyu Wu , Aditya Shrivastava , Jing Zhu , Alfy Samuel , Anoop Kumar , Daben Liu

We present an algorithm to perform trust-region-based optimization for nonlinear unconstrained problems. The method selectively uses function and gradient evaluations at different floating-point precisions to reduce the overall energy…

Optimization and Control · Mathematics 2022-02-18 Richard J Clancy , Matt Menickelly , Jan Hückelheim , Paul Hovland , Prani Nalluri , Rebecca Gjini

In this paper, we introduce a computational framework for recovering a high-resolution approximation of an unknown function from its low-resolution indirect measurements as well as high-resolution training observations by merging the…

Statistics Theory · Mathematics 2021-10-15 Milana Gataric

Text retrieval plays a crucial role in incorporating factual knowledge for decision making into language processing pipelines, ranging from chat-based web search to question answering systems. Current state-of-the-art text retrieval models…

Computation and Language · Computer Science 2024-11-26 Ge Gao , Jonathan D. Chang , Claire Cardie , Kianté Brantley , Thorsten Joachim

Requirements traceability is an essential step in ensuring the quality of software during the early stages of its development life cycle. Requirements tracing usually consists of document parsing, candidate link generation and evaluation…

Software Engineering · Computer Science 2015-06-30 Najla Al-Saati , Raghda Abdul-Jaleel

Most real-world datasets, and particularly those collected from physical systems, are full of noise, packet loss, and other imperfections. However, most specification mining, anomaly detection and other such algorithms assume, or even…

Machine Learning · Computer Science 2019-04-12 Ilia Sucholutsky , Apurva Narayan , Matthias Schonlau , Sebastian Fischmeister

Existing losses used in deep metric learning (DML) for image retrieval often lead to highly non-uniform intra-class and inter-class representation structures across test classes and data distributions. When combined with the common practice…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Qin Zhang , Linghan Xu , Qingming Tang , Jun Fang , Ying Nian Wu , Joe Tighe , Yifan Xing

Candidate retrieval is a fundamental issue in recommendation system. Given user's recommendation request, relevant candidates need to be retrieved in realtime for subsequent ranking operations. Considering that the retrieval operation is…

Information Retrieval · Computer Science 2019-10-22 Zheng Liu , Yu Xing , Jianxun Lian , Defu Lian , Ziyao Li , Xing Xie

This study introduces the "Grade Score", a novel metric designed to evaluate the consistency and fairness of Large Language Models (LLMs) when used as multiple-choice judges with respect to order bias and choice consistency. The Grade Score…

Artificial Intelligence · Computer Science 2024-06-24 Dmitri Iourovitski

In reinforcement learning, Reverse Experience Replay (RER) is a recently proposed algorithm that attains better sample complexity than the classic experience replay method. RER requires the learning algorithm to update the parameters…

Machine Learning · Computer Science 2024-09-02 Nan Jiang , Jinzhao Li , Yexiang Xue

Large language models (LLMs) are increasingly used as judges to replace costly human preference labels in pairwise evaluation. Despite their practicality, LLM judges remain prone to miscalibration and systematic biases. This paper proposes…

Computation and Language · Computer Science 2026-02-20 Sher Badshah , Ali Emami , Hassan Sajjad

Score-based explainable machine-learning techniques are often used to understand the logic behind black-box models. However, such explanation techniques are often computationally expensive, which limits their application in time-critical…

Machine Learning · Computer Science 2023-08-24 Amr Alkhatib , Henrik Boström , Sofiane Ennadir , Ulf Johansson

We study the task of retrieving relevant experiments given a query experiment. By experiment, we mean a collection of measurements from a set of `covariates' and the associated `outcomes'. While similar experiments can be retrieved by…

Machine Learning · Statistics 2014-02-20 Sohan Seth , John Shawe-Taylor , Samuel Kaski

Reciprocal recommender systems (RRSs) are crucial in online two-sided matching platforms, such as online job or dating markets, as they need to consider the preferences of both sides of the match. The concentration of recommendations to a…

Information Retrieval · Computer Science 2024-12-02 Kento Nakada , Kazuki Kawamura , Ryosuke Furukawa

Recent studies show that Large Language Models (LLMs) achieve strong reasoning capabilities through supervised fine-tuning or reinforcement learning. However, a key approach, the Process Reward Model (PRM), suffers from reward hacking,…

Computation and Language · Computer Science 2026-04-10 Teng Wang , Zhangyi Jiang , Zhenqi He , Shenyang Tong , Wenhan Yang , Yanan Zheng , Zeyu Li , Zifan He , Hailei Gong , Zewen Ye , Shengjie Ma , Jianping Zhang

Evaluating text-to-image generation models requires alignment with human perception, yet existing human-centric metrics are constrained by limited data coverage, suboptimal feature extraction, and inefficient loss functions. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Yuhang Ma , Yunhao Shui , Xiaoshi Wu , Keqiang Sun , Hongsheng Li

This research leverages Conformal Prediction (CP) in the form of Conformal Predictive Systems (CPS) to accurately estimate uncertainty in a suite of machine learning (ML)-based radio metric models [1] as well as in a 2-D map-based ML path…

Machine Learning · Computer Science 2025-01-14 Alexis Bose , Jonathan Ethier , Ryan G. Dempsey , Yifeng Qiu

Recourse provides individuals who received undesirable labels (e.g., denied a loan) from algorithmic decision-making systems with a minimum-cost improvement suggestion to achieve the desired outcome. However, in practice, models often get…

Machine Learning · Computer Science 2026-02-06 Phone Kyaw , Kshitij Kayastha , Shahin Jabbari

We study the Inexact Restoration framework with random models for minimizing functions whose evaluation is subject to errors. We propose a constrained formulation that includes well-known stochastic problems and an algorithm applicable when…

Optimization and Control · Mathematics 2026-02-24 Benedetta Morini , Simone Rebegoldi