English
Related papers

Related papers: Combining Query Performance Predictors: A Reproduc…

200 papers

Knowledge Graph Query Embedding (KGQE) aims to embed First-Order Logic (FOL) queries in a low-dimensional KG space for complex reasoning over incomplete KGs. To enhance the generalization of KGQE models, recent studies integrate various…

Artificial Intelligence · Computer Science 2024-10-29 Xingrui Zhuo , Jiapu Wang , Gongqing Wu , Shirui Pan , Xindong Wu

Existing prompt-optimization techniques rely on local signals to update behavior, often neglecting broader and recurring patterns across tasks, leading to poor generalization; they further rely on full-prompt rewrites or unstructured…

Software Engineering · Computer Science 2026-03-24 Balaji Dinesh Gangireddi , Aniketh Garikaparthi , Manasi Patwardhan , Arman Cohan

Simultaneous interpretation, translation of the spoken word in real-time, is both highly challenging and physically demanding. Methods to predict interpreter confidence and the adequacy of the interpreted message have a number of potential…

Computation and Language · Computer Science 2018-07-09 Craig Stewart , Nikolai Vogler , Junjie Hu , Jordan Boyd-Graber , Graham Neubig

Evaluating the computational reproducibility of data analysis pipelines has become a critical issue. It is, however, a cumbersome process for analyses that involve data from large populations of subjects, due to their computational and…

Methodology · Statistics 2018-09-28 Soudabeh Barghi , Lalet Scaria , Ali Salari , Tristan Glatard

Sequence prediction models can be learned from example sequences with a variety of training algorithms. Maximum likelihood learning is simple and efficient, yet can suffer from compounding error at test time. Reinforcement learning such as…

Machine Learning · Computer Science 2019-07-02 Bowen Tan , Zhiting Hu , Zichao Yang , Ruslan Salakhutdinov , Eric Xing

Modern deterministic retrieval pipelines prioritize achieving state-of-the-art performance but often lack interpretability in decision-making. These models face challenges in assessing uncertainty, leading to overconfident predictions. To…

Information Retrieval · Computer Science 2024-02-06 EuiYul Song , Philhoon Oh , Sangryul Kim , James Thorne

"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. Prior work on…

Information Retrieval · Computer Science 2021-08-11 Praveen Kumar Bodigutla

Cross-temporal forecast reconciliation aims to ensure consistency across forecasts made at different temporal and cross-sectional levels. We explore the relationships between sequential, iterative, and optimal combination approaches, and…

Methodology · Statistics 2024-10-28 Daniele Girolimetto , Tommaso Di Fonzo

Lowering the numerical precision of model parameters and computations is widely adopted to improve the efficiency of retrieval systems. However, when computing relevance scores between the query and documents in low-precision, we observe…

Information Retrieval · Computer Science 2026-04-14 Kisu Yang , Yoonna Jang , Hwanseok Jang , Kenneth Choi , Isabelle Augenstein , Heuiseok Lim

Large-scale replication studies like the Reproducibility Project: Psychology (RP:P) provide invaluable systematic data on scientific replicability, but most analyses and interpretations of the data fail to agree on the definition of…

Methodology · Statistics 2022-03-08 Kenneth Hung , William Fithian

There are many offline metrics that can be used as a reference for evaluation and optimization of the performance of recommender systems. Hybrid recommendation approaches are commonly used to improve some of those metrics by combining…

Information Retrieval · Computer Science 2019-01-09 Andres Ferraro , Dmitry Bogdanov , Kyumin Choi , Xavier Serra

An overview of current debates and contemporary research devoted to the modeling of decision making processes and their facilitation directs attention to the Analytic Hierarchy Process (AHP). At the core of the AHP are various…

Artificial Intelligence · Computer Science 2020-06-05 Paul Thaddeus Kazibudzki

We propose conformal predictive programming (CPP), a framework to solve chance constrained optimization problems, i.e., optimization problems with constraints that are functions of random variables. CPP utilizes samples from these random…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Yiqi Zhao , Xinyi Yu , Matteo Sesia , Jyotirmoy V. Deshmukh , Lars Lindemann

Reciprocal recommender systems~(RRS), conducting bilateral recommendations between two involved parties, have gained increasing attention for enhancing matching efficiency. However, the majority of existing methods in the literature still…

Information Retrieval · Computer Science 2024-08-20 Chen Yang , Sunhao Dai , Yupeng Hou , Wayne Xin Zhao , Jun Xu , Yang Song , Hengshu Zhu

Machine Translation Quality Estimation is a notoriously difficult task, which lessens its usefulness in real-world translation environments. Such scenarios can be improved if quality predictions are accompanied by a measure of uncertainty.…

Computation and Language · Computer Science 2016-07-01 Daniel Beck , Lucia Specia , Trevor Cohn

Retrieval systems are increasingly used in biomedical and clinical natural language processing applications, yet practical guidance for researchers building such systems is limited. In this work, we provide such guidance through an…

Information Retrieval · Computer Science 2026-04-24 Hayk Stepanyan , Matthew McDermott

The reliability of a high-throughput biological experiment relies highly on the settings of the operational factors in its experimental and data-analytic procedures. Understanding how operational factors influence the reproducibility of the…

Methodology · Statistics 2018-07-04 Feipeng Zhang , Frank Shen , Tao Yang , Qunhua Li

Meta-analysis is routinely performed in many scientific disciplines. This analysis is attractive since discoveries are possible even when all the individual studies are underpowered. However, the meta-analytic discoveries may be entirely…

Methodology · Statistics 2023-05-09 Marina Bogomolov , Ruth Heller

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

Quantum machine learning models incorporating data re-uploading circuits have garnered significant attention due to their exceptional expressivity and trainability. However, their ability to generate accurate predictions on unseen data,…

Quantum Physics · Physics 2025-10-29 Xin Wang , Han-Xiao Tao , Re-Bing Wu