English
Related papers

Related papers: A Fine-grained Analysis of Fitted Q-evaluation: Be…

200 papers

We study the problem of estimating the distribution of the return of a policy using an offline dataset that is not generated from the policy, i.e., distributional offline policy evaluation (OPE). We propose an algorithm called Fitted…

Machine Learning · Computer Science 2024-01-01 Runzhe Wu , Masatoshi Uehara , Wen Sun

Quality Estimation (QE) aims to assess machine translation quality without reference translations, but recent studies have shown that existing QE models exhibit systematic gender bias. In particular, they tend to favor masculine…

Artificial Intelligence · Computer Science 2026-04-24 Jinhee Jang , Juhwan Choi , Dongjin Lee , Seunguk Yu , Youngbin Kim

In this article, basing on NQD samples, we investigate the fixed design nonparametric regression model, where the errors are pairwise NQD random errors, with fixed design points, and an unknown function. Nonparametric weighted estimator…

Statistics Theory · Mathematics 2013-12-04 Jian-hua Shi , Xiao-ping Chen , Yong Zhou

Quantile regression is a powerful tool for detecting exposure-outcome associations given covariates across different parts of the outcome's distribution, but has two major limitations when the aim is to infer the effect of an exposure.…

Understanding the theoretical capabilities and limitations of quantum machine learning (QML) models to solve machine learning tasks is crucial to advancing both quantum software and hardware developments. Similarly to the classical setting,…

Quantum Physics · Physics 2026-03-31 Qiuhao Chen , Yuling Jiao , Yinan Li , Xiliang Lu , Jerry Zhijian Yang

We study quantile-optimal policy learning where the goal is to find a policy whose reward distribution has the largest $\alpha$-quantile for some $\alpha \in (0, 1)$. We focus on the offline setting whose generating process involves…

Machine Learning · Statistics 2025-06-10 Zhongren Chen , Siyu Chen , Zhengling Qi , Xiaohong Chen , Zhuoran Yang

We present a novel theoretical framework, Q-MMR, for off-policy evaluation in finite-horizon MDPs. Q-MMR learns a set of scalar weights, one for each data point, such that the reweighted rewards approximate the expected return under the…

Machine Learning · Computer Science 2026-05-11 Xiang Li , Nan Jiang

With the increasing availability of datasets, developing data fusion methods to leverage the strengths of different datasets to draw causal effects is of great practical importance to many scientific fields. In this paper, we consider…

Methodology · Statistics 2023-07-18 Yijiao Zhang , Zhongyi Zhu

The Variational Quantum Eigensolver (VQE) is a promising candidate for quantum applications on near-term Noisy Intermediate-Scale Quantum (NISQ) computers. Despite a lot of empirical studies and recent progress in theoretical understanding…

Quantum Physics · Physics 2022-05-26 Xuchen You , Shouvanik Chakrabarti , Xiaodi Wu

Due to its significance as a subroutine, in this work, we consider the coherent version of the quantum phase estimation problem, where given an arbitrary input state and black-box access to unitaries $U$ and controlled-$U$, the goal is to…

Quantum Physics · Physics 2026-04-20 Dhrumil Patel , Shi Jie Samuel Tan , Yigit Subasi , Andrew T. Sornborger

The predictions of question answering (QA)systems are typically evaluated against manually annotated finite sets of one or more answers. This leads to a coverage limitation that results in underestimating the true performance of systems,…

Computation and Language · Computer Science 2022-10-27 Jannis Bulian , Christian Buck , Wojciech Gajewski , Benjamin Boerschinger , Tal Schuster

Fitted $Q$-iteration (FQI) and soft FQI are widely used value-based methods for offline reinforcement learning, but their standard stability guarantees often depend on Bellman completeness, a strong closure condition that can fail under…

Machine Learning · Statistics 2026-05-11 Lars van der Laan , Nathan Kallus

Given a partial differential equation (PDE), goal-oriented error estimation allows us to understand how errors in a diagnostic quantity of interest (QoI), or goal, occur and accumulate in a numerical approximation, for example using the…

Machine Learning · Computer Science 2022-07-25 Joseph G. Wallwork , Jingyi Lu , Mingrui Zhang , Matthew D. Piggott

Quantum phase estimation is one of the key algorithms in the field of quantum computing, but up until now, only approximate expressions have been derived for the probability of error. We revisit these derivations, and find that by ensuring…

Quantum Physics · Physics 2012-02-13 James M. Chappell , Max A. Lohe , Lorenz von Smekal , Azhar Iqbal , Derek Abbott

It is expensive to evaluate the results of Machine Translation(MT), which usually requires manual translation as a reference. Machine Translation Quality Estimation (QE) is a task of predicting the quality of machine translations without…

Computation and Language · Computer Science 2022-04-19 Lei Lin

Interactive fixed effects are routinely controlled for in linear panel models. While an analogous fixed effects (FE) estimator for nonlinear models has been available in the literature (Chen, Fernandez-Val and Weidner, 2021), it sees much…

Econometrics · Economics 2026-03-25 Andrei Zeleneev , Weisheng Zhang

Quality estimation (QE) is the task of automatically evaluating the quality of translations without human-translated references. Calculating BLEU between the input sentence and round-trip translation (RTT) was once considered as a metric…

Computation and Language · Computer Science 2020-04-30 Jihyung Moon , Hyunchang Cho , Eunjeong L. Park

Quantum Phase Estimation (QPE) routines are known to fail probabilistically even with perfect gates and input states. This effect stems from an incompatibility of finite-sized quantum registers to capture a phase within QPE with phase…

Quantum Physics · Physics 2025-08-12 Harriet Apel , Cristian L. Cortes , Jessica Lemieux , Mark Steudtner

Progress in fault-tolerant quantum computation (FTQC) has driven the pursuit of practical applications with early fault-tolerant quantum computers (EFTQC). These devices, limited in their qubit counts and fault-tolerance capabilities,…

Quantum Physics · Physics 2024-05-06 Qiyao Liang , Yiqing Zhou , Archismita Dalal , Peter D. Johnson

Federated learning (FL) faces challenges in uncertainty quantification (UQ). Without reliable UQ, FL systems risk deploying overconfident models at under-resourced agents, leading to silent local failures despite seemingly satisfactory…

Machine Learning · Computer Science 2026-03-02 Quang-Huy Nguyen , Jiaqi Wang , Wei-Shinn Ku