English
Related papers

Related papers: Kernel Conditional Moment Constraints for Confound…

200 papers

Conditional density estimation is a general framework for solving various problems in machine learning. Among existing methods, non-parametric and/or kernel-based methods are often difficult to use on large datasets, while methods based on…

Machine Learning · Statistics 2018-06-06 Hiroaki Sasaki , Aapo Hyvärinen

The contextual bandit problem is a theoretically justified framework with wide applications in various fields. While the previous study on this problem usually requires independence between noise and contexts, our work considers a more…

Machine Learning · Computer Science 2022-09-08 Xueping Gong , Jiheng Zhang

Retrieval-augmented generation (RAG) often suffers from long and noisy retrieved contexts. Prior context compression methods rely on predefined importance metrics or supervised compression models, rather than on the model's own…

Computation and Language · Computer Science 2026-01-27 Yong Zhang , Heng Li , Yanwen Huang , Ning Cheng , Yang Guo , Yun Zhu , Yanmeng Wang , Shaojun Wang , Jing Xiao

Accurate conditional prediction in the regression setting plays an important role in many real-world problems. Typically, a point prediction often falls short since no attempt is made to quantify the prediction accuracy. Classically, under…

Methodology · Statistics 2025-09-04 Kejin Wu , Dimitris N. Politis

We consider the problem of causal effect estimation with an unobserved confounder, where we observe a single proxy variable that is associated with the confounder. Although it has been shown that the recovery of an average causal effect is…

Machine Learning · Statistics 2025-03-19 Liyuan Xu , Arthur Gretton

Contextual bandit algorithms have transformed modern experimentation by enabling real-time adaptation for personalized treatment and efficient use of data. Yet these advantages create challenges for statistical inference due to adaptivity.…

Statistics Theory · Mathematics 2025-09-23 Yongyi Guo , Ziping Xu

We present a method for assessing the sensitivity of the true causal effect to unmeasured confounding. The method requires the analyst to set two intuitive parameters. Otherwise, the method is assumption-free. The method returns an interval…

Methodology · Statistics 2022-02-07 Jose M. Peña

This Element offers a practical guide to estimating conditional marginal effects-how treatment effects vary with a moderating variable-using modern statistical methods. Commonly used approaches, such as linear interaction models, often…

Methodology · Statistics 2026-05-21 Jiehan Liu , Ziyi Liu , Yiqing Xu

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to exibly combine individual regression estimators $r_1, \ldots, r_M$ using a weighted average where the weights are dened based on…

Statistics Theory · Mathematics 2023-10-03 Sothea Has

Sensitivity analysis for unmeasured confounding under incremental propensity score interventions remains relatively underdeveloped. Incremental interventions define stochastic treatment regimes by multiplying the odds of treatment, offering…

Methodology · Statistics 2026-01-27 Shuying Shen , Valerio Bacak , Edward H. Kennedy

Complex models are often used to understand interactions and drivers of human-induced and/or natural phenomena. It is worth identifying the input variables that drive the model output(s) in a given domain and/or govern specific model…

Methodology · Statistics 2023-11-07 Matieyendou Lamboni

We study a generalization of the problem of online learning in adversarial linear contextual bandits by incorporating loss functions that belong to a reproducing kernel Hilbert space, which allows for a more flexible modeling of complex…

Machine Learning · Statistics 2023-10-04 Gergely Neu , Julia Olkhovskaya , Sattar Vakili

In this study, a scalable online kernel learning framework is proposed for estimating bidirectional causal effects in systems characterized by mutual dependence and heteroskedasticity. Traditional causal inference often focuses on…

Machine Learning · Statistics 2025-11-24 Masahiro Tanaka

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

We investigate the problem of algorithmic fairness in the case where sensitive and non-sensitive features are available and one aims to generate new, `oblivious', features that closely approximate the non-sensitive features, and are only…

Machine Learning · Statistics 2020-11-23 Steffen Grünewälder , Azadeh Khaleghi

We show that moment inequalities in a wide variety of economic applications have a particular linear conditional structure. We use this structure to construct uniformly valid confidence sets that remain computationally tractable even in…

Econometrics · Economics 2022-12-20 Isaiah Andrews , Jonathan Roth , Ariel Pakes

We study nonparametric estimation for the partially conditional average treatment effect, defined as the treatment effect function over an interested subset of confounders. We propose a hybrid kernel weighting estimator where the weights…

Methodology · Statistics 2021-03-08 Jiayi Wang , Raymond K. W. Wong , Shu Yang , Kwun Chuen Gary Chan

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators $r_1, r_2, \ldots, r_M$ using a weighted average where the weights are defined…

Methodology · Statistics 2021-04-29 Sothea Has

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

This paper investigates off-policy evaluation in contextual bandits, aiming to quantify the performance of a target policy using data collected under a different and potentially unknown behavior policy. Recently, methods based on conformal…

Machine Learning · Statistics 2025-07-23 Yilong Wan , Yuqiang Li , Xianyi Wu