English
Related papers

Related papers: The linear conditional expectation in Hilbert spac…

200 papers

In this paper, we address the inference problem in high-dimensional linear expectile regression. We transform the expectile loss into a weighted-least-squares form and apply a de-biased strategy to establish Wald-type tests for multiple…

Methodology · Statistics 2024-01-17 Xiang Li , Yu-Ning Li , Li-Xin Zhang , Jun Zhao

Conditional expectiles are becoming an increasingly important tool in finance as well as in other areas of applications. We analyse a support vector machine type approach for estimating conditional expectiles and establish learning rates…

Machine Learning · Statistics 2017-02-28 Muhammad Farooq , Ingo Steinwart

While the expected calibration error (ECE), which employs binning, is widely adopted to evaluate the calibration performance of machine learning models, theoretical understanding of its estimation bias is limited. In this paper, we present…

Machine Learning · Computer Science 2025-05-27 Futoshi Futami , Masahiro Fujisawa

Many problems in causal inference and economics can be formulated in the framework of conditional moment models, which characterize the target function through a collection of conditional moment restrictions. For nonparametric conditional…

Machine Learning · Statistics 2022-12-29 Ziyu Wang , Yucen Luo , Yueru Li , Jun Zhu , Bernhard Schölkopf

The continuity of conditional expectation on Orlicz spaces is investigated. Indeed, we provide some necessary and sufficient conditions on a sequence $\{\mathcal{A}_n\}_{n\in\mathbb{N}}$ of $\sigma$-subalgebras for $L^{\varphi}$-convergence…

Functional Analysis · Mathematics 2025-10-28 A. Hosseini , Y. Estaremi

It is often of interest to condition on a singular event given by a random variable, e.g. $\{Y=y\}$ for a continuous random variable $Y$. Conditional measures with respect to this event are usually derived as a special case of the…

Probability · Mathematics 2020-07-06 Philipp Wacker

The functional linear model extends the notion of linear regression to the case where the response and covariates are iid elements of an infinite dimensional Hilbert space. The unknown to be estimated is a Hilbert-Schmidt operator, whose…

Statistics Theory · Mathematics 2016-12-22 Tung Pham , Victor Panaretos

Bayesian inference is a principled framework for dealing with uncertainty. The practitioner can perform an initial assumption for the physical phenomenon they want to model (prior belief), collect some data and then adjust the initial…

Machine Learning · Computer Science 2020-11-10 Vasileios Gkolemis , Michael Gutmann

A complete understanding of heterogeneous treatment effects involves characterizing the full conditional distribution of potential outcomes. To this end, we propose the Conditional Counterfactual Mean Embeddings (CCME), a framework that…

Machine Learning · Statistics 2026-02-05 Thatchanon Anancharoenkij , Donlapark Ponnoprat

Nonlinear expectation, including sublinear expectation as its special case, is a new and original framework of probability theory and has potential applications in some scientific fields, especially in finance risk measure and management.…

Statistics Theory · Mathematics 2013-04-15 Lu Lin , Yufeng Shi , Xin Wang , Shuzhen Yang

Variational Bayesian inference is an important machine-learning tool that finds application from statistics to robotics. The goal is to find an approximate probability density function (PDF) from a chosen family that is in some sense…

Machine Learning · Computer Science 2022-09-27 Timothy D. Barfoot , Gabriele M. T. D'Eleuterio

A recursive estimator of the conditional geometric median in Hilbert spaces is studied. It is based on a stochastic gradient algorithm whose aim is to minimize a weighted L1 criterion and is consequently well adapted for robust online…

Statistics Theory · Mathematics 2012-04-18 Hervé Cardot , Peggy Cénac , Pierre-André Zitt

Computing an ensemble of random fields using conditional simulation is an ideal method for retrieving accurate estimates of a field conditioned on available data and for quantifying the uncertainty of these realizations. Methods for…

Methodology · Statistics 2021-11-11 Maggie D. Bailey , Soutir Bandyopadhyay , Douglas W. Nychka

In this paper, we show that the conditional expectation of a random variable with finite second moment given a $\sigma$-algebra is the unique critical point of an energy functional in Hilbert space $L^2$. Then, we extend by density the…

If error distribution has heteroscedasticity, it voliates the assumption of linear regression. Expectile regression is a powerful tool for estimating the conditional expectiles of a response variable in this setting. Since multiple levels…

Methodology · Statistics 2022-08-03 Jinghang Lin , Yuan Huang , Shuangge Ma

Pre-conditioning is a well-known concept that can significantly improve the convergence of optimization algorithms. For noise-free problems, where good pre-conditioners are not known a priori, iterative linear algebra methods offer one way…

Machine Learning · Computer Science 2019-02-21 Filip de Roos , Philipp Hennig

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

This paper proposes the asymmetric linear double autoregression, which jointly models the conditional mean and conditional heteroscedasticity characterized by asymmetric effects. A sufficient condition is established for the existence of a…

Methodology · Statistics 2021-04-22 Songhua Tan , Qianqian Zhu

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

Machine Learning · Computer Science 2026-03-13 Faris Chaudhry , Siddhant Gadkari

Standard meta-learning for representation learning aims to find a common representation to be shared across multiple tasks. The effectiveness of these methods is often limited when the nuances of the tasks' distribution cannot be captured…

Machine Learning · Computer Science 2021-03-31 Giulia Denevi , Massimiliano Pontil , Carlo Ciliberto