English
Related papers

Related papers: Observable adjustments in single-index models for …

200 papers

We propose a method for learning linear models whose predictive performance is robust to causal interventions on unobserved variables, when noisy proxies of those variables are available. Our approach takes the form of a regularization term…

Machine Learning · Computer Science 2021-06-29 Michael Oberst , Nikolaj Thams , Jonas Peters , David Sontag

The multivariate generalized Gaussian distribution (MGGD), also known as the multivariate exponential power (MEP) distribution, is widely used in signal and image processing. However, estimating MGGD parameters, which is required in…

Methodology · Statistics 2023-12-13 Nora Ouzir , Frédéric Pascal , Jean-Christophe Pesquet

Let $(X,Y)\in\mathcal{X}\times \mathcal{Y}$ be a random couple with unknown distribution $P$. Let $\GG$ be a class of measurable functions and $\ell$ a loss function. The problem of statistical learning deals with the estimation of the…

Statistics Theory · Mathematics 2012-07-12 Sébastien Loustau

We study the problem of learning conditional average treatment effects (CATE) from observational data with unobserved confounders. The CATE function maps baseline covariates to individual causal effect predictions and is key for…

Machine Learning · Statistics 2018-10-09 Nathan Kallus , Xiaojie Mao , Angela Zhou

Unmeasured confounding presents a common challenge in observational studies, potentially making standard causal parameters unidentifiable without additional assumptions. Given the increasing availability of diverse data sources, exploiting…

Methodology · Statistics 2023-09-18 Shanshan Luo , Yechi Zhang , Wei Li

By exploiting the theory of skew-symmetric distributions, we generalise existing results in sensitivity analysis by providing the analytic expression of the bias induced by marginalization over an unobserved continuous confounder in a…

Methodology · Statistics 2023-06-19 Matteo Gasparin , Bruno Scarpa , Elena Stanghellini

A key problem in the theory of meta-learning is to understand how the task distributions influence transfer risk, the expected error of a meta-learner on a new task drawn from the unknown task distribution. In this paper, focusing on fixed…

Machine Learning · Statistics 2021-06-15 Mikhail Konobeev , Ilja Kuzborskij , Csaba Szepesvári

Causal inference from observational data is crucial for many disciplines such as medicine and economics. However, sharp bounds for causal effects under relaxations of the unconfoundedness assumption (causal sensitivity analysis) are subject…

Machine Learning · Computer Science 2023-10-17 Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

Let $(X,Y)$ be a random couple in $S\times T$ with unknown distribution $P$ and $(X_1,Y_1),...,(X_n,Y_n)$ be i.i.d. copies of $(X,Y).$ Denote $P_n$ the empirical distribution of $(X_1,Y_1),...,(X_n,Y_n).$ Let $h_1,...,h_N:S\mapsto [-1,1]$…

Statistics Theory · Mathematics 2009-05-14 Vladimir Koltchinskii

Linear inverse problems are ubiquitous. Often the measurements do not follow a Gaussian distribution. Additionally, a model matrix with a large condition number can complicate the problem further by making it ill-posed. In this case, the…

This study proposes a novel method for estimation and hypothesis testing in high-dimensional single-index models. We address a common scenario where the sample size and the dimension of regression coefficients are large and comparable.…

Statistics Theory · Mathematics 2024-04-30 Kazuma Sawaya , Yoshimasa Uematsu , Masaaki Imaizumi

We develop a novel and general framework for reduced-bias $M$-estimation from asymptotically unbiased estimating functions. The framework relies on an empirical approximation of the bias by a function of derivatives of estimating function…

Methodology · Statistics 2023-08-11 Ioannis Kosmidis , Nicola Lunardon

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

Researchers increasingly leverage movement across multiple treatments to estimate causal effects. While these "mover regressions" are often motivated by a linear constant-effects model, it is not clear what they capture under weaker…

Econometrics · Economics 2018-04-19 Peter Hull

Robust estimators, like the median of a point set, are important for data analysis in the presence of outliers. We study robust estimators for locationally uncertain points with discrete distributions. That is, each point in a data set has…

Discrete Mathematics · Computer Science 2018-03-14 Kevin Buchin , Jeff M. Phillips , Pingfan Tang

We present a variational multi-label segmentation algorithm based on a robust Huber loss for both the data and the regularizer, minimized within a convex optimization framework. We introduce a novel constraint on the common areas, to bias…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Byung-Woo Hong , Ja-Keoung Koo , Stefano Soatto

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in…

Machine Learning · Statistics 2019-03-01 Adarsh Subbaswamy , Peter Schulam , Suchi Saria

Consider a nonlinear regression model : y_{i}=g(x_{i},{\theta})+e_{i}, i=1,...,n, where the x_{i} are random predictors x_{i} and {\theta} is the unknown parameter vector ranging in a set {\Theta}\subsetR^{p}. All known results on the…

Statistics Theory · Mathematics 2012-07-03 Fasano María Victoria , Ricardo A. Maronna

Gradient descent is one of the most widely used iterative algorithms in modern statistical learning. However, its precise algorithmic dynamics in high-dimensional settings remain only partially understood, which has limited its broader…

Statistics Theory · Mathematics 2025-11-19 Qiyang Han , Xiaocong Xu
‹ Prev 1 4 5 6 7 8 10 Next ›