English
Related papers

Related papers: Observable adjustments in single-index models for …

200 papers

We are concerned with obtaining well-calibrated output distributions from regression models. Such distributions allow us to quantify the uncertainty that the model has regarding the predicted target value. We introduce the novel concept of…

Machine Learning · Statistics 2019-05-16 Hao Song , Tom Diethe , Meelis Kull , Peter Flach

We consider the problem of estimating the joint distribution of $n$ independent random variables. Our approach is based on a family of candidate probabilities that we shall call a model and which is chosen to either contain the true…

Statistics Theory · Mathematics 2021-06-01 Yannick Baraud

We propose a fully data-driven approach to designing mutual information (MI) estimators. Since any MI estimator is a function of the observed sample from two random variables, we parameterize this function with a neural network (MIST) and…

Machine Learning · Computer Science 2026-02-24 German Gritsai , Megan Richards , Maxime Méloux , Kyunghyun Cho , Maxime Peyrard

We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those…

Statistics Theory · Mathematics 2024-11-08 Natalie Neumeyer , Leonie Selk

When estimating causal effects from observational studies, researchers often need to adjust for many covariates to deconfound the non-causal relationship between exposure and outcome, among which many covariates are discrete. The behavior…

Statistics Theory · Mathematics 2024-05-07 Zhenghao Zeng , Sivaraman Balakrishnan , Yanjun Han , Edward H. Kennedy

The presence of confounding by high-dimensional variables complicates estimation of the average effect of a point treatment. On the one hand, it necessitates the use of variable selection strategies or more general data-adaptive…

Methodology · Statistics 2017-08-15 Vahe Avagyan , Stijn Vansteelandt

For the problem of high-dimensional sparse linear regression, it is known that an $\ell_0$-based estimator can achieve a $1/n$ "fast" rate on the prediction error without any conditions on the design matrix, whereas in absence of…

Statistics Theory · Mathematics 2015-12-01 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

We study the approximation of expectations $\E(f(X))$ for Gaussian random elements $X$ with values in a separable Hilbert space $H$ and Lipschitz continuous functionals $f \colon H \to \R$. We consider restricted Monte Carlo algorithms,…

Numerical Analysis · Mathematics 2018-02-15 Michael B. Giles , Mario Hefter , Lukas Mayer , Klaus Ritter

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

Accurate estimates of causal effects play a key role in decision-making across applications such as healthcare, economics, and operations. In the absence of randomized experiments, a common approach to estimating causal effects uses…

Statistics Theory · Mathematics 2024-11-14 Davin Choo , Chandler Squires , Arnab Bhattacharyya , David Sontag

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach…

Machine Learning · Statistics 2017-12-15 John Duchi , Hongseok Namkoong

This PhD thesis contains several contributions to the field of statistical causal modeling. Statistical causal models are statistical models embedded with causal assumptions that allow for the inference and reasoning about the behavior of…

Machine Learning · Statistics 2021-10-05 Martin Emil Jakobsen

Causal effect estimation from observational data is a crucial but challenging task. Currently, only a limited number of data-driven causal effect estimation methods are available. These methods either provide only a bound estimation of the…

Methodology · Statistics 2020-11-10 Debo Cheng , Jiuyong Li , Lin Liu , Kui Yu , Thuc Duy Lee , Jixue Liu

We study the classical problem of predicting an outcome variable, $Y$, using a linear combination of a $d$-dimensional covariate vector, $\mathbf{X}$. We are interested in linear predictors whose coefficients solve: % \begin{align*}…

Statistics Theory · Mathematics 2024-04-10 José Luis Montiel Olea , Cynthia Rush , Amilcar Velez , Johannes Wiesel

This paper considers the evaluation of discretely distributed treatments when outcomes are only observed for a subpopulation due to sample selection or outcome attrition. For identification, we combine a selection-on-observables assumption…

Econometrics · Economics 2021-07-16 Michela Bia , Martin Huber , Lukáš Lafférs

Accurately modeling power distribution grids is crucial for designing effective monitoring and decision making algorithms. This paper addresses the partial observability issue of data-driven distribution modeling in order to improve the…

Signal Processing · Electrical Eng. & Systems 2021-10-08 Shanny Lin , Hao Zhu

We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid…

Optimization and Control · Mathematics 2021-11-09 Christian Clason , Carla Tameling , Benedikt Wirth

Rates of convergence for empirical risk minimizers have been well studied in the literature. In this paper, we aim to provide a complementary set of results, in particular by showing that after normalization, the risk of the empirical…

Statistics Theory · Mathematics 2016-01-12 Sara van de Geer , Martin Wainwright

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke
‹ Prev 1 3 4 5 6 7 10 Next ›