English
Related papers

Related papers: Isotonic Distributional Regression

200 papers

We propose causal isotonic calibration, a novel nonparametric method for calibrating predictors of heterogeneous treatment effects. Furthermore, we introduce cross-calibration, a data-efficient variant of calibration that eliminates the…

Machine Learning · Statistics 2023-06-07 Lars van der Laan , Ernesto Ulloa-Pérez , Marco Carone , Alex Luedtke

An individualized treatment rule (ITR) is a decision rule that aims to improve individual patients health outcomes by recommending optimal treatments according to patients specific information. In observational studies, collected data may…

Methodology · Statistics 2023-10-03 Zeyu Bian , Erica EM Moodie , Susan M Shortreed , Sylvie D Lambert , Sahir Bhatnagar

A bottleneck of sufficient dimension reduction (SDR) in the modern era is that, among numerous methods, only the sliced inverse regression (SIR) is generally applicable under the high-dimensional settings. The higher-order inverse…

Methodology · Statistics 2024-07-24 Yin Jin , Wei Luo

Deconvolution is a statistical inverse problem to estimate the distribution of a random variable based on its noisy observations. Despite the extensive studies on the topic, deconvolution with unknown noise distribution remains as a…

Statistics Theory · Mathematics 2020-04-06 Devavrat Shah , Dogyoon Song

Random Forest (Breiman, 2001) is a successful and widely used regression and classification algorithm. Part of its appeal and reason for its versatility is its (implicit) construction of a kernel-type weighting function on training data,…

Machine Learning · Statistics 2022-10-13 Domagoj Ćevid , Loris Michel , Jeffrey Näf , Nicolai Meinshausen , Peter Bühlmann

Due to their flexibility and predictive performance, machine-learning based regression methods have become an important tool for predictive modeling and forecasting. However, most methods focus on estimating the conditional mean or specific…

Machine Learning · Statistics 2019-03-15 Rui Li , Howard D. Bondell , Brian J. Reich

We introduce Interactive Bayesian Distributional Robustness (IBDR), a novel Bayesian inference framework that allows modeling the interactions between particles, thereby enhancing ensemble quality through increased particle diversity. IBDR…

Machine Learning · Computer Science 2025-06-10 Ngoc-Quan Pham , Tuan Truong , Quyen Tran , Tan Nguyen , Dinh Phung , Trung Le

The estimation of categorical distributions under marginal constraints summarizing some sample from a population in the most-generalizable way is key for many machine-learning and data-driven approaches. We provide a parameter-agnostic…

High Energy Physics - Theory · Physics 2023-11-17 Orestis Loukas , Ho Ryun Chung

The instrumental variable (IV) approach is commonly used to infer causal effects in the presence of unmeasured confounding. Existing methods typically aim to estimate the mean causal effects, whereas a few other methods focus on quantile…

Methodology · Statistics 2025-03-13 Anastasiia Holovchak , Sorawit Saengkyongam , Nicolai Meinshausen , Xinwei Shen

We propose a strategy for computing the isotonic least-squares estimate of a monotone function in a general regression setting where the data are distributed across different servers and the observations across servers, though independent,…

Statistics Theory · Mathematics 2018-06-25 Moulinath Banerjee , Cecile Durot

We consider the problem of nonparametric regression under shape constraints. The main examples include isotonic regression (with respect to any partial order), unimodal/convex regression, additive shape-restricted regression, and…

Statistics Theory · Mathematics 2018-07-03 Adityanand Guntuboyina , Bodhisattva Sen

We propose dual regression as an alternative to the quantile regression process for the global estimation of conditional distribution functions under minimal assumptions. Dual regression provides all the interpretational power of the…

Methodology · Statistics 2018-09-26 Richard Spady , Sami Stouli

This paper presents an in-depth analysis of the generalized isotonic recursive partitioning (GIRP) algorithm for fitting isotonic models under separable convex losses, proposed by Luss and Rosset [J. Comput. Graph. Statist., 23 (2014), pp.…

Machine Learning · Statistics 2024-01-12 Joong-Ho Won , Jihan Jung

An empirical Bayes problem has an unknown prior to be estimated from data. The predictive recursion (PR) algorithm provides fast nonparametric estimation of mixing distributions and is ideally suited for empirical Bayes applications. This…

Statistics Theory · Mathematics 2012-10-19 Ryan Martin

Iterative imputation, in which variables are imputed one at a time each given a model predicting from all the others, is a popular technique that can be convenient and flexible, as it replaces a potentially difficult multivariate modeling…

Statistics Theory · Mathematics 2012-04-04 Jingchen Liu , Andrew Gelman , Jennifer Hill , Yu-Sung Su

Quantile regression (QR) is becoming increasingly popular due to its relevance in many scientific investigations. There is a great amount of work about linear and nonlinear QR models. Specifically, nonparametric estimation of the…

Methodology · Statistics 2020-01-13 Eliana Christou

The field of precision medicine aims to tailor treatment based on patient-specific factors in a reproducible way. To this end, estimating an optimal individualized treatment regime (ITR) that recommends treatment decisions based on patient…

In regression problems where there is no known true underlying model, conformal prediction methods enable prediction intervals to be constructed without any assumptions on the distribution of the underlying data, except that the training…

Methodology · Statistics 2023-01-31 Wenyu Chen , Kelli-Jean Chun , Rina Foygel Barber

This paper introduces an iterative algorithm for training nonparametric additive models that enjoys favorable memory storage and computational requirements. The algorithm can be viewed as the functional counterpart of stochastic gradient…

Machine Learning · Statistics 2026-01-01 Xin Chen , Jason M. Klusowski

We describe a new approach for managing aleatoric uncertainty in the Reinforcement Learning (RL) paradigm. Instead of selecting actions according to a single statistic, we propose a distributional method based on the second-order stochastic…

Machine Learning · Computer Science 2020-10-08 John D. Martin , Michal Lyskawinski , Xiaohu Li , Brendan Englot