English
Related papers

Related papers: Model-Robust Designs for Quantile Regression

200 papers

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

Interest has been growing in decision-focused machine learning methods which train models to account for how their predictions are used in downstream optimization problems. Doing so can often improve performance on subsequent decision…

Machine Learning · Computer Science 2025-03-03 Santiago Cortes-Gomez , Carlos Patiño , Yewon Byun , Steven Wu , Eric Horvitz , Bryan Wilder

We study approaches to robust model-based design of experiments in the context of maximum-likelihood estimation. These approaches provide robustification of model-based methodologies for the design of optimal experiments by accounting for…

Methodology · Statistics 2021-09-03 Anwesh Reddy Gottu Mukkula , Michal Mateáš , Miroslav Fikar , Radoslav Paulen

We propose a nonparametric quantile regression method using deep neural networks with a rectified linear unit penalty function to avoid quantile crossing. This penalty function is computationally feasible for enforcing non-crossing…

Machine Learning · Statistics 2022-10-20 Wenlu Tang , Guohao Shen , Yuanyuan Lin , Jian Huang

Feature based explanations, that provide importance of each feature towards the model prediction, is arguably one of the most intuitive ways to explain a model. In this paper, we establish a novel set of evaluation criteria for such feature…

Machine Learning · Computer Science 2021-04-12 Cheng-Yu Hsieh , Chih-Kuan Yeh , Xuanqing Liu , Pradeep Ravikumar , Seungyeon Kim , Sanjiv Kumar , Cho-Jui Hsieh

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing…

Machine Learning · Computer Science 2022-12-20 Andrew Stirn , Hans-Hermann Wessels , Megan Schertzer , Laura Pereira , Neville E. Sanjana , David A. Knowles

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

In this article, we develop a semiparametric Bayesian estimation and model selection approach for partially linear additive models in conditional quantile regression. The asymmetric Laplace distribution provides a mechanism for Bayesian…

Computation · Statistics 2013-07-11 Yuao Hu , Kaifeng Zhao , Heng Lian

Linear regression is a data analysis technique, which is categorized as supervised learning. By utilizing known data, we can predict unknown data. Recently, researchers have explored the use of quantum annealing (QA) to perform linear…

Quantum Physics · Physics 2024-10-14 Asuka Koura , Takashi Imoto , Katsuki Ura , Yuichiro Matsuzaki

This paper continues the application of circuit theory to experimental design started by the first two authors. The theory gives a very special and detailed representation of the kernel of the design model matrix. This representation turns…

Computation · Statistics 2021-06-22 Roberto Fontana , Fabio Rapallo , Henry P. Wynn

Density regression characterizes the conditional density of the response variable given the covariates, and provides much more information than the commonly used conditional mean or quantile regression. However, it is often computationally…

Methodology · Statistics 2022-06-15 Yunlu Chen , Nan Zhang

In this paper we show that chordal structure can be used to devise efficient optimization methods for robust model predictive control problems. The chordal structure is used both for computing search directions efficiently as well as for…

Optimization and Control · Mathematics 2018-03-21 Anders Hansson , Sina Khoshfetrat Pakazad

Extremile regression, as a least squares analog of quantile regression, is potentially useful tool for modeling and understanding the extreme tails of a distribution. However, existing extremile regression methods, as nonparametric…

Methodology · Statistics 2025-07-03 Rong Jiang , Keming Yu , Jiangfeng Wang

This paper provides a method to construct simultaneous confidence bands for quantile functions and quantile effects in nonlinear network and panel models with unobserved two-way effects, strictly exogenous covariates, and possibly discrete…

Econometrics · Economics 2020-06-09 Victor Chernozhukov , Iván Fernández-Val , Martin Weidner

Uncertainty quantification (UQ) in deep learning regression is of wide interest, as it supports critical applications including sequential decision making and risk-sensitive tasks. In heteroskedastic regression, where the uncertainty of the…

Machine Learning · Computer Science 2026-03-03 Mikkel Jordahn , Jonas Vestergaard Jensen , James Harrison , Michael Riis Andersen , Mikkel N. Schmidt

High-dimensional data can often display heterogeneity due to heteroscedastic variance or inhomogeneous covariate effects. Penalized quantile and expectile regression methods offer useful tools to detect heteroscedasticity in…

Methodology · Statistics 2023-03-23 Rebeka Man , Kean Ming Tan , Zian Wang , Wen-Xin Zhou

This paper considers equity premium prediction, for which mean regression can be problematic due to heteroscedasticity and heavy-tails of the error. We show advantages of quantile predictions using a novel penalized quantile regression that…

Methodology · Statistics 2025-05-23 Shaobo Li , Ben Sherwood

We introduce several methods for assessing sensitivity to unmeasured confounding in marginal structural models; importantly we allow treatments to be discrete or continuous, static or time-varying. We consider three sensitivity models: a…

Methodology · Statistics 2022-10-12 Matteo Bonvini , Edward Kennedy , Valerie Ventura , Larry Wasserman

The effectiveness of supervised learning techniques has made them ubiquitous in research and practice. In high-dimensional settings, supervised learning commonly relies on dimensionality reduction to improve performance and identify the…

Machine Learning · Computer Science 2016-08-11 Chang Liu , Bo Li , Yevgeniy Vorobeychik , Alina Oprea

Counterfactual explanations are widely used to interpret machine learning predictions by identifying minimal changes to input features that would alter a model's decision. However, most existing counterfactual methods have not been tested…

Machine Learning · Computer Science 2026-02-03 Leonidas Christodoulou , Chang Sun