English
Related papers

Related papers: Deep Quantile Regression: Mitigating the Curse of …

200 papers

Dimension reduction for high-dimensional compositional data plays an important role in many fields, where the principal component analysis of the basis covariance matrix is of scientific interest. In practice, however, the basis variables…

Methodology · Statistics 2021-09-13 Jingru Zhang , Wei Lin

We develop a predictive inference procedure that combines conformal prediction (CP) with unconditional quantile regression (QR) -- a commonly used tool in econometrics that involves regressing the recentered influence function (RIF) of the…

Machine Learning · Computer Science 2023-04-05 Ahmed M. Alaa , Zeshan Hussain , David Sontag

This paper derives limit properties of nonparametric kernel regression estimators without requiring existence of density for regressors in $\mathbb{R}^{q}.$ In functional regression limit properties are established for multivariate…

Econometrics · Economics 2026-01-08 Marcia Schafgans , Victoria Zinde-Walsh

In this paper, we establish a neural network to approximate functionals, which are maps from infinite dimensional spaces to finite dimensional spaces. The approximation error of the neural network is $O(1/\sqrt{m})$ where $m$ is the size of…

Numerical Analysis · Mathematics 2023-01-02 Yahong Yang , Yang Xiang

The capacity to address counterfactual "what if" inquiries is crucial for understanding and making use of causal influences. Traditional counterfactual inference, under Pearls' counterfactual framework, typically depends on having access to…

Machine Learning · Computer Science 2024-02-29 Shaoan Xie , Biwei Huang , Bin Gu , Tongliang Liu , Kun Zhang

We study approximation and statistical learning properties of deep ReLU networks under structural assumptions that mitigate the curse of dimensionality. We prove minimax-optimal uniform approximation rates for $s$-H\"older smooth functions…

Statistics Theory · Mathematics 2026-02-06 Thomas Nagler , Sophie Langer

Recently, several deep learning (DL) methods for approximating high-dimensional partial differential equations (PDEs) have been proposed. The interest that these methods have generated in the literature is in large part due to simulations…

Numerical Analysis · Mathematics 2026-04-30 Julia Ackermann , Arnulf Jentzen , Thomas Kruse , Benno Kuckuck , Joshua Lee Padgett

Quantile regression, the prediction of conditional quantiles, finds applications in various fields. Often, some or all of the variables are discrete. The authors propose two new quantile regression approaches to handle such mixed…

Methodology · Statistics 2017-05-24 Niklas Schallhorn , Daniel Kraus , Thomas Nagler , Claudia Czado

In this paper, we study a novel approach for the estimation of quantiles when facing potential right censoring of the responses. Contrary to the existing literature on the subject, the adopted strategy of this paper is to tackle censoring…

Methodology · Statistics 2017-03-24 Mickaël De Backer , Anouar El Ghouch , Ingrid Van Keilegom

Semi-parametric quantile regression (SPQR) is a flexible approach to density regression that learns a spline-based representation of conditional density functions using neural networks. As it makes no parametric assumptions about the…

Methodology · Statistics 2026-02-26 Reetam Majumder , Jordan Richards

In a recent paper Birke and Bissantz (2008) considered the problem of nonparametric estimation in inverse regression models with convolution-type operators. For multivariate predictors nonparametric methods suffer from the curse of…

Statistics Theory · Mathematics 2013-03-19 T. Hildebrandt , N. Bissantz , H. Dette

This paper studies the problem of dimension reduction, tailored to improving time series forecasting with high-dimensional predictors. We propose a novel Supervised Deep Dynamic Principal component analysis (SDDP) framework that…

Machine Learning · Statistics 2025-11-25 Zhanye Luo , Yuefeng Han , Xiufan Yu

Learning the cumulative distribution function (CDF) of an outcome variable conditional on a set of features remains challenging, especially in high-dimensional settings. Conditional transformation models provide a semi-parametric approach…

Machine Learning · Computer Science 2021-10-05 Philipp F. M. Baumann , Torsten Hothorn , David Rügamer

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…

Quantile regression is a very important tool to explore the relationship between the response variable and its covariates. Motivated by mean regression with LASSO for compositional covariates proposed by Lin et al. (2014), we consider…

Methodology · Statistics 2020-06-02 Xuejun Ma , Ping Zhang

We consider a family of deep neural networks consisting of two groups of convolutional layers, a downsampling operator, and a fully connected layer. The network structure depends on two structural parameters which determine the numbers of…

Machine Learning · Computer Science 2021-07-05 Tong Mao , Zhongjie Shi , Ding-Xuan Zhou

For highly skewed or fat-tailed distributions, mean or median-based methods often fail to capture the central tendencies in the data. Despite being a viable alternative, estimating the conditional mode given certain covariates (or mode…

Econometrics · Economics 2024-12-10 Eduardo Schirmer Finn , Eduardo Horta

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

Statistics Theory · Mathematics 2025-02-20 Vladimir Spokoiny

Contextual bandits are a central framework for sequential decision-making, with applications ranging from recommendation systems to clinical trials. While nonparametric methods can flexibly model complex reward structures, they suffer from…

Statistics Theory · Mathematics 2026-01-01 Wanteng Ma , T. Tony Cai

We propose a deep neural network architecture for storing approximate Lyapunov functions of systems of ordinary differential equations. Under a small-gain condition on the system, the number of neurons needed for an approximation of a…

Optimization and Control · Mathematics 2020-05-20 Lars Grüne