中文
相关论文

相关论文: Deep Quantile Regression: Mitigating the Curse of …

200 篇论文

Deep neural networks excel in high-dimensional problems, outperforming models such as kernel methods, which suffer from the curse of dimensionality. However, the theoretical foundations of this success remain poorly understood. We follow…

机器学习 · 统计学 2025-10-06 Shuo Huang , Hippolyte Labarrière , Ernesto De Vito , Tomaso Poggio , Lorenzo Rosasco

In recent years deep artificial neural networks (DNNs) have been successfully employed in numerical simulations for a multitude of computational problems including, for example, object and face recognition, natural language processing,…

数值分析 · 数学 2021-10-12 Arnulf Jentzen , Diyora Salimova , Timo Welti

The development of new classification and regression algorithms based on empirical risk minimization (ERM) over deep neural network hypothesis classes, coined deep learning, revolutionized the area of artificial intelligence, machine…

机器学习 · 计算机科学 2020-11-12 Julius Berner , Philipp Grohs , Arnulf Jentzen

Having a large number of covariates can have a negative impact on the quality of causal effect estimation since confounding adjustment becomes unreliable when the number of covariates is large relative to the samples available. Propensity…

统计方法学 · 统计学 2020-09-15 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu

Approximating functions of a large number of variables poses particular challenges often subsumed under the term ``Curse of Dimensionality'' (CoD). Unless the approximated function exhibits a very high level of smoothness the CoD can be…

数值分析 · 数学 2023-06-16 Wolfgang Dahmen

Despite impressive state-of-the-art performance on a wide variety of machine learning tasks, deep learning methods can produce over-confident predictions, particularly with limited training data. Therefore, quantifying uncertainty is…

机器学习 · 计算机科学 2022-04-27 Haleh Akrami , Anand Joshi , Sergul Aydore , Richard Leahy

Conditional density estimation is a general framework for solving various problems in machine learning. Among existing methods, non-parametric and/or kernel-based methods are often difficult to use on large datasets, while methods based on…

机器学习 · 统计学 2018-06-06 Hiroaki Sasaki , Aapo Hyvärinen

Recent results in nonparametric regression show that deep learning, i.e., neural network estimates with many hidden layers, are able to circumvent the so-called curse of dimensionality in case that suitable restrictions on the structure of…

机器学习 · 统计学 2020-09-30 Michael Kohler , Sophie Langer

We propose a prediction procedure for the functional linear quantile regression model by using partial quantile covariance techniques and develop a simple partial quantile regression (SIMPQR) algorithm to efficiently extract partial…

统计方法学 · 统计学 2015-11-03 Dengdeng Yu , Linglong Kong , Ivan Mizera

Quantile regression, that is the prediction of conditional quantiles, has steadily gained importance in statistical modeling and financial applications. The authors introduce a new semiparametric quantile regression method based on…

统计方法学 · 统计学 2016-11-17 Daniel Kraus , Claudia Czado

In this paper, we propose deep partial least squares for the estimation of high-dimensional nonlinear instrumental variable regression. As a precursor to a flexible deep neural network architecture, our methodology uses partial least…

统计方法学 · 统计学 2023-06-06 Maria Nareklishvili , Nicholas Polson , Vadim Sokolov

Density estimation is a fundamental task in statistics and machine learning applications. Kernel density estimation is a powerful tool for non-parametric density estimation in low dimensions; however, its performance is poor in higher…

机器学习 · 计算机科学 2022-08-08 Joseph A. Gallego , Fabio A. González

The purpose of this article is to develop a machinery to study the capacity of deep neural networks (DNNs) to approximate high-dimensional functions. In particular, we show that DNNs have the expressive power to overcome the curse of…

Unsupervised machine learning lacks ground truth by definition. This poses a major difficulty when designing metrics to evaluate the performance of such algorithms. In sharp contrast with supervised learning, for which plenty of quality…

We consider the problem of estimating the structural function in nonparametric instrumental regression, where in the presence of an instrument W a response Y is modeled in dependence of an endogenous explanatory variable Z. The proposed…

统计理论 · 数学 2015-03-13 Jan Johannes , Maik Schwarz

Conformalized Quantile Regression (CQR) is a recently proposed method for constructing prediction intervals for a response $Y$ given covariates $X$, without making distributional assumptions. However, existing constructions of CQR can be…

统计方法学 · 统计学 2024-05-16 Raphael Rossellini , Rina Foygel Barber , Rebecca Willett

We propose a novel deep learning approach to nonparametric statistical inference for the conditional hazard function of survival time with right-censored data. We use a deep neural network (DNN) to approximate the logarithm of a conditional…

统计方法学 · 统计学 2024-10-24 Wen Su , Kin-Yat Liu , Guosheng Yin , Jian Huang , Xingqiu Zhao

The No Unmeasured Confounding Assumption is widely used to identify causal effects in observational studies. Recent work on proximal inference has provided alternative identification results that succeed even in the presence of unobserved…

Recently, it has been proposed in the literature to employ deep neural networks (DNNs) together with stochastic gradient descent methods to approximate solutions of PDEs. There are also a few results in the literature which prove that DNNs…

数值分析 · 数学 2022-06-29 Philipp Grohs , Arnulf Jentzen , Diyora Salimova

Quantile regression is a powerful tool for inferring how covariates affect specific percentiles of the response distribution. Existing methods either estimate conditional quantiles separately for each quantile of interest or estimate the…

统计方法学 · 统计学 2024-11-19 Joseph Feldman , Daniel Kowal