English
Related papers

Related papers: Scalable Ultra-High-Dimensional Quantile Regressio…

200 papers

Quantile regression (QR) relies on the estimation of conditional quantiles and explores the relationships between independent and dependent variables. At high probability levels, classical QR methods face extrapolation difficulties due to…

Statistics Theory · Mathematics 2026-04-16 Lucien M. Vidagbandji , Alexandre Berred , Cyrille Bertelle , Laurent Amanton

Quantile Regression (QR) can be used to estimate aleatoric uncertainty in deep neural networks and can generate prediction intervals. Quantifying uncertainty is particularly important in critical applications such as clinical diagnosis,…

Machine Learning · Computer Science 2023-09-15 Haleh Akrami , Omar Zamzam , Anand Joshi , Sergul Aydore , Richard Leahy

Quantile regression (QR) is becoming increasingly popular due to its relevance in many scientific investigations. There is a great amount of work about linear and nonlinear QR models. Specifically, nonparametric estimation of the…

Methodology · Statistics 2020-01-13 Eliana Christou

Quantile regression is a powerful tool capable of offering a richer view of the data as compared to least-squares regression. Quantile regression is typically performed individually on a few quantiles or a grid of quantiles without…

Methodology · Statistics 2026-03-26 Ta-Hsin Li , Nimrod Megiddo

Censored quantile regression (CQR) has become a valuable tool to study the heterogeneous association between a possibly censored outcome and a set of covariates, yet computation and statistical inference for CQR have remained a challenge…

Statistics Theory · Mathematics 2022-10-25 Xuming He , Xiaoou Pan , Kean Ming Tan , Wen-Xin Zhou

Quantile regression is a powerful tool for robust and heterogeneous learning that has seen applications in a diverse range of applied areas. However, its broader application is often hindered by the substantial computational demands arising…

Machine Learning · Statistics 2025-08-13 Qian Tang , Yuwen Gu , Boxiang Wang

Random Projection (RP) technique has been widely applied in many scenarios because it can reduce high-dimensional features into low-dimensional space within short time and meet the need of real-time analysis of massive data. There is an…

Machine Learning · Computer Science 2017-06-20 Haozhe Xie , Jie Li , Qiaosheng Zhang , Yadong Wang

We consider the problem of conformal prediction under covariate shift. Given labeled data from a source domain and unlabeled data from a covariate shifted target domain, we seek to construct prediction sets with valid marginal coverage in…

Machine Learning · Statistics 2025-07-02 Sunay Joshi , Shayan Kiyani , George Pappas , Edgar Dobriban , Hamed Hassani

We propose a penalized nonparametric approach to estimating the quantile regression process (QRP) in a nonseparable model using rectifier quadratic unit (ReQU) activated deep neural networks and introduce a novel penalty function to enforce…

Machine Learning · Statistics 2022-07-22 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Joel L. Horowitz , Jian Huang

We propose a nonparametric quantile regression method using deep neural networks with a rectified linear unit penalty function to avoid quantile crossing. This penalty function is computationally feasible for enforcing non-crossing…

Machine Learning · Statistics 2022-10-20 Wenlu Tang , Guohao Shen , Yuanyuan Lin , Jian Huang

Quantile regression (QR) is a statistical tool for distribution-free estimation of conditional quantiles of a target variable given explanatory features. QR is limited by the assumption that the target distribution is univariate and defined…

Recent methods in quantile regression have adopted a classification perspective to handle challenges posed by heteroscedastic, multimodal, or skewed data by quantizing outputs into fixed bins. Although these regression-as-classification…

Machine Learning · Computer Science 2024-11-05 Batuhan Cengiz , Halil Faruk Karagoz , Tufan Kumbasar

Distributed sensors in the internet-of-things (IoT) generate vast amounts of sparse data. Analyzing this high-dimensional data and identifying relevant predictors pose substantial challenges, especially when data is preferred to remain on…

Machine Learning · Computer Science 2024-08-14 Reza Mirzaeifard , Diyako Ghaderyan , Stefan Werner

Due to the dynamic nature of financial markets, maintaining models that produce precise predictions over time is difficult. Often the goal isn't just point prediction but determining uncertainty. Quantifying uncertainty, especially the…

Machine Learning · Statistics 2024-08-06 Mingshu Li , Bhaskarjit Sarmah , Dhruv Desai , Joshua Rosaler , Snigdha Bhagat , Philip Sommer , Dhagash Mehta

Recurrent neural networks are a powerful tool for modeling sequential data, but the dependence of each timestep's computation on the previous timestep's output limits parallelism and makes RNNs unwieldy for very long sequences. We introduce…

Neural and Evolutionary Computing · Computer Science 2016-11-22 James Bradbury , Stephen Merity , Caiming Xiong , Richard Socher

Correlation among the observations in high-dimensional regression modeling can be a major source of confounding. We present a new open-source package, plmmr, to implement penalized linear mixed models in R. This R package estimates…

Computation · Statistics 2026-05-13 Tabitha K. Peter , Anna C. Reisetter , Yujing Lu , Oscar A. Rysavy , Patrick J. Breheny

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

This paper considers doing quantile regression on censored data using neural networks (NNs). This adds to the survival analysis toolkit by allowing direct prediction of the target variable, along with a distribution-free characterisation of…

Machine Learning · Statistics 2023-02-07 Tim Pearce , Jong-Hyeon Jeong , Yichen Jia , Jun Zhu

Kernel methods are powerful and flexible approach to solve many problems in machine learning. Due to the pairwise evaluations in kernel methods, the complexity of kernel computation grows as the data size increases; thus the applicability…

Machine Learning · Computer Science 2017-11-28 Bharath Bhushan Damodaran , Nicolas Courty , Philippe-Henri Gosselin

We address the problem of how to achieve optimal inference in distributed quantile regression without stringent scaling conditions. This is challenging due to the non-smooth nature of the quantile regression (QR) loss function, which…

Methodology · Statistics 2022-08-24 Kean Ming Tan , Heather Battey , Wen-Xin Zhou