English
Related papers

Related papers: Composite quantile regression and the oracle Model…

200 papers

In the regression problem, L1 and L2 are the most commonly used loss functions, which produce mean predictions with different biases. However, the predictions are neither robust nor adequate enough since they only capture a few conditional…

Machine Learning · Computer Science 2019-11-14 Faen Zhang , Xinyu Fan , Hui Xu , Pengcheng Zhou , Yujian He , Junlong Liu

We present two innovative functional partial quantile regression algorithms designed to accurately and efficiently estimate the regression coefficient function within the function-on-function linear quantile regression model. Our algorithms…

Methodology · Statistics 2025-10-14 Muge Mutis , Ufuk Beyaztas , Filiz Karaman , Han Lin Shang

The Multi-Kink Quantile Regression (MKQR) model is an important tool for analyzing data with heterogeneous conditional distributions, especially when quantiles of response variable are of interest, due to its robustness to outliers and…

Methodology · Statistics 2020-06-16 Wei Zhong , Chuang Wan , Wenyang Zhang

The errors-in-variables (EIV) regression model, being more realistic by accounting for measurement errors in both the dependent and the independent variables, is widely adopted in applied sciences. The traditional EIV model estimators,…

Methodology · Statistics 2015-08-13 Hao Han , Wei Zhu

This paper proposes a new objective function and quantile regression (QR) algorithm for load forecasting (LF). In LF, the positive forecasting errors often have different economic impact from the negative forecasting errors. Considering…

Applications · Statistics 2017-03-21 Hossein Sangrody , Ning Zhou

Symbolic Regression (SR) is a well-established framework for generating interpretable or white-box predictive models. Although SR has been successfully applied to create interpretable estimates of the average of the outcome, it is currently…

Machine Learning · Computer Science 2026-05-19 Cas Oude Hoekstra , Floris den Hengst

Uncertainty quantification (UQ) is essential for safe deployment of generative AI models such as large language models (LLMs), especially in high stakes applications. Conformal prediction (CP) offers a principled uncertainty quantification…

Machine Learning · Computer Science 2025-06-09 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani

Spline quantile regression (SQR) is a method introduced recently by Li and Megiddo (2026) for linear quantile regression where the regression coefficients are treated as smooth functions of the quantile level. With the coefficients…

Methodology · Statistics 2026-03-25 Ta-Hsin Li

Quantile regression (QR) is a principal regression method for analyzing the impact of covariates on outcomes. The impact is described by the conditional quantile function and its functionals. In this paper we develop the nonparametric…

We address the Least Quantile of Squares (LQS) (and in particular the Least Median of Squares) regression problem using modern optimization methods. We propose a Mixed Integer Optimization (MIO) formulation of the LQS problem which allows…

Computation · Statistics 2014-11-20 Dimitris Bertsimas , Rahul Mazumder

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

Statistics Theory · Mathematics 2008-12-18 Arijit Chakrabarti , Tapas Samanta

Multi-fidelity methods that use an ensemble of models to compute a Monte Carlo estimator of the expectation of a high-fidelity model can significantly reduce computational costs compared to single-model approaches. These methods use oracle…

Computation · Statistics 2026-03-12 Thomas Dixon , Alex Gorodetsky , John Jakeman , Akil Narayan , Yiming Xu

In this article, we present a novel approach to multivariate probabilistic forecasting. Our approach is based on an extension of single-output quantile regression (QR) to multivariate-targets, called quantile surfaces (QS). QS uses a simple…

Applications · Statistics 2020-10-13 Maarten Bieshaar , Jens Schreiber , Stephan Vogt , André Gensler , Bernhard Sick

As computer resources become increasingly limited, traditional statistical methods face challenges in analyzing massive data, especially in functional data analysis. To address this issue, subsampling offers a viable solution by…

Methodology · Statistics 2024-07-01 Jingxiang Pan , Xiaohui Yuan , Xiaohui Yuan

This paper studies the inference problem in quantile regression (QR) for a large sample size $n$ but under a limited memory constraint, where the memory can only store a small batch of data of size $m$. A natural method is the na\"ive…

Methodology · Statistics 2021-11-15 Xi Chen , Weidong Liu , Yichen Zhang

We derive oracle inequalities for the problems of isotonic and convex regression using the combination of $Q$-aggregation procedure and sparsity pattern aggregation. This improves upon the previous results including the oracle inequalities…

Statistics Theory · Mathematics 2015-10-01 Pierre C. Bellec , Alexandre B. Tsybakov

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

Methodology · Statistics 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri

Quantile Regression (QR) provides a way to approximate a single conditional quantile. To have a more informative description of the conditional distribution, QR can be merged with deep learning techniques to simultaneously estimate multiple…

Machine Learning · Computer Science 2022-02-01 Axel Brando , Joan Gimeno , Jose A. Rodríguez-Serrano , Jordi Vitrià

Simplicial-simplicial regression refers to the regression setting where both the responses and predictor variables lie within the simplex space, i.e. they are compositional. For this setting, constrained least squares, where the regression…

Methodology · Statistics 2024-12-24 Michail Tsagris

It is shown that the the popular least squares method of option pricing converges even under very general assumptions. This substantially increases the freedom of creating different implementations of the method, with varying levels of…

Computational Finance · Quantitative Finance 2015-11-18 Maciej Klimek , Marcin Pitera