English
Related papers

Related papers: Fused LASSO as Non-Crossing Quantile Regression

200 papers

When developing risk prediction models, shrinkage methods are recommended, especially when the sample size is limited. Several earlier studies have shown that the shrinkage of model coefficients can reduce overfitting of the prediction…

Methodology · Statistics 2019-07-29 Ben Van Calster , Maarten van Smeden , Ewout W. Steyerberg

The paper considers a linear regression model in high-dimension for which the predictive variables can change the influence on the response variable at unknown times (called change-points). Moreover, the particular case of the heavy-tailed…

Statistics Theory · Mathematics 2013-07-03 Gabriela Ciuperca

The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full control over the…

Quantile regression is an effective technique to quantify uncertainty, fit challenging underlying distributions, and often provide full probabilistic predictions through joint learnings over multiple quantile levels. A common drawback of…

Machine Learning · Computer Science 2022-02-24 Youngsuk Park , Danielle Maddix , François-Xavier Aubet , Kelvin Kan , Jan Gasthaus , Yuyang Wang

This paper addresses the challenge of integrating sequentially arriving data within the quantile regression framework, where the number of features is allowed to grow with the number of observations, the horizon is unknown, and memory is…

Statistics Theory · Mathematics 2025-10-21 Yinan Shen , Dong Xia , Wen-Xin Zhou

In this study, we consider preliminary test and shrinkage estimation strategies for quantile regression models. In classical Least Squares Estimation (LSE) method, the relationship between the explanatory and explained variables in the…

Statistics Theory · Mathematics 2017-09-07 Bahadır Yüzbaşı , Yasin Asar , M. Şamil Şık , Ahmet Demiralp

The fused lasso, also known as total-variation denoising, is a locally-adaptive function estimator over a regular grid of design points. In this paper, we extend the fused lasso to settings in which the points do not occur on a regular…

Methodology · Statistics 2019-07-09 Oscar Hernan Madrid Padilla , James Sharpnack , Yanzhen Chen , Daniela M. Witten

A multivariate quantile regression model with a factor structure is proposed to study data with many responses of interest. The factor structure is allowed to vary with the quantile levels, which makes our framework more flexible than the…

Methodology · Statistics 2020-01-22 Shih-Kang Chao , Wolfgang Karl Härdle , Ming Yuan

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

Econometrics · Economics 2024-01-17 Ziwei Mei , Zhentao Shi

Causal inference in modern largescale systems faces growing challenges, including highdimensional covariates, multi-valued treatments, massive observational (OBS) data, and limited randomized controlled trial (RCT) samples due to cost…

Methodology · Statistics 2026-02-27 Yuxi Du , Zhiheng Zhang , Haoxuan Li , Cong Fang , Jixing Xu , Peng Zhen , Jiecheng Guo

In the present paper we investigate the predictive risk of possibly misspecified quantile regression functions. The in-sample risk is well-known to be an overly optimistic estimate of the predictive risk and we provide two relatively simple…

Statistics Theory · Mathematics 2018-11-05 Alexander Giessing , Xuming He

Flexible estimation of multiple conditional quantiles is of interest in numerous applications, such as studying the effect of pregnancy-related factors on low and high birth weight. We propose a Bayesian non-parametric method to…

Methodology · Statistics 2021-10-22 Steven G. Xu , Brian J. Reich

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

Machine Learning · Statistics 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Quantile regression provides a framework for modeling statistical quantities of interest other than the conditional mean. The regression methodology is well developed for linear models, but less so for nonparametric models. We consider…

Statistics Theory · Mathematics 2009-09-29 Mi-Ok Kim

Quantile Regression (QR) provides a way to approximate a single conditional quantile. To have a more informative description of the conditional distribution, QR can be merged with deep learning techniques to simultaneously estimate multiple…

Machine Learning · Computer Science 2022-02-01 Axel Brando , Joan Gimeno , Jose A. Rodríguez-Serrano , Jordi Vitrià

We develop quantile regression models in order to derive risk margin and to evaluate capital in non-life insurance applications. By utilizing the entire range of conditional quantile functions, especially higher quantile levels, we detail…

Risk Management · Quantitative Finance 2014-02-12 Alice X. D. Dong , Jennifer S. K. Chan , Gareth W. Peters

Zero-inflated explanatory variables are common in fields such as ecology and finance. In this paper we address the problem of having excess of zero values in some explanatory variables which are subject to multioutcome lasso-regularized…

Methodology · Statistics 2021-09-13 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

Quantile regression is a powerful data analysis tool that accommodates heterogeneous covariate-response relationships. We find that by coupling the asymmetric Laplace working likelihood with appropriate shrinkage priors, we can deliver…

Methodology · Statistics 2021-11-02 Yuanzhi Li , Xuming He

Modern approaches to perform Bayesian variable selection rely mostly on the use of shrinkage priors. That said, an ideal shrinkage prior should be adaptive to different signal levels, ensuring that small effects are ruled out, while keeping…

Methodology · Statistics 2024-11-14 Santiago Marin , Bronwyn Loong , Anton H. Westveld

LASSO inflicts shrinkage bias on estimated coefficients, which undermines asymptotic normality and invalidates standard inferential procedures based on the t-statistic. Given cross sectional data, the desparsified LASSO has emerged as a…

Methodology · Statistics 2026-04-21 Zhan Gao , Ji Hyung Lee , Ziwei Mei , Zhentao Shi