English
Related papers

Related papers: Semi-parametric bulk and tail regression using spl…

200 papers

We propose a penalized nonparametric approach to estimating the quantile regression process (QRP) in a nonseparable model using rectifier quadratic unit (ReQU) activated deep neural networks and introduce a novel penalty function to enforce…

Machine Learning · Statistics 2022-07-22 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Joel L. Horowitz , Jian Huang

The mean-variance portfolio model, based on the risk-return trade-off for optimal asset allocation, remains foundational in portfolio optimization. However, its reliance on restrictive assumptions about asset return distributions limits its…

Portfolio Management · Quantitative Finance 2025-04-17 Savita Pareek , Sujit K. Ghosh

The most popular approach in extreme value statistics is the modelling of threshold exceedances using the asymptotically motivated generalised Pareto distribution. This approach involves the selection of a high threshold above which the…

Methodology · Statistics 2014-05-27 Ioannis Papastathopoulos , Jonathan A. Tawn

Growth charts are often more informative when they are customized per subject, taking into account prior measurements and possibly other covariates of the subject. We study a global semiparametric quantile regression model that has the…

Statistics Theory · Mathematics 2007-06-13 Ying Wei , Xuming He

Offline reinforcement learning (RL) enables policy learning from fixed datasets without further environment interaction, making it particularly valuable in high-risk or costly domains. Extreme $Q$-Learning (XQL) is a recent offline RL…

Machine Learning · Computer Science 2026-04-15 Xinming Gao , Shangzhe Li , Yujin Cai , Wenwu Yu

In this work, we propose a deep learning-based method to perform semiparametric regression analysis for spatially dependent data. To be specific, we use a sparsely connected deep neural network with rectified linear unit (ReLU) activation…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Jun Zhu , Anthony R. Ives , Volker C. Radeloff , Fangfang Wang

In modern scientific applications, large volumes of covariate data are readily available, while outcome labels are costly, sparse, and often subject to distribution shift. This asymmetry has spurred interest in semi-supervised (SS)…

Statistics Theory · Mathematics 2026-05-12 Lorenzo Testa , Qi Xu , Jing Lei , Kathryn Roeder

In real data analysis, the underlying model is usually unknown, modelling strategy plays a key role in the success of data analysis. Stimulated by the idea of model averaging, we propose a novel semiparametric modelling strategy for…

Methodology · Statistics 2022-03-21 Chaohui Guo , Wenyang Zhang

Coefficient estimation and variable selection in multiple linear regression is routinely done in the (penalized) least squares (LS) framework. The concept of model selection oracle introduced by Fan and Li [J. Amer. Statist. Assoc. 96…

Statistics Theory · Mathematics 2008-12-18 Hui Zou , Ming Yuan

The Generalized Pareto Distribution (GPD) plays a central role in modelling heavy tail phenomena in many applications. Applying the GPD to actual datasets however is a non-trivial task. One common way suggested in the literature to…

Statistics Theory · Mathematics 2017-08-08 Se Yoon Lee , Joseph H. T. Kim

Recently some papers, such as Aban, Meerschaert and Panorska (2006), Nuyts (2010) and Clark (2013), have drawn attention to possible truncation in Pareto tail modelling. Sometimes natural upper bounds exist that truncate the probability…

Statistics Theory · Mathematics 2015-05-21 Jan Beirlant , Isabel Fraga Alves , Ivette Gomes

Extreme quantile treatment effects (eQTEs) measure the causal impact of a treatment on the tails of an outcome distribution and are central for studying rare, high-impact events. Standard QTE methods often fail in extreme regimes due to…

Methodology · Statistics 2026-03-25 Mengran Li , Daniela Castro-Camilo

It has repeatedly been observed that loss minimization by stochastic gradient descent (SGD) leads to heavy-tailed distributions of neural network parameters. Here, we analyze a continuous diffusion approximation of SGD, called homogenized…

Machine Learning · Statistics 2024-02-05 Zhe Jiao , Martin Keller-Ressel

In this article, we present a novel approach to multivariate probabilistic forecasting. Our approach is based on an extension of single-output quantile regression (QR) to multivariate-targets, called quantile surfaces (QS). QS uses a simple…

Applications · Statistics 2020-10-13 Maarten Bieshaar , Jens Schreiber , Stephan Vogt , André Gensler , Bernhard Sick

Alleviating overestimation bias is a critical challenge for deep reinforcement learning to achieve successful performance on more complex tasks or offline datasets containing out-of-distribution data. In order to overcome overestimation…

Machine Learning · Computer Science 2024-01-09 Dohyeok Lee , Seungyub Han , Taehyun Cho , Jungwoo Lee

We present two innovative functional partial quantile regression algorithms designed to accurately and efficiently estimate the regression coefficient function within the function-on-function linear quantile regression model. Our algorithms…

Methodology · Statistics 2025-10-14 Muge Mutis , Ufuk Beyaztas , Filiz Karaman , Han Lin Shang

This paper presents a novel probabilistic forecasting method called ensemble conformalized quantile regression (EnCQR). EnCQR constructs distribution-free and approximately marginally valid prediction intervals (PIs), which are suitable for…

Machine Learning · Computer Science 2022-11-08 Vilde Jensen , Filippo Maria Bianchi , Stian Norman Anfinsen

In this paper we propose a semiparametric spatial autoregressive model that combines a linear covariate component with a nonparametrically estimated spatial term, allowing flexible dependence modeling without restrictive covariance…

Methodology · Statistics 2026-04-30 Rodrigo García Arancibia , Pamela Llop , Mariel Lovatto

While stochastic gradient descent (SGD) is one of the major workhorses in machine learning, the learning properties of many practically used variants are poorly understood. In this paper, we consider least squares learning in a…

Machine Learning · Statistics 2019-05-28 Nicole Mücke , Gergely Neu , Lorenzo Rosasco

The relationship between a response variable and its covariates can vary significantly, especially in scenarios where covariates take on extremely high or low values. This paper introduces a max-linear tail regression model specifically…

Methodology · Statistics 2025-02-24 Liujun Chen , Deyuan Li , Zhengjun Zhang