English
Related papers

Related papers: Composite Quantile Regression With XGBoost Using t…

200 papers

Due to the dynamic nature of financial markets, maintaining models that produce precise predictions over time is difficult. Often the goal isn't just point prediction but determining uncertainty. Quantifying uncertainty, especially the…

Machine Learning · Statistics 2024-08-06 Mingshu Li , Bhaskarjit Sarmah , Dhruv Desai , Joshua Rosaler , Snigdha Bhagat , Philip Sommer , Dhagash Mehta

Forecast combination methods have traditionally emphasized symmetric loss functions, particularly squared error loss, with equally weighted combinations often justified as a robust approach under such criteria. However, these justifications…

Methodology · Statistics 2025-04-08 Henry D. van Eijk , Sujit K. Ghosh

This paper considers the problem of nonparametric quantile regression under the assumption that the target conditional quantile function is a composition of a sequence of low-dimensional functions. We study the nonparametric quantile…

Statistics Theory · Mathematics 2021-08-03 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Joel L. Horowitz , Jian Huang

Quantile regression is a fundamental tool for distributional learning but poses significant optimization challenges for deep models due to the non-smoothness of the pinball loss. We propose ConquerNet, a class of…

Machine Learning · Statistics 2026-05-08 Tianpai Luo , Fangwei Wu , Weichi Wu

The widespread use of quantile regression methods depends crucially on the existence of fast algorithms. Despite numerous algorithmic improvements, the computation time is still non-negligible because researchers often estimate many…

Econometrics · Economics 2020-04-08 Victor Chernozhukov , Iván Fernández-Val , Blaise Melly

We introduce a variational algorithm based on the quantum alternating operator ansatz (QAOA) for the approximate solution of computationally hard counting problems. Our algorithm, dubbed VQCount, is based on the equivalence between random…

Quantum Physics · Physics 2026-04-16 Julien Drapeau , Shreya Banerjee , Stefanos Kourtis

Forecasting revenues by aggregating analyst forecasts is a fundamental problem in financial research and practice. A key objective in this context is to improve the accuracy of the forecast by optimizing two performance metrics: the hit…

Methodology · Statistics 2025-03-27 Henry D. van Eijk , Sujit K. Ghosh

In the field of high-dimensional data analysis, modeling methods based on quantile loss function are highly regarded due to their ability to provide a comprehensive statistical perspective and effective handling of heterogeneous data. In…

Computation · Statistics 2025-01-14 Xiaofei Wu , Dingzi Guo , Rongmei Liang , Zhimin Zhang

Local regression is widely used to explore spatial heterogeneity, but anisotropic or effectively low-dimensional neighborhoods can produce ill-conditioned local solves, causing coefficient variation driven by numerical artifacts rather than…

Methodology · Statistics 2026-03-31 Yuichiro Otani

A composite likelihood is an inference function derived by multiplying a set of likelihood components. This approach provides a flexible framework for drawing inference when the likelihood function of a statistical model is computationally…

Methodology · Statistics 2024-12-10 Giuseppe Alfonzetti , Ruggero Bellio , Yunxiao Chen , Irini Moustaki

Binary optimization is a fundamental area in computational science, with wide-ranging applications from logistics to cryptography, where the tasks are often formulated as Quadratic or Polynomial Unconstrained Binary Optimization problems…

Quantum Physics · Physics 2024-12-20 Jean Cazalis , Tirth Shah , Yahui Chai , Karl Jansen , Stefan Kühn

Count data frequently arises in biomedical applications, such as the length of hospital stay. However, their discrete nature poses significant challenges for appropriately modeling conditional quantiles, which are crucial for understanding…

Methodology · Statistics 2025-07-28 Yuta Yamauchi , Genya Kobayashi , Shonosuke Sugasawa

This paper considers estimation and model selection of quantile vector autoregression (QVAR). Conventional quantile regression often yields undesirable crossing quantile curves, violating the monotonicity of quantiles. To address this…

Methodology · Statistics 2026-03-02 Tomohiro Ando , Tadao Hoshino , Ruey Tsay

In this paper, we propose a novel perturbation-based exploration method in bandit algorithms with bounded or unbounded rewards, called residual bootstrap exploration (\texttt{ReBoot}). The \texttt{ReBoot} enforces exploration by injecting…

Machine Learning · Statistics 2020-02-21 Chi-Hua Wang , Yang Yu , Botao Hao , Guang Cheng

In many applications of supervised learning, multiple classification or regression outputs have to be predicted jointly. We consider several extensions of gradient boosting to address such problems. We first propose a straightforward…

Machine Learning · Statistics 2019-05-21 Arnaud Joly , Louis Wehenkel , Pierre Geurts

We propose a soft gradient boosting framework for sequential regression that embeds a learnable linear feature transform within the boosting procedure. At each boosting iteration, we train a soft decision tree and learn a linear input…

Machine Learning · Computer Science 2025-09-17 Huseyin Karaca , Suleyman Serdar Kozat

With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in explainable AI. They are used for feature attribution, data attribution, data valuation, and more.…

Machine Learning · Computer Science 2026-01-14 R. Teal Witter , Yurong Liu , Christopher Musco

Quantile is a popular performance measure for a stochastic system to evaluate its variability and risk. To reduce the risk, selecting the actions that minimize the tail quantiles of some loss distributions is typically of interest for…

Optimization and Control · Mathematics 2019-01-18 Songhao Wang , Szu Hui Ng , William Benjamin Haskell

Recent papers have used machine learning architecture to fit low-order functional ANOVA models with main effects and second-order interactions. These GAMI (GAM + Interaction) models are directly interpretable as the functional main effects…

Machine Learning · Statistics 2023-09-06 Linwei Hu , Soroush Aramideh , Jie Chen , Vijayan N. Nair

Gradient boosted trees are competition-winning, general-purpose, non-parametric regressors, which exploit sequential model fitting and gradient descent to minimize a specific loss function. The most popular implementations are tailored to…

Machine Learning · Computer Science 2022-08-23 Lorenzo Nespoli , Vasco Medici