English
Related papers

Related papers: Quantile Regression by Dyadic CART

200 papers

In recent years, a CRA (Credit Risk Analysis) quantum algorithm with a quadratic speedup over classical analogous methods has been introduced. We propose a new variant of this quantum algorithm with the intent of overcoming some of the most…

Emerging Technologies · Computer Science 2022-12-21 Emanuele Dri , Edoardo Giusto , Antonello Aita , Bartolomeo Montrucchio

Quantile regression is a method to estimate the quantiles of the conditional distribution of a response variable, and as such it permits a much more accurate portrayal of the relationship between the response variable and observed…

Data Structures and Algorithms · Computer Science 2014-01-08 Jiyan Yang , Xiangrui Meng , Michael W. Mahoney

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression model that is commonly used in causal inference and beyond. Its strong predictive performance is supported by well-developed estimation theory,…

Machine Learning · Statistics 2026-02-10 Yan Shuo Tan , Omer Ronen , Theo Saarinen , Bin Yu

We propose a computationally efficient algorithm that achieves anytime regret of order $\mathcal{O}(\sqrt{t})$, with explicit dependence on the system dimensions and on the solution of the Discrete Algebraic Riccati Equation (DARE). Our…

Machine Learning · Statistics 2026-01-06 Jafar Abbaszadeh Chekan , Cedric Langbort

Quality-Diversity (QD) algorithms excel at discovering diverse repertoires of skills, but are hindered by poor sample efficiency and often require tens of millions of environment steps to solve complex locomotion tasks. Recent advances in…

Machine Learning · Computer Science 2026-04-23 Behrad Koohy , Jamie Bayne

We propose a penalized nonparametric approach to estimating the quantile regression process (QRP) in a nonseparable model using rectifier quadratic unit (ReQU) activated deep neural networks and introduce a novel penalty function to enforce…

Machine Learning · Statistics 2022-07-22 Guohao Shen , Yuling Jiao , Yuanyuan Lin , Joel L. Horowitz , Jian Huang

Quadratically regularized optimal transport (QOT) is an alternative to entropic regularization that yields sparse couplings and avoids numerical instabilities due to exponential scaling. From an optimization viewpoint, the dual QOT…

Optimization and Control · Mathematics 2026-05-27 Alberto González-Sanz , Marcel Nutz , Andrés Riveros Valdevenito

We develop early stopping rules for growing regression tree estimators. The fully data-driven stopping rule is based on monitoring the global residual norm. The best-first search and the breadth-first search algorithms together with linear…

Statistics Theory · Mathematics 2025-07-29 Ratmir Miftachov , Markus Reiß

Previous algorithms for constructing regression tree models for longitudinal and multiresponse data have mostly followed the CART approach. Consequently, they inherit the same selection biases and computational difficulties as CART. We…

Machine Learning · Statistics 2013-05-28 Wei-Yin Loh , Wei Zheng

We study nonlinear regression of real valued data in an individual sequence manner, where we provide results that are guaranteed to hold without any statistical assumptions. We address the convergence and undertraining issues of…

Machine Learning · Computer Science 2014-10-08 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

We consider conducting inference on the output of the Classification and Regression Tree (CART) [Breiman et al., 1984] algorithm. A naive approach to inference that does not account for the fact that the tree was estimated from the data…

Methodology · Statistics 2022-10-19 Anna C. Neufeld , Lucy L. Gao , Daniela M. Witten

We present a novel statistical approach to incorporating uncertainty awareness in model-free distributional reinforcement learning involving quantile regression-based deep Q networks. The proposed algorithm, $\textit{Calibrated Evidential…

Machine Learning · Computer Science 2024-06-05 Alex Christopher Stutts , Danilo Erricolo , Theja Tulabandhula , Amit Ranjan Trivedi

Accurate estimation of conditional average treatment effects (CATE) is at the core of personalized decision making. While there is a plethora of models for CATE estimation, model selection is a nontrivial task, due to the fundamental…

Machine Learning · Statistics 2025-04-29 Hui Lan , Vasilis Syrgkanis

The paper considers a linear regression model in high-dimension for which the predictive variables can change the influence on the response variable at unknown times (called change-points). Moreover, the particular case of the heavy-tailed…

Statistics Theory · Mathematics 2013-07-03 Gabriela Ciuperca

Algorithms for bandit convex optimization and online learning often rely on constructing noisy gradient estimates, which are then used in appropriately adjusted first-order algorithms, replacing actual gradients. Depending on the properties…

Machine Learning · Computer Science 2020-07-07 Xiaowei Hu , Prashanth L. A. , András György , Csaba Szepesvári

We present a quantum algorithm for fitting a linear regression model to a given data set using the least squares approach. Different from previous algorithms which yield a quantum state encoding the optimal parameters, our algorithm outputs…

Quantum Physics · Physics 2017-08-01 Guoming Wang

The problem of learning functions over spaces of probabilities - or distribution regression - is gaining significant interest in the machine learning community. A key challenge behind this problem is to identify a suitable representation…

Machine Learning · Statistics 2022-06-20 Dimitri Meunier , Massimiliano Pontil , Carlo Ciliberto

Quantile regression is an important tool for estimation of conditional quantiles of a response Y given a vector of covariates X. It can be used to measure the effect of covariates not only in the center of a distribution, but also in the…

Statistics Theory · Mathematics 2017-10-03 Victor Chernozhukov

The reliability of neural networks is essential for their use in safety-critical applications. Existing approaches generally aim at improving the robustness of neural networks to either real-world distribution shifts (e.g., common…

Machine Learning · Computer Science 2022-05-20 Leo Schwinn , Leon Bungert , An Nguyen , René Raab , Falk Pulsmeyer , Doina Precup , Björn Eskofier , Dario Zanca

Mission critical applications, such as UAV-assisted IoT networks require risk-aware decision-making under dynamic topologies and uncertain channels. We propose meta-conservative quantile regression (M-CQR), a meta-offline distributional…

Multiagent Systems · Computer Science 2026-04-23 Eslam Eldeeb , Hirley Alves