English
Related papers

Related papers: Time series quantile regression using random fores…

200 papers

A random forest is a popular tool for estimating probabilities in machine learning classification tasks. However, the means by which this is accomplished is unprincipled: one simply counts the fraction of trees in a forest that vote for a…

Machine Learning · Statistics 2018-12-17 Matthew A. Olson , Abraham J. Wyner

Classification and Regression Tree (CART), Random Forest (RF) and Gradient Boosting Tree (GBT) are probably the most popular set of statistical learning methods. However, their statistical consistency can only be proved under very…

Statistics Theory · Mathematics 2025-02-17 Haoran Zhan , Yu Liu , Yingcun Xia

Random Feature (RF) models are used as efficient parametric approximations of kernel methods. We investigate, by means of random matrix theory, the connection between Gaussian RF models and Kernel Ridge Regression (KRR). For a Gaussian RF…

Machine Learning · Statistics 2020-09-24 Arthur Jacot , Berfin Şimşek , Francesco Spadaro , Clément Hongler , Franck Gabriel

Wind speed forecasting models and their application to wind farm operations are attaining remarkable attention in the literature because of its benefits as a clean energy source. In this paper, we suggested the time series machine learning…

Machine Learning · Computer Science 2022-03-29 G. V. Drisya , Valsaraj P. , K. Asokan , K. Satheesh Kumar

Regression trees are a popular machine learning algorithm that fit piecewise constant models by recursively partitioning the predictor space. This paper focuses on statistical inference for a data-dependent model obtained from a fitted…

Methodology · Statistics 2025-12-17 Soham Bakshi , Yiling Huang , Snigdha Panigrahi , Walter Dempsey

Quantile Regression Forests (QRF) are widely used for non-parametric conditional quantile estimation, yet statistical inference for variable importance measures remains challenging due to the non-smoothness of the loss function and the…

Machine Learning · Statistics 2025-12-01 Tomoshige Nakamura , Hiroshi Shiraishi

Random forest regression is a powerful non-parametric method that adapts to local data characteristics through data-driven partitioning, making it effective across diverse application domains. However, the piecewise constant nature of…

Machine Learning · Computer Science 2026-05-19 Ziyi Liu , Phuc Luong , Mario Boley , Daniel F. Schmidt

We propose a time series forecasting method named Quantum Gramian Angular Field (QGAF). This approach merges the advantages of quantum computing technology with deep learning, aiming to enhance the precision of time series classification…

Machine Learning · Computer Science 2023-12-12 Zhengmeng Xu , Yujie Wang , Xiaotong Feng , Yilin Wang , Yanli Li , Hai Lin

This paper proposes a novel conditional heteroscedastic time series model by applying the framework of quantile regression processes to the ARCH(\infty) form of the GARCH model. This model can provide varying structures for conditional…

Methodology · Statistics 2023-11-14 Qianqian Zhu , Songhua Tan , Yao Zheng , Guodong Li

We propose a novel method designed for large-scale regression problems, namely the two-stage best-scored random forest (TBRF). "Best-scored" means to select one regression tree with the best empirical performance out of a certain number of…

Machine Learning · Statistics 2019-05-10 Hanyuan Hang , Yingyi Chen , Johan A. K. Suykens

Classification is essential to the applications in the field of data mining, artificial intelligence, and fault detection. There exists a strong need in developing accurate, suitable, and efficient classification methods and algorithms with…

Artificial Intelligence · Computer Science 2024-03-19 Yingtao Ren , Xiaomin Zhu , Kaiyuan Bai , Runtong Zhang

Since survival data occur over time, often important covariates that we wish to consider also change over time. Such covariates are referred as time-dependent covariates. Quantile regression offers flexible modeling of survival data by…

Methodology · Statistics 2014-05-01 Malka Gorfine , Yair Goldberg , Yaacov Ritov

Random forests remain among the most popular off-the-shelf supervised machine learning tools with a well-established track record of predictive accuracy in both regression and classification settings. Despite their empirical success as well…

Machine Learning · Statistics 2020-09-15 Lucas Mentch , Siyu Zhou

Kernel Induced Random Survival Forests (KIRSF) is a statistical learning algorithm which aims to improve prediction accuracy for survival data. As in Random Survival Forests (RSF), Cumulative Hazard Function is predicted for each individual…

Machine Learning · Statistics 2010-08-25 Fang Yang , Jiheng Wang , Guangzhe Fan

The quantile residual lifetime (QRL) regression is an attractive tool for assessing covariate effects on the distribution of residual life expectancy, which is often of interest in clinical studies. When the study subjects are exposed to…

Methodology · Statistics 2025-03-04 Tonghui Yu , Liming Xiang , Jong-Hyeon Jeong

Age estimation from facial images is typically cast as a nonlinear regression problem. The main challenge of this problem is the facial feature space w.r.t. ages is heterogeneous, due to the large variation in facial appearance across…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Wei Shen , Yilu Guo , Yan Wang , Kai Zhao , Bo Wang , Alan Yuille

Forecasting models that are trained across sets of many time series, known as Global Forecasting Models (GFM), have shown recently promising results in forecasting competitions and real-world applications, outperforming many…

Machine Learning · Computer Science 2020-08-07 Kasun Bandara , Hansika Hewamalage , Yuan-Hao Liu , Yanfei Kang , Christoph Bergmeir

Random forests remain among the most popular off-the-shelf supervised learning algorithms. Despite their well-documented empirical success, however, until recently, few theoretical results were available to describe their performance and…

Machine Learning · Statistics 2021-11-17 Wei Peng , Tim Coleman , Lucas Mentch

Fairness of classification and regression has received much attention recently and various, partially non-compatible, criteria have been proposed. The fairness criteria can be enforced for a given classifier or, alternatively, the data can…

Machine Learning · Statistics 2019-11-18 Drago Plečko , Nicolai Meinshausen

Modern decision-making processes require uncertainty-aware models, especially those relying on non-symmetric costs and risk-averse profiles. The objective of this work is to propose a dynamic model for the conditional non-parametric…

Applications · Statistics 2021-02-18 Marcelo Ruas , Alexandre Street , Cristiano Fernandes