English
Related papers

Related papers: SETAR-Tree: A Novel and Accurate Tree Algorithm fo…

200 papers

Tree kernels have been proposed to be used in many areas as the automatic learning of natural language applications. In this paper, we propose a new linear time algorithm based on the concept of weighted tree automata for SubTree kernel…

Computation and Language · Computer Science 2023-02-03 Ludovic Mignot , Faissal Ouardi , Djelloul Ziadi

Although regression trees were originally designed for large datasets, they can profitably be used on small datasets as well, including those from replicated or unreplicated complete factorial experiments. We show that in the latter…

Statistics Theory · Mathematics 2007-06-13 Wei-Yin Loh

This paper develops a novel stochastic tree ensemble method for nonlinear regression, which we refer to as XBART, short for Accelerated Bayesian Additive Regression Trees. By combining regularization and stochastic search strategies from…

Machine Learning · Statistics 2021-06-04 Jingyu He , P. Richard Hahn

In prediction of forest parameters with data from remote sensing (RS), regression models have traditionally been trained on a small sample of ground reference data. This paper proposes to impute this sample of true prediction targets with…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Sara Björk , Stian N. Anfinsen , Michael Kampffmeyer , Erik Næsset , Terje Gobakken , Lennart Noordermeer

Vector autoregressive (VAR) models assume linearity between the endogenous variables and their lags. This assumption might be overly restrictive and could have a deleterious impact on forecasting accuracy. As a solution, we propose…

Econometrics · Economics 2021-03-10 Florian Huber , Luca Rossini

Decision trees are widely used for non-linear modeling, as they capture interactions between predictors while producing inherently interpretable models. Despite their popularity, performing inference on the non-linear fit remains largely…

Methodology · Statistics 2026-04-14 Soham Bakshi , Snigdha Panigrahi

Regression trees are one of the oldest forms of AI models, and their predictions can be made without a calculator, which makes them broadly useful, particularly for high-stakes applications. Within the large literature on regression trees,…

Machine Learning · Computer Science 2023-04-11 Rui Zhang , Rui Xin , Margo Seltzer , Cynthia Rudin

In the fight against hard-to-treat diseases such as cancer, it is often difficult to discover new treatments that benefit all subjects. For regulatory agency approval, it is more practical to identify subgroups of subjects for whom the…

Methodology · Statistics 2014-10-09 Wei-Yin Loh , Xu He , Michael Man

Regression models for supervised learning problems with a continuous target are commonly understood as models for the conditional mean of the target given predictors. This notion is simple and therefore appealing for interpretation and…

Methodology · Statistics 2018-01-09 Torsten Hothorn , Achim Zeileis

This paper studies Time Series Extrinsic Regression (TSER): a regression task of which the aim is to learn the relationship between a time series and a continuous scalar variable; a task closely related to time series classification (TSC),…

Machine Learning · Computer Science 2021-02-04 Chang Wei Tan , Christoph Bergmeir , Francois Petitjean , Geoffrey I. Webb

Decision trees and their ensembles are popular in machine learning as easy-to-understand models. Several techniques have been proposed in the literature for learning tree-based classifiers, with different techniques working well for data…

Machine Learning · Computer Science 2025-05-20 Maria-Florina Balcan , Dravyansh Sharma

Model-free forecasting of the temporal evolution of chaotic systems is crucial but challenging. Existing solutions require hyperparameter tuning, significantly hindering their wider adoption. In this work, we introduce a tree-based approach…

Machine Learning · Computer Science 2025-07-04 Adam Giammarese , Kamal Rana , Erik M. Bollt , Nishant Malik

Dual-tree algorithms are a widely used class of branch-and-bound algorithms. Unfortunately, developing dual-tree algorithms for use with different trees and problems is often complex and burdensome. We introduce a four-part logical split:…

Data Structures and Algorithms · Computer Science 2013-04-17 Ryan R. Curtin , William B. March , Parikshit Ram , David V. Anderson , Alexander G. Gray , Charles L. Isbell

Several structure-learning algorithms for staged trees, asymmetric extensions of Bayesian networks, have been proposed. However, these either do not scale efficiently as the number of variables considered increases, a priori restrict the…

Methodology · Statistics 2022-11-15 Peter Strong , Jim Q. Smith

Tree-based models are widely recognized for their interpretability and have proven effective in various application domains, particularly in high-stakes domains. However, learning decision trees (DTs) poses a significant challenge due to…

Machine Learning · Computer Science 2026-03-13 Sascha Marton

Forecasting is critical in areas such as finance, biology, and healthcare. Despite the progress in the field, making accurate forecasts remains challenging because real-world time series contain both global trends, local fine-grained…

Machine Learning · Computer Science 2026-01-01 Zihao Chen , Alexandre Andre , Wenrui Ma , Ian Knight , Sergey Shuvaev , Eva Dyer

Battery performance datasets are typically non-normal and multicollinear. Extrapolating such datasets for model predictions needs attention to such characteristics. This study explores the impact of data normality in building machine…

Machine Learning · Computer Science 2021-11-05 Shovan Chowdhury , Yuxiao Lin , Boryann Liaw , Leslie Kerby

Connected acyclic graphs (trees) are data objects that hierarchically organize categories. Collections of trees arise in a diverse variety of fields, including evolutionary biology, public health, machine learning, social sciences and…

Methodology · Statistics 2025-12-01 Maria Alejandra Valdez Cabrera , Amy D Willis , Armeen Taeb

Regression tree (RT) has been widely used in machine learning and data mining community. Given a target data for prediction, a regression tree is first constructed based on a training dataset before making prediction for each leaf node. In…

Machine Learning · Computer Science 2020-10-22 Xingchun Xiang , Qingtao Tang , Huaixuan Zhang , Tao Dai , Jiawei Li , Shu-Tao Xia

Merging satellite products and ground-based measurements is often required for obtaining precipitation datasets that simultaneously cover large regions with high density and are more accurate than pure satellite precipitation products.…

Machine Learning · Computer Science 2023-03-06 Georgia Papacharalampous , Hristos Tyralis , Anastasios Doulamis , Nikolaos Doulamis