English
Related papers

Related papers: Growing Regression Forests by Classification: Appl…

200 papers

We introduce a differentiable clustering method based on stochastic perturbations of minimum-weight spanning forests. This allows us to include clustering in end-to-end trainable pipelines, with efficient gradients. We show that our method…

Machine Learning · Computer Science 2023-11-07 Lawrence Stewart , Francis S Bach , Felipe Llinares López , Quentin Berthet

In this work, we propose a method for object recognition and pose estimation from depth images using convolutional neural networks. Previous methods addressing this problem rely on manifold learning to learn low dimensional viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Mai Bui , Sergey Zakharov , Shadi Albarqouni , Slobodan Ilic , Nassir Navab

The tree-based ensembles are known for their outstanding performance in classification and regression problems characterized by feature vectors represented by mixed-type variables from various ranges and domains. However, considering…

Machine Learning · Computer Science 2025-12-16 Patryk Wielopolski , Maciej Zięba

Both neural networks and decision trees are popular machine learning methods and are widely used to solve problems from diverse domains. These two classifiers are commonly used base classifiers in an ensemble framework. In this paper, we…

Machine Learning · Computer Science 2018-02-06 Rakesh Katuwal , P. N. Suganthan

Linear model trees are regression trees that incorporate linear models in the leaf nodes. This preserves the intuitive interpretation of decision trees and at the same time enables them to better capture linear relationships, which is hard…

Machine Learning · Statistics 2024-07-10 Jakob Raymaekers , Peter J. Rousseeuw , Tim Verdonck , Ruicong Yao

Recursive partitioning approaches producing tree-like models are a long standing staple of predictive modeling, in the last decade mostly as ``sub-learners'' within state of the art ensemble methods like Boosting and Random Forest. However,…

Machine Learning · Statistics 2015-12-14 Amichai Painsky , Saharon Rosset

Classification trees continue to be widely adopted in machine learning applications due to their inherently interpretable nature and scalability. We propose a rolling subtree lookahead algorithm that combines the relative scalability of the…

Machine Learning · Computer Science 2023-04-24 Zeynel Batuhan Organ , Enis Kayış , Taghi Khaniyev

Ensembles of classification and regression trees remain popular machine learning methods because they define flexible non-parametric models that predict well and are computationally efficient both during training and testing. During…

Machine Learning · Computer Science 2012-06-22 Sebastian Nowozin

The motivation of this work is to improve the performance of standard stacking approaches or ensembles, which are composed of simple, heterogeneous base models, through the integration of the generation and selection stages for regression…

Machine Learning · Statistics 2014-03-31 Roberto Aldave , Jean-Pierre Dussault

The goal of this paper is to provide a method, which is able to find categories of traffic scenarios automatically. The architecture consists of three main components: A microscopic traffic simulation, a clustering technique and a…

Signal Processing · Electrical Eng. & Systems 2020-04-08 Friedrich Kruber , Jonas Wurst , Eduardo Sánchez Morales , Samarjit Chakraborty , Michael Botsch

Artificial intelligence, trained via machine learning or computational statistics algorithms, holds much promise for the improvement of small molecule drug discovery. However, structure-activity data are high dimensional with low…

Applications · Statistics 2018-07-25 Oliver Watson , Isidro Cortes-Ciriano , Aimee Taylor , James A Watson

This paper proposes an extension of regression trees by quadratic unconstrained binary optimization (QUBO). Regression trees are very popular prediction models that are trainable with tabular datasets, but their accuracy is insufficient…

Machine Learning · Computer Science 2023-03-20 Koichiro Yawata , Yoshihiro Osakabe , Takuya Okuyama , Akinori Asahara

Machine learning has an emerging critical role in high-performance computing to modulate simulations, extract knowledge from massive data, and replace numerical models with efficient approximations. Decision forests are a critical tool…

Performance · Computer Science 2018-06-22 James Browne , Tyler M. Tomita , Disa Mhembere , Randal Burns , Joshua T. Vogelstein

Random forests are a popular method for classification and regression due to their versatility. However, this flexibility can come at the cost of user privacy, since training random forests requires multiple data queries, often on small,…

Machine Learning · Computer Science 2021-02-23 Shorya Consul , Sinead A. Williamson

Classification of datasets into two or more distinct classes is an important machine learning task. Many methods are able to classify binary classification tasks with a very high accuracy on test data, but cannot provide any easily…

Machine Learning · Computer Science 2020-08-26 Yashesh Dhebar , Sparsh Gupta , Kalyanmoy Deb

The algebraic properties of flattenings and subflattenings provide direct methods for identifying edges in the true phylogeny -- and by extension the complete tree -- using pattern counts from a sequence alignment. The relatively small…

Populations and Evolution · Quantitative Biology 2022-05-06 Joshua Stevenson , Barbara Holland , Michael Charleston , Jeremy Sumner

This paper presents an autonomous approach to tree detection and segmentation in high resolution airborne LiDAR that utilises state-of-the-art region-based CNN and 3D-CNN deep learning algorithms. If the number of training examples for a…

Robotics · Computer Science 2018-10-31 Lloyd Windrim , Mitch Bryson

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

We study the problem of sharing as many branching conditions of a given forest classifier or regressor as possible while keeping classification performance. As a constraint for preventing from accuracy degradation, we first consider the one…

Machine Learning · Computer Science 2022-12-15 Atsuyoshi Nakamura , Kento Sakurada

Image ordinal estimation is to predict the ordinal label of a given image, which can be categorized as an ordinal regression problem. Recent methods formulate an ordinal regression problem as a series of binary classification problems. Such…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Haiping Zhu , Hongming Shan , Yuheng Zhang , Lingfu Che , Xiaoyang Xu , Junping Zhang , Jianbo Shi , Fei-Yue Wang