English
Related papers

Related papers: Tree-based machine learning performed in-memory wi…

200 papers

Decision trees and their ensembles are popular in machine learning as easy-to-understand models. Several techniques have been proposed in the literature for learning tree-based classifiers, with different techniques working well for data…

Machine Learning · Computer Science 2025-05-20 Maria-Florina Balcan , Dravyansh Sharma

We focus on generative AI for a type of data that still represent one of the most prevalent form of data: tabular data. Our paper introduces two key contributions: a new powerful class of forest-based models fit for such tasks and a simple…

Machine Learning · Computer Science 2024-11-15 Richard Nock , Mathieu Guillame-Bert

Both neural networks and decision trees are popular machine learning methods and are widely used to solve problems from diverse domains. These two classifiers are commonly used base classifiers in an ensemble framework. In this paper, we…

Machine Learning · Computer Science 2018-02-06 Rakesh Katuwal , P. N. Suganthan

Deep Learning is considered to be a quite young in the area of machine learning research, found its effectiveness in dealing complex yet high dimensional dataset that includes but limited to images, text and speech etc. with multiple levels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Mrutyunjaya Panda

Most deep learning models are limited to specific datasets or tasks because of network structures using fixed layers. In this paper, we discuss the differences between existing neural networks and real human neurons, propose association…

Artificial Intelligence · Computer Science 2023-01-31 Seokjun Kim , Jaeeun Jang , Hyeoncheol Kim

Decision trees and their ensembles are very popular models of supervised machine learning. In this paper we merge the ideas underlying decision trees, their ensembles and FCA by proposing a new supervised machine learning model which can be…

Machine Learning · Computer Science 2021-06-02 Egor Dudyrev , Sergei O. Kuznetsov

Database research can help machine learning performance in many ways. One way is to design better data structures. This paper combines the use of incremental computation and sequential and probabilistic filtering to enable "forgetful"…

Machine Learning · Computer Science 2022-12-16 Zhehu Yuan , Yinqi Sun , Dennis Shasha

Recently proposed budding tree is a decision tree algorithm in which every node is part internal node and part leaf. This allows representing every decision tree in a continuous parameter space, and therefore a budding tree can be jointly…

Machine Learning · Computer Science 2014-12-22 Ozan İrsoy , Ethem Alpaydın

Decision forests are widely used for classification and regression tasks. A lesser known property of tree-based methods is that one can construct a proximity matrix from the tree(s), and these proximity matrices are induced kernels. While…

Machine Learning · Statistics 2024-10-14 Sambit Panda , Cencheng Shen , Joshua T. Vogelstein

Neural Networks and Decision Trees: two popular techniques for supervised learning that are seemingly disconnected in their formulation and optimization method, have recently been combined in a single construct. The connection pivots on…

Machine Learning · Statistics 2020-02-27 Giuseppe Nuti , Lluís Antoni Jiménez Rugama , Kaspar Thommen

Decision tree learning is a popular classification technique most commonly used in machine learning applications. Recent work has shown that decision trees can be used to represent provably-correct controllers concisely. Compared to…

Machine Learning · Computer Science 2021-02-02 Pranav Ashok , Mathias Jackermeier , Pushpak Jagtap , Jan Křetínský , Maximilian Weininger , Majid Zamani

Deep neural networks (DNN) have achieved remarkable success in computer vision (CV). However, training and inference of DNN models are both memory and computation intensive, incurring significant overhead in terms of energy consumption and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Tao Luo , Wai Teng Tang , Matthew Kay Fei Lee , Chuping Qu , Weng-Fai Wong , Rick Goh

Decision tree (and its extensions such as Gradient Boosting Decision Trees and Random Forest) is a widely used machine learning algorithm, due to its practical effectiveness and model interpretability. With the emergence of big data, there…

Machine Learning · Computer Science 2016-11-07 Qi Meng , Guolin Ke , Taifeng Wang , Wei Chen , Qiwei Ye , Zhi-Ming Ma , Tie-Yan Liu

Label ranking aims to learn a mapping from instances to rankings over a finite number of predefined labels. Random forest is a powerful and one of the most successful general-purpose machine learning algorithms of modern times. In this…

Machine Learning · Computer Science 2018-06-19 Yangming Zhou , Guoping Qiu

Over the past decade, Deep Convolutional Neural Networks (DCNNs) have shown remarkable performance in most computer vision tasks. These tasks traditionally use a fixed dataset, and the model, once trained, is deployed as is. Adding new…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Deboleena Roy , Priyadarshini Panda , Kaushik Roy

Tree ensemble algorithms as RandomForest and GradientBoosting are currently the dominant methods for modeling discrete or tabular data, however, they are unable to perform a hierarchical representation learning from raw data as…

Machine Learning · Computer Science 2024-02-07 Ángel Delgado-Panadero , José Alberto Benítez-Andrades , María Teresa García-Ordás

It is very useful to integrate human knowledge and experience into traditional neural networks for faster learning speed, fewer training samples and better interpretability. However, due to the obscured and indescribable black box model of…

Machine Learning · Computer Science 2018-10-02 Guangming Shi , Zhongqiang Zhang , Dahua Gao , Xuemei Xie , Yihao Feng , Xinrui Ma , Danhua Liu

Decision trees are renowned for their ability to achieve high predictive performance while remaining interpretable, especially on tabular data. Traditionally, they are constructed through recursive algorithms, where they partition the data…

Machine Learning · Computer Science 2024-08-27 Yufan Zhuang , Liyuan Liu , Chandan Singh , Jingbo Shang , Jianfeng Gao

Vision-based segmentation in forested environments is a key functionality for autonomous forestry operations such as tree felling and forwarding. Deep learning algorithms demonstrate promising results to perform visual tasks such as object…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Vincent Grondin , François Pomerleau , Philippe Giguère

We propose new methods for Support Vector Machines (SVMs) using tree architecture for multi-class classi- fication. In each node of the tree, we select an appropriate binary classifier using entropy and generalization error estimation, then…

Machine Learning · Computer Science 2017-08-29 Pittipol Kantavat , Boonserm Kijsirikul , Patoomsiri Songsiri , Ken-ichi Fukui , Masayuki Numao