English
Related papers

Related papers: Hard-ODT: Hardware-Friendly Online Decision Tree L…

200 papers

We present a novel implementation of classification using the machine learning / artificial intelligence method called boosted decision trees (BDT) on field programmable gate arrays (FPGA). The firmware implementation of binary…

High Energy Physics - Experiment · Physics 2023-04-12 Tae Min Hong , Benjamin Carlson , Brandon Eubanks , Stephen Racz , Stephen Roche , Joerg Stelzer , Daniel Stumpp

Online learning algorithms have become a ubiquitous tool in the machine learning toolbox and are frequently used in small, resource-constraint environments. Among the most successful online learning methods are Decision Tree (DT) ensembles.…

Machine Learning · Computer Science 2021-12-08 Sebastian Buschjäger , Sibylle Hess , Katharina Morik

Decision Trees are prominent prediction models for interpretable Machine Learning. They have been thoroughly researched, mostly in the batch setting with a fixed labelled dataset, leading to popular algorithms such as C4.5, ID3 and CART.…

Machine Learning · Computer Science 2024-06-24 Ayman Chaouki , Jesse Read , Albert Bifet

Decision tree learning is a widely used approach in machine learning, favoured in applications that require concise and interpretable models. Heuristic methods are traditionally used to quickly produce models with reasonably high accuracy.…

Decision trees and random forest remain highly competitive for classification on medium-sized, standard datasets due to their robustness, minimal preprocessing requirements, and interpretability. However, a single tree suffers from high…

Machine Learning · Statistics 2025-12-02 Cencheng Shen , Yuexiao Dong , Carey E. Priebe

There is a need for machine learning models to evolve in unsupervised circumstances. New classifications may be introduced, unexpected faults may occur, or the initial dataset may be small compared to the data-points presented to the system…

Machine Learning · Computer Science 2023-06-05 Samuel Prescott , Adrian Wheeldon , Rishad Shafik , Tousif Rahman , Alex Yakovlev , Ole-Christoffer Granmo

Decision trees provide a rich family of highly non-linear but efficient models, due to which they continue to be the go-to family of predictive models by practitioners across domains. But learning trees is challenging due to their discrete…

Machine Learning · Computer Science 2022-10-03 Ajaykrishna Karthikeyan , Naman Jain , Nagarajan Natarajan , Prateek Jain

Machine-learning models are increasingly deployed on resource-constrained embedded systems with strict timing constraints. In such scenarios, the worst-case execution time (WCET) of the models is required to ensure safe operation.…

Machine Learning · Computer Science 2025-01-30 Nils Hölscher , Christian Hakert , Georg von der Brüggen , Jian-Jia Chen , Kuan-Hsun Chen , Jan Reineke

Mobile edge computing (a.k.a. fog computing) has recently emerged to enable in-situ processing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however, is…

Machine Learning · Computer Science 2017-03-20 Jie Xu , Lixing Chen , Shaolei Ren

Decision diagrams for classification have some notable advantages over decision trees, as their internal connections can be determined at training time and their width is not bound to grow exponentially with their depth. Accordingly,…

Machine Learning · Computer Science 2022-05-31 Alexandre M. Florio , Pedro Martins , Maximilian Schiffer , Thiago Serra , Thibaut Vidal

Gradient Boosting Decision Tree (GBDT) are popular machine learning algorithms with implementations such as LightGBM and in popular machine learning toolkits like Scikit-Learn. Many implementations can only produce trees in an offline…

Machine Learning · Statistics 2020-02-06 Chapman Siu

Optimal decision tree (\odt) is a fundamental problem arising in applications such as active learning, entity identification, and medical diagnosis. An instance of \odt is given by $m$ hypotheses, out of which an unknown ``true'' hypothesis…

Data Structures and Algorithms · Computer Science 2025-05-22 Zhengjia Zhuo , Viswanath Nagarajan

Hoeffding trees are the state-of-the-art methods in decision tree learning for evolving data streams. These very fast decision trees are used in many real applications where data is created in real-time due to their efficiency. In this…

Machine Learning · Computer Science 2020-10-19 Chaitanya Manapragada , Geoffrey I Webb , Mahsa Salehi , Albert Bifet

Out-Of-Distribution (OOD) generalization is an essential topic in machine learning. However, recent research is only focusing on the corresponding methods for neural networks. This paper introduces a novel and effective solution for OOD…

Machine Learning · Computer Science 2024-01-19 Yufan Liao , Qi Wu , Xing Yan

Artificial intelligence applications in autonomous driving, medical diagnostics, and financial systems increasingly demand machine learning models that can provide robust uncertainty quantification, interpretability, and noise resilience.…

Machine learning-based applications are increasingly prevalent in IoT devices. The power and storage constraints of these devices make it particularly challenging to run modern neural networks, limiting the number of new applications that…

Machine Learning · Computer Science 2019-03-06 Dibakar Gope , Ganesh Dasika , Matthew Mattina

Oblique Decision Tree (ODT) separates the feature space by linear projections, as opposed to the conventional Decision Tree (DT) that forces axis-parallel splits. ODT has been proven to have a stronger representation ability than DT, as it…

Machine Learning · Computer Science 2025-02-04 Shen-Huan Lyu , Yi-Xiao He , Yanyan Wang , Zhihao Qu , Bin Tang , Baoliu Ye

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and performance for hardware implementations of deep neural…

Machine Learning · Computer Science 2018-02-20 Yanzhi Wang , Caiwen Ding , Zhe Li , Geng Yuan , Siyu Liao , Xiaolong Ma , Bo Yuan , Xuehai Qian , Jian Tang , Qinru Qiu , Xue Lin

Computation offloading at lower time and lower energy consumption is crucial for resource limited mobile devices. This paper proposes an offloading decision-making model using federated learning. Based on the task type and the user input,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Anwesha Mukherjee , Rajkumar Buyya

Discretization based approaches to solving online reinforcement learning problems have been studied extensively in practice on applications ranging from resource allocation to cache management. Two major questions in designing…

Machine Learning · Statistics 2024-09-30 Sean R. Sinclair , Siddhartha Banerjee , Christina Lee Yu