English
Related papers

Related papers: LHT: Statistically-Driven Oblique Decision Trees f…

200 papers

In this paper, we introduce the first machine learning framework for predicting optimal processing times in Single-Level Tree Network (SLTN) architectures for the Divisible Load Theory (DLT) paradigm. Using a feedforward neural network(FNN)…

Machine Learning · Computer Science 2026-05-25 Bharadwaj Veeravalli

Interpretability and effectiveness are two essential and indispensable requirements for adopting machine learning methods in reality. In this paper, we propose a knowledge distillation based decision trees extension, dubbed rectified…

Machine Learning · Computer Science 2020-08-24 Yiming Li , Jiawang Bai , Jiawei Li , Xue Yang , Yong Jiang , Shu-Tao Xia

Iterative hard thresholding (IHT) is a projected gradient descent algorithm, known to achieve state of the art performance for a wide range of structured estimation problems, such as sparse inference. In this work, we consider IHT as a…

Machine Learning · Statistics 2020-02-03 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

The adoption of the distributed paradigm has allowed applications to increase their scalability, robustness and fault tolerance, but it has also complicated their structure, leading to an exponential growth of the applications'…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-23 Ioannis Giannakopoulos , Dimitrios Tsoumakos , Nectarios Koziris

The majority of existing Linear Temporal Logic (LTL) planning methods rely on the construction of a discrete product automaton, that combines a discrete abstraction of robot mobility and a B$\ddot{\text{u}}$chi automaton that captures the…

Robotics · Computer Science 2021-03-24 Xusheng Luo , Yiannis Kantaros , Michael M. Zavlanos

Symbolic learning represents the most straightforward approach to interpretable modeling, but its applications have been hampered by a single structural design choice: the adoption of propositional logic as the underlying language.…

Machine Learning · Computer Science 2021-09-20 Giovanni Pagliarini , Guido Sciavicco

While Temporal Logic provides a rigorous verification framework for robotics, it typically operates on trajectory-level signals and does not natively represent the object-centric geometric relations that are central to manipulation.…

Robotics · Computer Science 2026-03-25 Licheng Luo , Kaier Liang , Yu Xia , Mingyu Cai

Categorical sequence clustering plays a crucial role in various fields, but the lack of interpretability in cluster assignments poses significant challenges. Sequences inherently lack explicit features, and existing sequence clustering…

Machine Learning · Computer Science 2023-09-06 Junjie Dong , Xinyi Yang , Mudi Jiang , Lianyu Hu , Zengyou He

Decision trees are widely used for classification and regression tasks in a variety of application fields due to their interpretability and good accuracy. During the past decade, growing attention has been devoted to globally optimized…

Machine Learning · Computer Science 2025-01-28 Antonio Consolo , Edoardo Amaldi , Andrea Manno

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

Informed sampling-based planning algorithms exploit problem knowledge for better search performance. This knowledge is often expressed as heuristic estimates of solution cost and used to order the search. The practical improvement of this…

Robotics · Computer Science 2020-12-10 Marlin P. Strub , Jonathan D. Gammell

Decision trees are often preferred when implementing Machine Learning in embedded systems for their simplicity and scalability. Hoeffding Trees are a type of Decision Trees that take advantage of the Hoeffding Bound to allow them to learn…

Machine Learning · Computer Science 2021-12-06 Luís Miguel Sousa , Nuno Paulino , João Canas Ferreira , João Bispo

With the advent of highly predictive but opaque deep learning models, it has become more important than ever to understand and explain the predictions of such models. Existing approaches define interpretability as the inverse of complexity…

Machine learning algorithms often contain many hyperparameters (HPs) whose values affect the predictive performance of the induced models in intricate ways. Due to the high number of possibilities for these HP configurations and their…

Decision-making processes in healthcare can be highly complex and challenging. Machine Learning tools offer significant potential to assist in these processes. However, many current methodologies rely on complex models that are not easily…

Artificial Intelligence · Computer Science 2025-03-24 Alessio Cascione , Mattia Setzu , Federico A. Galatolo , Mario G. C. A. Cimino , Riccardo Guidotti

Classification and Regression Tree (CART), Random Forest (RF) and Gradient Boosting Tree (GBT) are probably the most popular set of statistical learning methods. However, their statistical consistency can only be proved under very…

Statistics Theory · Mathematics 2025-02-17 Haoran Zhan , Yu Liu , Yingcun Xia

Decision tree ensembles are widely used in practice. In this work, we study in ensemble settings the effectiveness of replacing the split strategy for the state-of-the-art online tree learner, Hoeffding Tree, with a rigorous but more eager…

Machine Learning · Computer Science 2021-08-03 Chaitanya Manapragada , Heitor M Gomes , Mahsa Salehi , Albert Bifet , Geoffrey I Webb

Understanding the multiple socially-acceptable future behaviors is an essential task for many vision applications. In this paper, we propose a tree-based method, termed as Social Interpretable Tree (SIT), to address this multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Liushuai Shi , Le Wang , Chengjiang Long , Sanping Zhou , Fang Zheng , Nanning Zheng , Gang Hua

We propose an innovative, learnable two-sided short-time Laplace transform (STLT) mechanism to supplant the traditional self attention in transformer-based LLMs. Our STLT introduces trainable parameters for each Laplace node, enabling…

Machine Learning · Computer Science 2025-06-23 Andrew Kiruluta

Direct policy search (DPS) and look-ahead tree (LT) policies are two widely used classes of techniques to produce high performance policies for sequential decision-making problems. To make DPS approaches work well, one crucial issue is to…

Systems and Control · Computer Science 2015-03-20 Tobias Jung , Louis Wehenkel , Damien Ernst , Francis Maes