English
Related papers

Related papers: Optimal hypersurface decision trees

200 papers

Decision trees are a popular machine learning model which are traditionally trained by heuristic methods. Massive improvements in computing power and optimisation techniques has led to renewed interest in learning globally optimal decision…

Optimization and Control · Mathematics 2025-11-25 Mitchell Keegan , Michael Forbes , Paul Corry , Mahdi Abolghasemi

Vertex Subset Problems (VSPs) are a class of combinatorial optimization problems on graphs where the goal is to find a subset of vertices satisfying a predefined condition. Two prominent approaches for solving VSPs are dynamic programming…

Data Structures and Algorithms · Computer Science 2026-01-14 Mateus de Oliveira Oliveira , Wim Van den Broeck

We study the Steiner Tree problem on the intersection graph of most natural families of geometric objects, e.g., disks, squares, polygons, etc. Given a set of $n$ objects in the plane and a subset $T$ of $t$ terminal objects, the task is to…

Computational Geometry · Computer Science 2025-11-11 Sujoy Bhore , Baris Can Esmer , Daniel Marx , Karol Wegrzycki

There are many classical problems in P whose time complexities have not been improved over the past decades. Recent studies of "Hardness in P" have revealed that, for several of such problems, the current fastest algorithm is the best…

Data Structures and Algorithms · Computer Science 2017-10-24 Yoichi Iwata , Tomoaki Ogasawara , Naoto Ohsaka

Oblique Decision Tree (ODT) separates the feature space by linear projections, as opposed to the conventional Decision Tree (DT) that forces axis-parallel splits. ODT has been proven to have a stronger representation ability than DT, as it…

Machine Learning · Computer Science 2025-02-04 Shen-Huan Lyu , Yi-Xiao He , Yanyan Wang , Zhihao Qu , Bin Tang , Baoliu Ye

This work considers a number of optimization problems and reductive relations between them. The two main problems we are interested in are the \emph{Optimal Decision Tree} and \emph{Set Cover}. We study these two fundamental tasks under…

Data Structures and Algorithms · Computer Science 2026-03-23 Michał Szyfelbein , Dariusz Dereniowski

Global optimization of decision trees has shown to be promising in terms of accuracy, size, and consequently human comprehensibility. However, many of the methods used rely on general-purpose solvers for which scalability remains an issue.…

Machine Learning · Computer Science 2025-01-31 Jacobus G. M. van der Linden , Mathijs M. de Weerdt , Emir Demirović

The decision tree ensembles use a single data feature at each node for splitting the data. However, splitting in this manner may fail to capture the geometric properties of the data. Thus, oblique decision trees generate the oblique…

Machine Learning · Computer Science 2023-04-17 M. A. Ganaie , M. Tanveer , I. Beheshti , N. Ahmad , P. N. Suganthan

Computing bounded depth decompositions is a bottleneck in many applications of the treedepth parameter. The fastest known algorithm, which is due to Reidl, Rossmanith, S\'{a}nchez Villaamil, and Sikdar [ICALP 2014], runs in…

Data Structures and Algorithms · Computer Science 2025-02-25 Lars Jaffke , Paloma T. de Lima , Wojciech Nadara , Emmanuel Sam

The uniqueness of an optimal solution to a combinatorial optimization problem attracts many fields of researchers' attention because it has a wide range of applications, it is related to important classes in computational complexity, and an…

Data Structures and Algorithms · Computer Science 2023-12-19 Takashi Horiyama , Yasuaki Kobayashi , Hirotaka Ono , Kazuhisa Seto , Ryu Suzuki

While obtaining optimal algorithms for the most important problems in the LOCAL model has been one of the central goals in the area of distributed algorithms since its infancy, tight complexity bounds are elusive for many problems even when…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Sebastian Brandt , Ananth Narayanan

Informed sampling-based planning algorithms exploit problem knowledge for better search performance. This knowledge is often expressed as heuristic estimates of solution cost and used to order the search. The practical improvement of this…

Robotics · Computer Science 2020-12-10 Marlin P. Strub , Jonathan D. Gammell

Decision trees are popular Classification and Regression tools and, when small-sized, easy to interpret. Traditionally, a greedy approach has been used to build the trees, yielding a very fast training process; however, controlling sparsity…

Optimization and Control · Mathematics 2020-02-24 Rafael Blanquero , Emilio Carrizosa , Cristina Molero-Río , Dolores Romero Morales

In this paper we present a novel probabilistic sampling-based motion planning algorithm called the Fast Marching Tree algorithm (FMT*). The algorithm is specifically aimed at solving complex motion planning problems in high-dimensional…

Robotics · Computer Science 2015-02-09 Lucas Janson , Edward Schmerling , Ashley Clark , Marco Pavone

We develop a theoretical framework for the analysis of oblique decision trees, where the splits at each decision node occur at linear combinations of the covariates (as opposed to conventional tree constructions that force axis-aligned…

Statistics Theory · Mathematics 2023-09-01 Matias D. Cattaneo , Rajita Chandak , Jason M. Klusowski

Decision trees are one of the most popular classifiers in the machine learning literature. While the most common decision tree learning algorithms treat data as a batch, numerous algorithms have been proposed to construct decision trees…

Machine Learning · Computer Science 2026-01-21 Nikolaj Tatti

Decision trees are a fundamental tool in machine learning for representing, classifying, and generalizing data. It is desirable to construct ``small'' decision trees, by minimizing either the \textit{size} ($s$) or the \textit{depth} $(d)$…

Machine Learning · Computer Science 2025-05-22 Harmender Gahlawat , Meirav Zehavi

Treemaps have been widely applied to the visualization of hierarchical data. A treemap takes a weighted tree and visualizes its leaves in a nested planar geometric shape, with sub-regions partitioned such that each sub-region has an area…

Graphics · Computer Science 2023-09-01 Mehdi Behroozi , Reyhaneh Mohammadi , Cody Dunne

When introducing physics-constrained deep learning solutions to the volumetric super-resolution of scientific data, the training is challenging to converge and always time-consuming. We propose a new hierarchical sampling method based on…

Computational Physics · Physics 2023-06-09 Xinjie Wang , Maoquan Sun , Yundong Guo , Chunxin Yuan , Xiang Sun , Zhiqiang Wei , Xiaogang Jin

Given a directed graph $G=(V,A)$, the Directed Maximum Leaf Spanning Tree problem asks to compute a directed spanning tree (i.e., an out-branching) with as many leaves as possible. By designing a Branch-and-Reduced algorithm combined with…

Data Structures and Algorithms · Computer Science 2009-11-11 Daniel Raible , Henning Fernau