English
Related papers

Related papers: Improving Decision Trees through the Lens of Param…

200 papers

Mathematical modeling is a standard approach to solve many real-world problems and {\em diversity} of solutions is an important issue, emerging in applying solutions obtained from mathematical models to real-world problems. Many studies…

Data Structures and Algorithms · Computer Science 2020-12-15 Tesshu Hanaka , Yasuaki Kobayashi , Kazuhiro Kurita , Yota Otachi

Mathematical optimization, although often leading to NP-hard models, is now capable of solving even large-scale instances within reasonable time. However, the primary focus is often placed solely on optimality. This implies that while…

Optimization and Control · Mathematics 2025-12-23 Kevin-Martin Aigner , Marc Goerigk , Michael Hartisch , Frauke Liers , Arthur Miehlich , Florian Rösel

We consider the well-studied problem of finding a spanning tree with minimum average distance between vertex pairs (called a MAD tree). This is a classic network design problem which is known to be NP-hard. While approximation algorithms…

Data Structures and Algorithms · Computer Science 2026-04-01 Tom-Lukas Breitkopf , Vincent Froese , Anton Herrmann , André Nichterlein , Camille Richer

Decision trees are popular Classification and Regression tools and, when small-sized, easy to interpret. Traditionally, a greedy approach has been used to build the trees, yielding a very fast training process; however, controlling sparsity…

Optimization and Control · Mathematics 2020-02-24 Rafael Blanquero , Emilio Carrizosa , Cristina Molero-Río , Dolores Romero Morales

Based on decision trees, many fields have arguably made tremendous progress in recent years. In simple words, decision trees use the strategy of "divide-and-conquer" to divide the complex problem on the dependency between input features and…

Machine Learning · Computer Science 2021-01-22 Jinxiong Zhang

We present convincing empirical evidence for an effective and general strategy for building accurate small models. Such models are attractive for interpretability and also find use in resource-constrained environments. The strategy is to…

Machine Learning · Computer Science 2024-04-30 Abhishek Ghose

Inferring probabilistic networks from data is a notoriously difficult task. Under various goodness-of-fit measures, finding an optimal network is NP-hard, even if restricted to polytrees of bounded in-degree. Polynomial-time algorithms are…

Data Structures and Algorithms · Computer Science 2012-08-16 Serge Gaspers , Mikko Koivisto , Mathieu Liedloff , Sebastian Ordyniak , Stefan Szeider

Fixed-parameter tractability analysis and scheduling are two core domains of combinatorial optimization which led to deep understanding of many important algorithmic questions. However, even though fixed-parameter algorithms are appealing…

Data Structures and Algorithms · Computer Science 2013-11-19 Matthias Mnich , Andreas Wiese

This paper presents several new tractability results for planning based on macros. We describe an algorithm that optimally solves planning problems in a class that we call inverted tree reducible, and is provably tractable for several…

Artificial Intelligence · Computer Science 2014-01-16 Anders Jonsson

Dynamic programming over tree decompositions is a common technique in parameterized algorithms. In this paper, we study whether this technique can also be applied to compute Pareto sets of multiobjective optimization problems. We first…

Data Structures and Algorithms · Computer Science 2025-09-09 Joshua Könen , Heiko Röglin , Tarek Stuck

We focus on the average-case analysis: A function w : V -> Z+ is given which defines the likelihood for a node to be the one marked, and we want the strategy that minimizes the expected number of queries. Prior to this paper, very little…

Data Structures and Algorithms · Computer Science 2009-08-10 Ferdinando Cicalese , Tobias Jacobs , Eduardo Laber , Marco Molinaro

Datasets can be biased due to societal inequities, human biases, under-representation of minorities, etc. Our goal is to certify that models produced by a learning algorithm are pointwise-robust to potential dataset biases. This is a…

Machine Learning · Computer Science 2021-10-12 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

Parameterized algorithms are a way to solve hard problems more efficiently, given that a specific parameter of the input is small. In this paper, we apply this idea to the field of answer set programming (ASP). To this end, we propose two…

Logic in Computer Science · Computer Science 2017-02-10 Johannes Fichte , Markus Hecher , Michael Morak , Stefan Woltran

The key to reconciling the polynomial-time intractability of many machine learning tasks in the worst case with the surprising solvability of these tasks by heuristic algorithms in practice seems to be exploiting restrictions on real-world…

Machine Learning · Computer Science 2022-05-11 Todd Wareham

We argue that parameterized complexity is a useful tool with which to study global constraints. In particular, we show that many global constraints which are intractable to propagate completely have natural parameters which make them…

Artificial Intelligence · Computer Science 2009-03-04 Christian Bessiere , Emmanuel Hebrard , Brahim Hnich , Zeynep Kiziltan , Toby Walsh

Integer Linear Programming (ILP) can be seen as the archetypical problem for NP-complete optimization problems, and a wide range of problems in artificial intelligence are solved in practice via a translation to ILP. Despite its huge range…

Data Structures and Algorithms · Computer Science 2018-09-05 Robert Ganian , Sebastian Ordyniak

Conventional decision trees have a number of favorable properties, including interpretability, a small computational footprint and the ability to learn from little training data. However, they lack a key quality that has helped fuel the…

Machine Learning · Statistics 2017-12-08 Thomas Hehn , Fred A. Hamprecht

In this paper, we study three algorithmic problems involving computation trees: the optimization, solvability, and satisfiability problems. The solvability problem is concerned with recognizing computation trees that solve problems. The…

Logic in Computer Science · Computer Science 2025-01-06 Mikhail Moshkov

Decision trees are ubiquitous in machine learning for their ease of use and interpretability. Yet, these models are not typically employed in reinforcement learning as they cannot be updated online via stochastic gradient descent. We…

Machine Learning · Computer Science 2020-06-29 Andrew Silva , Taylor Killian , Ivan Dario Jimenez Rodriguez , Sung-Hyun Son , Matthew Gombolay

We consider the problem of finding a 1-planar drawing for a general graph, where a 1-planar drawing is a drawing in which each edge participates in at most one crossing. Since this problem is known to be NP-hard we investigate the…

Data Structures and Algorithms · Computer Science 2018-12-18 Michael J. Bannister , Sergio Cabello , David Eppstein