English
Related papers

Related papers: Properly learning decision trees in almost polynom…

200 papers

Given a graph $G=(V,E)$, a $\beta$-ruling set is a subset $S\subseteq V$ that is i) independent, and ii) every node $v\in V$ has a node of $S$ within distance $\beta$. In this paper we present almost optimal distributed algorithms for…

Data Structures and Algorithms · Computer Science 2026-04-03 Malte Baumecker , Yannic Maus , Jara Uitto

I present a parallel algorithm for exact probabilistic inference in Bayesian networks. For polytree networks with n variables, the worst-case time complexity is O(log n) on a CREW PRAM (concurrent-read, exclusive-write parallel…

Artificial Intelligence · Computer Science 2013-02-01 David M. Pennock

The tree inclusion problem is, given two node-labeled trees $P$ and $T$ (the ``pattern tree'' and the ``target tree''), to locate every minimal subtree in $T$ (if any) that can be obtained by applying a sequence of node insertion operations…

Data Structures and Algorithms · Computer Science 2021-06-16 Tatsuya Akutsu , Jesper Jansson , Ruiming Li , Atsuhiro Takasu , Takeyuki Tamura

Explorable heap selection is the problem of selecting the $n$th smallest value in a binary heap. The key values can only be accessed by traversing through the underlying infinite binary tree, and the complexity of the algorithm is measured…

Data Structures and Algorithms · Computer Science 2024-09-12 Sander Borst , Daniel Dadush , Sophie Huiberts , Danish Kashaev

We show that $n$-variable tree-structured Ising models can be learned computationally-efficiently to within total variation distance $\epsilon$ from an optimal $O(n \ln n/\epsilon^2)$ samples, where $O(\cdot)$ hides an absolute constant…

Machine Learning · Computer Science 2020-12-01 Constantinos Daskalakis , Qinxuan Pan

Most computational models of dependency syntax consist of distributions over spanning trees. However, the majority of dependency treebanks require that every valid dependency tree has a single edge coming out of the ROOT node, a constraint…

Computation and Language · Computer Science 2022-11-29 Miloš Stanojević

Decision trees are popular machine learning models that are simple to build and easy to interpret. Even though algorithms to learn decision trees date back to almost 50 years, key properties affecting their generalization error are still…

Machine Learning · Computer Science 2020-10-16 Jean-Samuel Leboeuf , Frédéric LeBlanc , Mario Marchand

We introduce a novel incremental decision tree learning algorithm, Hoeffding Anytime Tree, that is statistically more efficient than the current state-of-the-art, Hoeffding Tree. We demonstrate that an implementation of Hoeffding Anytime…

Machine Learning · Computer Science 2018-02-27 Chaitanya Manapragada , Geoff Webb , Mahsa Salehi

The maximum common subtree isomorphism problem asks for the largest possible isomorphism between subtrees of two given input trees. This problem is a natural restriction of the maximum common subgraph problem, which is ${\sf NP}$-hard in…

Data Structures and Algorithms · Computer Science 2016-08-23 Andre Droschinsky , Nils M. Kriege , Petra Mutzel

We present the first sub-quadratic time algorithm that with high probability correctly reconstructs phylogenetic trees for short sequences generated by a Markov model of evolution. Due to rapid expansion in sequence databases, such very…

Populations and Evolution · Quantitative Biology 2012-06-01 Daniel G. Brown , Jakub Truszkowski

In 1992 Blum and Rudich [BR92] gave an algorithm that uses membership and equivalence queries to learn $k$-term DNF formulas over $\{0,1\}^n$ in time $\textsf{poly}(n,2^k)$, improving on the naive $O(n^k)$ running time that can be achieved…

Data Structures and Algorithms · Computer Science 2025-07-29 Josh Alman , Shivam Nadimpalli , Shyamal Patel , Rocco Servedio

Based on decision trees, many fields have arguably made tremendous progress in recent years. In simple words, decision trees use the strategy of "divide-and-conquer" to divide the complex problem on the dependency between input features and…

Machine Learning · Computer Science 2021-01-22 Jinxiong Zhang

We consider the problem of augmenting an $n$-vertex tree with one shortcut in order to minimize the diameter of the resulting graph. The tree is embedded in an unknown space and we have access to an oracle that, when queried on a pair of…

Data Structures and Algorithms · Computer Science 2018-10-03 Davide Bilò

In this paper we describe an algorithm that embeds a graph metric $(V,d_G)$ on an undirected weighted graph $G=(V,E)$ into a distribution of tree metrics $(T,D_T)$ such that for every pair $u,v\in V$, $d_G(u,v)\leq d_T(u,v)$ and…

Data Structures and Algorithms · Computer Science 2017-05-29 Guy E. Blelloch , Yan Gu , Yihan Sun

Until recently, the fastest distributed MIS algorithm, even for simple graphs, e.g., unoriented trees has been the simple randomized algorithm discovered the 80s. This algorithm (commonly called Luby's algorithm) computes an MIS in $O(\log…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-23 Sriram Pemmaraju , Talal Riaz

Given a set of $n$ real numbers, the 3SUM problem is to decide whether there are three of them that sum to zero. Until a recent breakthrough by Gr{\o}nlund and Pettie [FOCS'14], a simple $\Theta(n^2)$-time deterministic algorithm for this…

Data Structures and Algorithms · Computer Science 2017-03-07 Omer Gold , Micha Sharir

We present a new uniform random sampler for binary trees with $n$ internal nodes consuming $2n + \Theta(\log(n)^2)$ random bits on average. This makes it quasi-optimal and out-performs the classical Remy algorithm. We also present a sampler…

Data Structures and Algorithms · Computer Science 2018-02-20 Axel Bacher , Olivier Bodini , Alice Jacquot

We propose an approach for learning optimal tree-based prescription policies directly from data, combining methods for counterfactual estimation from the causal inference literature with recent advances in training globally-optimal decision…

Machine Learning · Computer Science 2020-12-07 Maxime Amram , Jack Dunn , Ying Daisy Zhuo

We consider the problem of learning decision rules for prediction with feature budget constraint. In particular, we are interested in pruning an ensemble of decision trees to reduce expected feature cost while maintaining high prediction…

Machine Learning · Statistics 2016-01-06 Feng Nan , Joseph Wang , Venkatesh Saligrama

Linear model trees are regression trees that incorporate linear models in the leaf nodes. This preserves the intuitive interpretation of decision trees and at the same time enables them to better capture linear relationships, which is hard…

Machine Learning · Statistics 2024-07-10 Jakob Raymaekers , Peter J. Rousseeuw , Tim Verdonck , Ruicong Yao