English
Related papers

Related papers: Learning Polytrees

200 papers

We consider the task of properly PAC learning decision trees with queries. Recent work of Koch, Strassle, and Tan showed that the strictest version of this task, where the hypothesis tree $T$ is required to be optimally small, is NP-hard.…

Computational Complexity · Computer Science 2024-07-02 Caleb Koch , Carmen Strassle , Li-Yang Tan

We focus on the average-case analysis: A function w : V -> Z+ is given which defines the likelihood for a node to be the one marked, and we want the strategy that minimizes the expected number of queries. Prior to this paper, very little…

Data Structures and Algorithms · Computer Science 2009-08-10 Ferdinando Cicalese , Tobias Jacobs , Eduardo Laber , Marco Molinaro

We study the problem of learning optimal policy from a set of discrete treatment options using observational data. We propose a piecewise linear neural network model that can balance strong prescriptive performance and interpretability,…

Machine Learning · Computer Science 2023-06-02 Wei Sun , Asterios Tsiourvas

This paper considers the task of learning users' preferences on a combinatorial set of alternatives, as generally used by online configurators, for example. In many settings, only a set of selected alternatives during past interactions is…

Artificial Intelligence · Computer Science 2022-09-26 Hélène Fargier , Pierre-François Gimenez , Jérôme Mengin , Bao Ngoc Le Nguyen

We study the problem of learning a hierarchical tree representation of data from labeled samples, taken from an arbitrary (and possibly adversarial) distribution. Consider a collection of data tuples labeled according to their hierarchical…

Machine Learning · Computer Science 2023-02-10 Dmitrii Avdiukhin , Grigory Yaroslavtsev , Danny Vainstein , Orr Fischer , Sauman Das , Faraz Mirza

We present a comprehensive classical and parameterized complexity analysis of decision tree pruning operations, extending recent research on the complexity of learning small decision trees. Thereby, we offer new insights into the…

Machine Learning · Computer Science 2025-03-06 Juha Harviainen , Frank Sommer , Manuel Sorge , Stefan Szeider

We consider the problem of PAC-learning decision trees, i.e., learning a decision tree over the n-dimensional hypercube from independent random labeled examples. Despite significant effort, no polynomial-time algorithm is known for learning…

Machine Learning · Computer Science 2008-12-05 Adam Tauman Kalai , Shang-Hua Teng

We investigate approximating joint distributions of random processes with causal dependence tree distributions. Such distributions are particularly useful in providing parsimonious representation when there exists causal dynamics among…

Information Theory · Computer Science 2011-01-27 Christopher J. Quinn , Todd P. Coleman , Negar Kiyavash

We consider the branch-length estimation problem on a bifurcating tree: a character evolves along the edges of a binary tree according to a two-state symmetric Markov process, and we seek to recover the edge transition probabilities from…

Computation · Statistics 2025-07-30 David Clancy , Hanbaek Lyu , Sebastien Roch

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

Understanding the evolution of a set of genes or species is a fundamental problem in evolutionary biology. The problem we study here takes as input a set of trees describing {possibly discordant} evolutionary scenarios for a given set of…

Data Structures and Algorithms · Computer Science 2019-07-10 Cedric Chauve , Mark Jones , Manuel Lafond , Céline Scornavacca , Mathias Weller

Inferring a decision tree from a given dataset is one of the classic problems in machine learning. This problem consists of buildings, from a labelled dataset, a tree such that each node corresponds to a class and a path between the tree…

Machine Learning · Computer Science 2019-04-15 Florent Avellaneda

Over the last few years, there has been a surge in the use of learning techniques to improve the performance of optimization algorithms. In particular, the learning of branching rules in mixed integer linear programming has received a lot…

In the context of graphical causal discovery, we adapt the versatile framework of linear non-Gaussian acyclic models (LiNGAMs) to propose new algorithms to efficiently learn graphs that are polytrees. Our approach combines the Chow--Liu…

Machine Learning · Statistics 2022-08-16 Daniele Tramontano , Anthea Monod , Mathias Drton

We show that the class of strongly connected graphical models with treewidth at most k can be properly efficiently PAC-learnt with respect to the Kullback-Leibler Divergence. Previous approaches to this problem, such as those of Chow ([1]),…

Machine Learning · Computer Science 2012-07-19 Mukund Narasimhan , Jeff A. Bilmes

In recent years, significant progress has been made on algorithms for learning optimal decision trees, primarily in the context of binary features. Extending these methods to continuous features remains substantially more challenging due to…

Machine Learning · Computer Science 2026-01-22 Harold Kiossou , Pierre Schaus , Siegfried Nijssen

Phylogenetic networks are often constructed by merging multiple conflicting phylogenetic signals into a directed acyclic graph. It is interesting to explore whether a network constructed in this way induces biologically-relevant…

Populations and Evolution · Quantitative Biology 2017-07-13 Steven Kelk , Fabio Pardi , Celine Scornavacca , Leo van Iersel

We investigate active learning by pairwise similarity over the leaves of trees originating from hierarchical clustering procedures. In the realizable setting, we provide a full characterization of the number of queries needed to achieve…

Machine Learning · Computer Science 2019-10-15 Fabio Vitale , Anand Rajagopalan , Claudio Gentile

Estimating a constrained relation is a fundamental problem in machine learning. Special cases are classification (the problem of estimating a map from a set of to-be-classified elements to a set of labels), clustering (the problem of…

Machine Learning · Computer Science 2014-08-06 Lizhen Qu , Bjoern Andres