English
Related papers

Related papers: Structure learning in polynomial time: Greedy algo…

200 papers

Although many algorithms have been designed to construct Bayesian network structures using different approaches and principles, they all employ only two methods: those based on independence criteria, and those based on a scoring function…

Artificial Intelligence · Computer Science 2011-07-04 S. Acid , L. M. de Campos

We analyze greedy algorithms for the Hierarchical Aggregation (HAG) problem, a strategy introduced in [Jia et al., KDD 2020] for speeding up learning on Graph Neural Networks (GNNs). The idea of HAG is to identify and remove redundancies in…

Data Structures and Algorithms · Computer Science 2021-02-09 Alexandra Porter , Mary Wootters

Directed acyclic graphs (DAGs) are commonly used to model causal relationships among random variables. In general, learning the DAG structure is both computationally and statistically challenging. Moreover, without additional information,…

Machine Learning · Statistics 2024-03-26 Ali Shojaie , Wenyu Chen

Causal Bayesian networks (CBN) are popular graphical probabilistic models that encode causal relations among variables. Learning their graphical structure from observational data has received a lot of attention in the literature. When there…

Machine Learning · Computer Science 2024-08-22 Christophe Gonzales , Amir-Hosein Valizadeh

Learning the structure of Bayesian networks from data is known to be a computationally challenging, NP-hard problem. The literature has long investigated how to perform structure learning from data containing large numbers of variables,…

Computation · Statistics 2019-10-25 Marco Scutari , Claudia Vitolo , Allan Tucker

Recovering underlying Directed Acyclic Graph (DAG) structures from observational data is highly challenging due to the combinatorial nature of the DAG-constrained optimization problem. Recently, DAG learning has been cast as a continuous…

Machine Learning · Computer Science 2022-12-23 Zhen Zhang , Ignavier Ng , Dong Gong , Yuhang Liu , Ehsan M Abbasnejad , Mingming Gong , Kun Zhang , Javen Qinfeng Shi

Orthogonal greedy learning (OGL) is a stepwise learning scheme that starts with selecting a new atom from a specified dictionary via the steepest gradient descent (SGD) and then builds the estimator through orthogonal projection. In this…

Machine Learning · Computer Science 2016-04-21 Lin Xu , Shaobo Lin , Jinshan Zeng , Xia Liu , Zongben Xu

Greedy algorithms are a fundamental category of algorithms in mathematics and computer science, characterized by their iterative, locally optimal decision-making approach, which aims to find global optima. In this review, we will discuss…

Functional Analysis · Mathematics 2024-12-09 Andrea García

We show for several computational problems how classical greedy algorithms for special cases can be derived in a simple way from dynamic programs for the general case: interval scheduling (restricted to unit weights), knapsack (restricted…

Data Structures and Algorithms · Computer Science 2026-02-26 Dieter van Melkebeek

We analyze the complexity of learning directed acyclic graphical models from observational data in general settings without specific distributional assumptions. Our approach is information-theoretic and uses a local Markov boundary search…

Statistics Theory · Mathematics 2021-11-23 Ming Gao , Bryon Aragam

We consider the problem of learning a causal graph over a set of variables with interventions. We study the cost-optimal causal graph learning problem: For a given skeleton (undirected version of the causal graph), design the set of…

Artificial Intelligence · Computer Science 2017-03-09 Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath

Online learning algorithms, widely used to power search and content optimization on the web, must balance exploration and exploitation, potentially sacrificing the experience of current users in order to gain information that will lead to…

Machine Learning · Computer Science 2021-12-28 Manish Raghavan , Aleksandrs Slivkins , Jennifer Wortman Vaughan , Zhiwei Steven Wu

Bayesian networks, with structure given by a directed acyclic graph (DAG), are a popular class of graphical models. However, learning Bayesian networks from discrete or categorical data is particularly challenging, due to the large…

Methodology · Statistics 2018-02-06 Jiaying Gu , Fei Fu , Qing Zhou

Estimating the structure of directed acyclic graphs (DAGs) of features (variables) plays a vital role in revealing the latent data generation process and providing causal insights in various applications. Although there have been many…

Machine Learning · Computer Science 2024-03-06 Shaohua Fan , Shuyang Zhang , Xiao Wang , Chuan Shi

We study the problem of causal structure learning when the experimenter is limited to perform at most $k$ non-adaptive experiments of size $1$. We formulate the problem of finding the best intervention target set as an optimization problem,…

Machine Learning · Computer Science 2018-08-03 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Elias Bareinboim

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

Gaussian Graphical Models (GGMs) have wide-ranging applications in machine learning and the natural and social sciences. In most of the settings in which they are applied, the number of observed samples is much smaller than the dimension…

Machine Learning · Computer Science 2020-03-10 Jonathan Kelner , Frederic Koehler , Raghu Meka , Ankur Moitra

We consider the exploration problem: an agent equipped with a depth sensor must map out a previously unknown environment using as few sensor measurements as possible. We propose an approach based on supervised learning of a greedy…

Machine Learning · Computer Science 2022-03-29 Louis Ly , Yen-Hsi Richard Tsai

We introduce Selective Greedy Equivalence Search (SGES), a restricted version of Greedy Equivalence Search (GES). SGES retains the asymptotic correctness of GES but, unlike GES, has polynomial performance guarantees. In particular, we show…

Machine Learning · Computer Science 2015-06-09 David Maxwell Chickering , Christopher Meek

Several modern applications involve huge graphs and require fast answers to reachability queries. In more than two decades since first proposals, several approaches have been presented adopting on-line searches, hop labelling or transitive…

Data Structures and Algorithms · Computer Science 2016-11-09 Nicolas Boria , Gianpiero Cabodi , Paolo Camurati , Marco Palena , Paolo Pasini , Stefano Quer