English
Related papers

Related papers: Structure learning in polynomial time: Greedy algo…

200 papers

We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables…

Machine Learning · Computer Science 2020-02-19 Sébastien Lachapelle , Philippe Brouillard , Tristan Deleu , Simon Lacoste-Julien

Decision trees and decision rule systems play important roles as classifiers, knowledge representation tools, and algorithms. They are easily interpretable models for data analysis, making them widely used and studied in computer science.…

Artificial Intelligence · Computer Science 2024-01-17 Kerven Durdymyradov , Mikhail Moshkov

In this paper, we address the problem of learning the structure of a pairwise graphical model from samples in a high-dimensional setting. Our first main result studies the sparsistency, or consistency in sparsity pattern recovery,…

Machine Learning · Computer Science 2012-02-28 Ali Jalali , Chris Johnson , Pradeep Ravikumar

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

In this report paper we first present a report of the Advanced Machine Learning Course Project on the provided data set and then present a novel heuristic algorithm for exact Bayesian network (BN) structure discovery that uses decomposable…

Artificial Intelligence · Computer Science 2014-11-26 Amir Arsalan Soltani

Determinantal point processes (DPPs) are popular probabilistic models that arise in many machine learning tasks, where distributions of diverse sets are characterized by matrix determinants. In this paper, we develop fast algorithms to find…

Discrete Mathematics · Computer Science 2017-06-15 Insu Han , Prabhanjan Kambadur , Kyoungsoo Park , Jinwoo Shin

Identifying the structure of a partially observed causal system is essential to various scientific fields. Recent advances have focused on constraint-based causal discovery to solve this problem, and yet in practice these methods often face…

Machine Learning · Computer Science 2026-05-04 Xinshuai Dong , Ignavier Ng , Haoyue Dai , Jiaqi Sun , Xiangchen Song , Peter Spirtes , Kun Zhang

Estimating the structure of directed acyclic graphs (DAGs, also known as Bayesian networks) is a challenging problem since the search space of DAGs is combinatorial and scales superexponentially with the number of nodes. Existing approaches…

Machine Learning · Statistics 2018-11-06 Xun Zheng , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

Directed acyclic graphical models, or DAG models, are widely used to represent complex causal systems. Since the basic task of learning such a model from data is NP-hard, a standard approach is greedy search over the space of directed…

Statistics Theory · Mathematics 2021-06-09 Liam Solus , Yuhao Wang , Caroline Uhler

Kernel-based schemes are state-of-the-art techniques for learning by data. In this work we extend some ideas about kernel-based greedy algorithms to exponential-polynomial splines, whose main drawback consists in possible overfitting and…

Numerical Analysis · Mathematics 2022-10-31 Rosanna Campagna , Stefano De Marchi , Emma Perracchione , Gabriele Santin

We propose a new yet natural algorithm for learning the graph structure of general discrete graphical models (a.k.a. Markov random fields) from samples. Our algorithm finds the neighborhood of a node by sequentially adding nodes that…

Machine Learning · Statistics 2012-02-09 Praneeth Netrapalli , Siddhartha Banerjee , Sujay Sanghavi , Sanjay Shakkottai

Learning from data that contain missing values represents a common phenomenon in many domains. Relatively few Bayesian Network structure learning algorithms account for missing data, and those that do tend to rely on standard approaches…

Machine Learning · Computer Science 2022-05-23 Yang Liu , Anthony C. Constantinou

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

It was recently shown that a version of the greedy algorithm gives a construction of fault-tolerant spanners that is size-optimal, at least for vertex faults. However, the algorithm to construct this spanner is not polynomial-time, and the…

Data Structures and Algorithms · Computer Science 2020-05-26 Michael Dinitz , Caleb Robelle

A novel and detailed convergence analysis is presented for a greedy algorithm that was previously introduced for operator reconstruction problems in the field of quantum mechanics. This algorithm is based on an offline/online decomposition…

Optimization and Control · Mathematics 2020-11-02 S Buchwald , G Ciaramella , Julien Salomon

We consider structure learning of linear Gaussian structural equation models with weak edges. Since the presence of weak edges can lead to a loss of edge orientations in the true underlying CPDAG, we define a new graphical object that can…

Methodology · Statistics 2017-07-25 Marco F. Eigenmann , Preetam Nandy , Marloes H. Maathuis

We study greedy-type algorithms such that at a greedy step we pick several dictionary elements contrary to a single dictionary element in standard greedy-type algorithms. We call such greedy algorithms {\it super greedy algorithms}. The…

Numerical Analysis · Mathematics 2010-10-27 Entao Liu , Vladimir N. Temlyakov

Temporal background information can improve causal discovery algorithms by orienting edges and identifying relevant adjustment sets. We develop the Temporal Greedy Equivalence Search (TGES) algorithm and terminology essential for…

Methodology · Statistics 2025-02-13 Tobias Ellegaard Larsen , Claus Thorn Ekstrøm , Anne Helby Petersen

Sparsity learning with known grouping structure has received considerable attention due to wide modern applications in high-dimensional data analysis. Although advantages of using group information have been well-studied by shrinkage-based…

Machine Learning · Statistics 2018-09-28 Wei Qian , Wending Li , Yasuhiro Sogawa , Ryohei Fujimaki , Xitong Yang , Ji Liu

Learning graphical structures based on Directed Acyclic Graphs (DAGs) is a challenging problem, partly owing to the large search space of possible graphs. A recent line of work formulates the structure learning problem as a continuous…

Machine Learning · Computer Science 2021-01-12 Ignavier Ng , AmirEmad Ghassami , Kun Zhang
‹ Prev 1 2 3 10 Next ›