English
Related papers

Related papers: Score-based Greedy Search for Structure Identifica…

200 papers

We consider the problem of finding sparse solutions to a system of underdetermined nonlinear system of equations. The methods are based on a Gauss-Newton approach with line search where the search direction is found by solving a linearized…

Numerical Analysis · Mathematics 2016-10-12 Mårten Gulliksson , Anna Oleynik

Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal…

Machine Learning · Computer Science 2021-08-04 Nataliya Sokolovska , Pierre-Henri Wuillemin

Given data sampled from a number of variables, one is often interested in the underlying causal relationships in the form of a directed acyclic graph. In the general case, without interventions on some of the variables it is only possible…

Machine Learning · Statistics 2017-12-05 Christopher Nowzohour , Peter Bühlmann

Causal discovery methods are intrinsically constrained by the set of assumptions needed to ensure structure identifiability. Moreover additional restrictions are often imposed in order to simplify the inference task: this is the case for…

Machine Learning · Computer Science 2023-04-07 Francesco Montagna , Nicoletta Noceti , Lorenzo Rosasco , Kun Zhang , Francesco Locatello

In this paper, we address the problem of learning the structure of a pairwise graphical model from samples in a high-dimensional setting. Our first main result studies the sparsistency, or consistency in sparsity pattern recovery,…

Machine Learning · Computer Science 2012-02-28 Ali Jalali , Chris Johnson , Pradeep Ravikumar

Predicting stable and metastable structures is central to molecular and materials discovery, but remains limited by the cost of searching high-dimensional energy landscapes. Deep generative models offer efficient structure sampling, yet…

Artificial Intelligence · Computer Science 2026-05-26 Yifang Qin , Yu Shi , Junfu Tan , Chang Liu , Ming Zhang , Ziheng Lu

Identifying cause-effect relations among variables is a key step in the decision-making process. While causal inference requires randomized experiments, researchers and policymakers are increasingly using observational studies to test…

Optimization and Control · Mathematics 2021-11-22 Md Saiful Islam , Md Sarowar Morshed , Md. Noor-E-Alam

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

Neural and Evolutionary Computing · Computer Science 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed…

Machine Learning · Computer Science 2019-11-19 Ignavier Ng , Shengyu Zhu , Zhitang Chen , Zhuangyan Fang

We study the problem of causal structure learning when the experimenter is limited to perform at most $k$ non-adaptive experiments of size $1$. We formulate the problem of finding the best intervention target set as an optimization problem,…

Machine Learning · Computer Science 2018-08-03 AmirEmad Ghassami , Saber Salehkaleybar , Negar Kiyavash , Elias Bareinboim

Discovering causal structures with latent variables from observational data is a fundamental challenge in causal discovery. Existing methods often rely on constraint-based, iterative discrete searches, limiting their scalability to large…

Machine Learning · Computer Science 2024-12-02 Parjanya Prashant , Ignavier Ng , Kun Zhang , Biwei Huang

This work addresses the problem of exploration in an unknown environment. For linear dynamical systems, we use an experimental design framework and introduce an online greedy policy where the control maximizes the information of the next…

Machine Learning · Statistics 2023-04-27 Matthieu Blanke , Marc Lelarge

Efficiently representing real world data in a succinct and parsimonious manner is of central importance in many fields. We present a generalized greedy pursuit framework, allowing us to efficiently solve structured matrix factorization…

Machine Learning · Computer Science 2016-02-15 Rajiv Khanna , Michael Tschannen , Martin Jaggi

The discovery of structure from time series data is a key problem in fields of study working with complex systems. Most identifiability results and learning algorithms assume the underlying dynamics to be discrete in time. Comparatively…

Machine Learning · Statistics 2022-02-04 Alexis Bellot , Kim Branson , Mihaela van der Schaar

We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables…

Machine Learning · Computer Science 2020-02-19 Sébastien Lachapelle , Philippe Brouillard , Tristan Deleu , Simon Lacoste-Julien

The existence of latent variables in practical problems is common, for example when some variables are difficult or expensive to measure, or simply unknown. When latent variables are unaccounted for, structure learning for Gaussian…

Methodology · Statistics 2025-02-06 Ignacio Echave-Sustaeta Rodríguez , Frank Röttger

We propose a greedy search-and-score algorithm for ancestral graphs, which include directed as well as bidirected edges, originating from unobserved latent variables. The normalized likelihood score of ancestral graphs is estimated in terms…

Machine Learning · Computer Science 2024-12-30 Nikita Lagrange , Herve Isambert

Graphical models are widely used to model stochastic dependences among large collections of variables. We introduce a new method of estimating undirected conditional independence graphs based on the score matching loss, introduced by…

Methodology · Statistics 2016-03-24 Lina Lin , Mathias Drton , Ali Shojaie

A greedy algorithm is proposed for sparse-sensor selection in reduced-order sensing that contains correlated noise in measurement. The sensor selection is carried out by maximizing the determinant of the Fisher information matrix in a…

Optimization and Control · Mathematics 2021-04-28 Keigo Yamada , Yuji Saito , Koki Nankai , Taku Nonomura , Keisuke Asai , Daisuke Tsubakino

We present a hybrid constraint-based/Bayesian algorithm for learning causal networks in the presence of sparse data. The algorithm searches the space of equivalence classes of models (essential graphs) using a heuristic based on…

Artificial Intelligence · Computer Science 2013-01-30 Denver Dash , Marek J. Druzdzel