English
Related papers

Related papers: Scalable Structure Learning for Sparse Context-Spe…

200 papers

Causal structure learning with data from multiple contexts carries both opportunities and challenges. Opportunities arise from considering shared and context-specific causal graphs enabling to generalize and transfer causal knowledge across…

Machine Learning · Computer Science 2024-10-29 Martin Rabel , Wiebke Günther , Jakob Runge , Andreas Gerhardus

We study a version of the proximal gradient algorithm for which the gradient is intractable and is approximated by Monte Carlo methods (and in particular Markov Chain Monte Carlo). We derive conditions on the step size and the Monte Carlo…

Statistics Theory · Mathematics 2016-11-22 Yves F. Atchade , Gersende Fort , Eric Moulines

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang

Modern retrieval systems are often driven by an underlying machine learning model. The goal of such systems is to identify and possibly rank the few most relevant items for a given query or context. Thus, such systems are typically…

Machine Learning · Statistics 2017-03-02 Elad ET. Eban , Mariano Schain , Alan Mackey , Ariel Gordon , Rif A. Saurous , Gal Elidan

A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good…

Statistics Theory · Mathematics 2011-11-11 Christian Schäfer , Nicolas Chopin

The graph structure of a Bayesian network (BN) can be learned from data using the well-known score-and-search approach. Previous work has shown that incorporating structured representations of the conditional probability distributions…

Machine Learning · Computer Science 2022-06-22 Charupriya Sharma , Peter van Beek

Causal structure learning refers to a process of identifying causal structures from observational data, and it can have multiple applications in biomedicine and health care. This paper provides a practical review and tutorial on scalable…

Machine Learning · Computer Science 2023-01-20 Pulakesh Upadhyaya , Kai Zhang , Can Li , Xiaoqian Jiang , Yejin Kim

Score-based approaches in the structure learning task are thriving because of their scalability. Continuous relaxation has been the key reason for this advancement. Despite achieving promising outcomes, most of these methods are still…

Machine Learning · Computer Science 2023-09-07 Quang-Duy Tran , Phuoc Nguyen , Bao Duong , Thin Nguyen

Modeling the time evolution of discrete sets of items (e.g., genetic mutations) is a fundamental problem in many biomedical applications. We approach this problem through the lens of continuous-time Markov chains, and show that the…

Machine Learning · Computer Science 2021-07-08 Alkis Gotovos , Rebekka Burkholz , John Quackenbush , Stefanie Jegelka

Learning the structure of a causal graphical model using both observational and interventional data is a fundamental problem in many scientific fields. A promising direction is continuous optimization for score-based methods, which,…

Machine Learning · Computer Science 2022-02-28 Phillip Lippe , Taco Cohen , Efstratios Gavves

In this work we handle with categorical (ordinal) variables and we focus on the (in)dependence relationship under the marginal, conditional and context-specific perspective. If the first two are well known, the last one concerns…

Methodology · Statistics 2017-12-25 Federica Nicolussi , Manuela Cazzaro

Gaussian concentration graph models and covariance graph models are two classes of graphical models that are useful for uncovering latent dependence structures among multivariate variables. In the Bayesian literature, graphs are often…

Statistics Theory · Mathematics 2015-05-08 Hao Wang

We investigate the capacity of transformers to learn algorithms involving their context while solely being trained using next token prediction. We set up Markov chains with random transition matrices and we train transformers to predict the…

Machine Learning · Computer Science 2025-08-07 Simon Lepage , Jeremie Mary , David Picard

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

This thesis studies two problems in modern statistics. First, we study selective inference, or inference for hypothesis that are chosen after looking at the data. The motiving application is inference for regression coefficients selected by…

Machine Learning · Statistics 2015-07-02 Jason D. Lee

Markov networks are widely studied and used throughout multivariate statistics and computer science. In particular, the problem of learning the structure of Markov networks from data without invoking chordality assumptions in order to…

Machine Learning · Statistics 2025-12-29 Juri Kuronen , Jukka Corander , Johan Pensar

The aim in many sciences is to understand the mechanisms that underlie the observed distribution of variables, starting from a set of initial hypotheses. Causal discovery allows us to infer mechanisms as sets of cause and effect…

Machine Learning · Computer Science 2025-03-05 Ashka Shah , Adela DePavia , Nathaniel Hudson , Ian Foster , Rick Stevens

We consider the structure learning problem for graphical models that we call loosely connected Markov random fields, in which the number of short paths between any pair of nodes is small, and present a new conditional independence test…

Machine Learning · Statistics 2014-02-05 Rui Wu , R. Srikant , Jian Ni

Causal discovery is a crucial initial step in establishing causality from empirical data and background knowledge. Numerous algorithms have been developed for this purpose. Among them, the score-matching method has demonstrated superior…

Machine Learning · Statistics 2026-04-14 Hao Chen , Kai Yi