English
Related papers

Related papers: Score-informed Neural Operator for Enhancing Order…

200 papers

Identifying causal relations from purely observational data typically requires additional assumptions on relations and/or noise. Most current methods restrict their analysis to datasets that are assumed to have pure linear or nonlinear…

Machine Learning · Computer Science 2024-10-10 Zhuopeng Xu , Yujie Li , Cheng Liu , Ning Gui

We present FLOP (Fast Learning of Order and Parents), a score-based causal discovery algorithm for linear models. It pairs fast parent selection with iterative Cholesky-based score updates, cutting run-times over prior algorithms. This…

Machine Learning · Statistics 2026-03-02 Marcel Wienöbst , Leonard Henckel , Sebastian Weichwald

Several machine learning applications involve the optimization of higher-order derivatives (e.g., gradients of gradients) during training, which can be expensive in respect to memory and computation even with automatic differentiation. As a…

Machine Learning · Computer Science 2020-11-26 Tianyu Pang , Kun Xu , Chongxuan Li , Yang Song , Stefano Ermon , Jun Zhu

The use of simulated data in the field of causal discovery is ubiquitous due to the scarcity of annotated real data. Recently, Reisach et al., 2021 highlighted the emergence of patterns in simulated linear data, which displays increasing…

Methodology · Statistics 2023-10-24 Francesco Montagna , Nicoletta Noceti , Lorenzo Rosasco , Francesco Locatello

Existing score-based methods for directed acyclic graph (DAG) learning from observational data struggle to recover the causal graph accurately and sample-efficiently. To overcome this, in this study, we propose DrBO (DAG recovery via…

Machine Learning · Computer Science 2025-01-28 Bao Duong , Sunil Gupta , Thin Nguyen

Causal inference can estimate causal effects, but unless data are collected experimentally, statistical analyses must rely on pre-specified causal models. Causal discovery algorithms are empirical methods for constructing such causal models…

Methodology · Statistics 2022-05-17 Anne Helby Petersen , Joseph Ramsey , Claus Thorn Ekstrøm , Peter Spirtes

We present a boosting-based method to learn additive Structural Equation Models (SEMs) from observational data, with a focus on the theoretical aspects of determining the causal order among variables. We introduce a family of score…

Machine Learning · Statistics 2024-01-15 Maximilian Kertel , Nadja Klein

Causal structure learning, also known as causal discovery, aims to estimate causal relationships between variables as a form of a causal directed acyclic graph (DAG) from observational data. One of the major frameworks is the order-based…

Machine Learning · Statistics 2026-02-18 Kentaro Kanamori , Hirofumi Suzuki , Takuya Takagi

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained…

Machine Learning · Computer Science 2024-10-16 Xinyu Liao , Aoyang Qin , Jacob Seidman , Junqi Wang , Wei Wang , Paris Perdikaris

The aim in many sciences is to understand the mechanisms that underlie the observed distribution of variables, starting from a set of initial hypotheses. Causal discovery allows us to infer mechanisms as sets of cause and effect…

Machine Learning · Computer Science 2025-03-05 Ashka Shah , Adela DePavia , Nathaniel Hudson , Ian Foster , Rick Stevens

We develop estimation for potentially high-dimensional additive structural equation models. A key component of our approach is to decouple order search among the variables from feature or edge selection in a directed acyclic graph encoding…

Methodology · Statistics 2014-12-02 Peter Bühlmann , Jonas Peters , Jan Ernest

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

Learning the unique directed acyclic graph corresponding to an unknown causal model is a challenging task. Methods based on functional causal models can identify a unique graph, but either suffer from the curse of dimensionality or impose…

Machine Learning · Computer Science 2025-01-14 Sujai Hiremath , Jacqueline R. M. A. Maasch , Mengxiao Gao , Promit Ghosal , Kyra Gan

As the significance of understanding the cause-and-effect relationships among variables increases in the development of modern systems and algorithms, learning causality from observational data has become a preferred and efficient approach…

Machine Learning · Computer Science 2024-11-28 Xiaoxuan Li , Yao Liu , Ruoyu Wang , Lina Yao

A Bayesian network is a probabilistic graphical model that consists of a directed acyclic graph (DAG), where each node is a random variable and attached to each node is a conditional probability distribution (CPD). A Bayesian network can be…

Machine Learning · Computer Science 2020-11-04 Charupriya Sharma , Zhenyu A. Liao , James Cussens , Peter van Beek

Recent advances have established the identifiability of a directed acyclic graph (DAG) under additive noise models (ANMs), spurring the development of various causal discovery methods. However, most existing methods make restrictive model…

Machine Learning · Statistics 2026-04-24 Stella Huang , Qing Zhou

Predicting causal structure from time series data is crucial for understanding complex phenomena in physiology, brain connectivity, climate dynamics, and socio-economic behaviour. Causal discovery in time series is hindered by the…

Machine Learning · Computer Science 2026-01-06 Pedro P. Sanchez , Damian Machlanski , Steven McDonagh , Sotirios A. Tsaftaris

Score-based generative models can effectively learn the distribution of data by estimating the gradient of the distribution. Due to the multi-step denoising characteristic, researchers have recently considered combining score-based…

Machine Learning · Computer Science 2024-12-17 Changyuan Zhao , Hongyang Du , Guangyuan Liu , Dusit Niyato

Channel estimation is a critical task in digital communications that greatly impacts end-to-end system performance. In this work, we introduce a novel approach for multiple-input multiple-output (MIMO) channel estimation using score-based…

Signal Processing · Electrical Eng. & Systems 2022-02-16 Marius Arvinte , Jonathan I Tamir

Under stringent model type and variable distribution assumptions, differentiable score-based causal discovery methods learn a directed acyclic graph (DAG) from observational data by evaluating candidate graphs over an average score…

Machine Learning · Computer Science 2023-03-07 An Zhang , Fangfu Liu , Wenchang Ma , Zhibo Cai , Xiang Wang , Tat-seng Chua