English
Related papers

Related papers: Gradient-based Causal Structure Learning with Norm…

200 papers

Graph neural networks have shown great ability in representation (GNNs) learning on graphs, facilitating various tasks. Despite their great performance in modeling graphs, recent works show that GNNs tend to inherit and amplify the bias…

Machine Learning · Computer Science 2023-08-22 Zhimeng Guo , Jialiang Li , Teng Xiao , Yao Ma , Suhang Wang

Data-driven graph learning models a network by determining the strength of connections between its nodes. The data refers to a graph signal which associates a value with each graph node. Existing graph learning methods either use simplified…

Machine Learning · Computer Science 2020-11-05 Nafiseh Ghoroghchian , David M. Groppe , Roman Genov , Taufik A. Valiante , Stark C. Draper

Causal Discovery methods aim to identify a DAG structure that represents causal relationships from observational data. In this article, we stress that it is important to test such methods for robustness in practical settings. As our main…

Machine Learning · Statistics 2021-06-16 Marcus Kaiser , Maksim Sipos

We consider the problem of learning the underlying causal structure among a set of variables, which are assumed to follow a Bayesian network or, more specifically, a linear recursive structural equation model (SEM) with the associated…

Statistics Theory · Mathematics 2025-08-05 Anamitra Chaudhuri , Anirban Bhattacharya , Yang Ni

Graph Neural Networks (GNNs) have emerged as powerful representation learning tools for capturing complex dependencies within diverse graph-structured data. Despite their success in a wide range of graph mining tasks, GNNs have raised…

Machine Learning · Computer Science 2024-06-19 Wenzhao Jiang , Hao Liu , Hui Xiong

Traditional approaches for learning on categorical data underexploit the dependencies between columns (\aka fields) in a dataset because they rely on the embedding of data points driven alone by the classification/regression loss. In…

Machine Learning · Computer Science 2023-07-19 Zhibin Li , Piotr Koniusz , Lu Zhang , Daniel Edward Pagendam , Peyman Moghadam

We consider graphs that represent pairwise marginal independencies amongst a set of variables (for instance, the zero entries of a covariance matrix for normal data). We characterize the directed acyclic graphs (DAGs) that faithfully…

Artificial Intelligence · Computer Science 2015-08-04 Johannes Textor , Alexander Idelberger , Maciej Liśkiewicz

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

Conventional neural architecture search (NAS) approaches are based on reinforcement learning or evolutionary strategy, which take more than 3000 GPU hours to find a good model on CIFAR-10. We propose an efficient NAS approach learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Xuanyi Dong , Yi Yang

Generative models aim to learn the distribution of datasets, such as images, so as to be able to generate samples that statistically resemble real data. However, learning the underlying probability distribution can be very challenging and…

Machine Learning · Computer Science 2024-09-20 Zeyang Yu , Shengxi Li , Danilo Mandic

Estimating the causal structure of observational data is a challenging combinatorial search problem that scales super-exponentially with graph size. Existing methods use continuous relaxations to make this problem computationally tractable…

Machine Learning · Computer Science 2024-02-20 Hamidreza Kamkari , Vahid Balazadeh , Vahid Zehtab , Rahul G. Krishnan

New biological assays like Perturb-seq link highly parallel CRISPR interventions to a high-dimensional transcriptomic readout, providing insight into gene regulatory networks. Causal gene regulatory networks can be represented by directed…

Machine Learning · Statistics 2024-02-22 Albert Xue , Jingyou Rao , Sriram Sankararaman , Harold Pimentel

We conjecture that the inherent difference in generalisation between adaptive and non-adaptive gradient methods in deep learning stems from the increased estimation noise in the flattest directions of the true loss surface. We demonstrate…

Machine Learning · Statistics 2022-03-17 Diego Granziol , Nicholas Baskerville

In this paper, we propose Continuous Graph Flow, a generative continuous flow based method that aims to model complex distributions of graph-structured data. Once learned, the model can be applied to an arbitrary graph, defining a…

Machine Learning · Computer Science 2019-10-01 Zhiwei Deng , Megha Nawhal , Lili Meng , Greg Mori

Recent advances have established the identifiability of a directed acyclic graph (DAG) under additive noise models (ANMs), spurring the development of various causal discovery methods. However, most existing methods make restrictive model…

Machine Learning · Statistics 2026-04-24 Stella Huang , Qing Zhou

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

In the algorithm Intersort, Chevalley et al. (2024) proposed a score-based method to discover the causal order of variables in a Directed Acyclic Graph (DAG) model, leveraging interventional data to outperform existing methods. However, as…

Machine Learning · Computer Science 2024-10-14 Mathieu Chevalley , Arash Mehrjou , Patrick Schwab

The assumption of independence between observations (units) in a dataset is prevalent across various methodologies for learning causal graphical models. However, this assumption often finds itself in conflict with real-world data, posing…

Machine Learning · Computer Science 2024-12-31 Alex Chen , Qing Zhou

Computing the Banzhaf value in network flow games is fundamental for quantifying agent influence in multi-agent systems, with applications ranging from cybersecurity to infrastructure planning. However, exact computation is intractable for…

Machine Learning · Computer Science 2025-10-21 Benjamin Kempinski , Tal Kachman

Generating safety-critical scenarios, which are crucial yet difficult to collect, provides an effective way to evaluate the robustness of autonomous driving systems. However, the diversity of scenarios and efficiency of generation methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao