English
Related papers

Related papers: Constraint-Free Structure Learning with Smooth Acy…

200 papers

Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationally challenging to…

Machine Learning · Statistics 2026-02-09 Ryan Thompson , Edwin V. Bonilla , Robert Kohn

Bayesian networks are a class of popular graphical models that encode causal and conditional independence relations among variables by directed acyclic graphs (DAGs). We propose a novel structure learning method, annealing on regularized…

Machine Learning · Statistics 2020-05-04 Qiaoling Ye , Arash A. Amini , Qing Zhou

Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this…

Optimization and Control · Mathematics 2018-01-19 Bo Jiang , Tianyi Lin , Shiqian Ma , Shuzhong Zhang

Directed acyclic graph (DAG) models are widely used to represent causal relationships among random variables in many application domains. This paper studies a special class of non-Gaussian DAG models, where the conditional variance of each…

Machine Learning · Statistics 2021-11-03 Wei Zhou , Xin He , Wei Zhong , Junhui Wang

We develop a novel convolutional architecture tailored for learning from data defined over directed acyclic graphs (DAGs). DAGs can be used to model causal relationships among variables, but their nilpotent adjacency matrices pose unique…

Machine Learning · Computer Science 2024-05-07 Samuel Rey , Hamed Ajorlou , Gonzalo Mateos

Bayesian networks are probabilistic graphical models widely employed to understand dependencies in high dimensional data, and even to facilitate causal discovery. Learning the underlying network structure, which is encoded as a directed…

Machine Learning · Statistics 2022-02-03 Jack Kuipers , Polina Suter , Giusi Moffa

Large-scale machine learning models necessitate distributed systems, posing significant design challenges due to the large parameter space across distinct design stacks. Existing studies often focus on optimizing individual system aspects…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-22 Aditi Raju , Jared Ni , William Won , Changhai Man , Srivatsan Krishnan , Srinivas Sridharan , Amir Yazdanbakhsh , Tushar Krishna , Vijay Janapa Reddi

The constraints arising from DAG models with latent variables can be naturally represented by means of acyclic directed mixed graphs (ADMGs). Such graphs contain directed and bidirected arrows, and contain no directed cycles. DAGs with…

Machine Learning · Statistics 2012-07-24 Ilya Shpitser , Thomas S. Richardson , James M. Robins , Robin Evans

Directed acyclic graphs (DAGs) are commonly used to represent causal relationships among random variables in graphical models. Applications of these models arise in the study of physical, as well as biological systems, where directed edges…

Machine Learning · Statistics 2009-12-01 Ali Shojaie , George Michailidis

We consider the problem of structure learning for bow-free acyclic path diagrams (BAPs). BAPs can be viewed as a generalization of linear Gaussian DAG models that allow for certain hidden variables. We present a first method for this…

Machine Learning · Statistics 2017-12-05 Christopher Nowzohour , Marloes H. Maathuis , Robin J. Evans , Peter Bühlmann

Due to its human-interpretability and invariance properties, Directed Acyclic Graph (DAG) has been a foundational tool across various areas of AI research, leading to significant advancements. However, DAG learning remains highly…

Machine Learning · Computer Science 2025-06-24 Naiyu Yin , Tian Gao , Yue Yu

We consider a smoothed online convex optimization (SOCO) problem with predictions, where the learner has access to a finite lookahead window of time-varying stage costs, but suffers a switching cost for changing its actions at each stage.…

Optimization and Control · Mathematics 2023-10-16 Spandan Senapati , Ashwin Shenai , Ketan Rajawat

In many statistical learning problems, it is desired that the optimal solution conforms to an a priori known sparsity structure represented by a directed acyclic graph. Inducing such structures by means of convex regularizers requires…

Optimization and Control · Mathematics 2020-10-20 Dewei Zhang , Yin Liu , Sam Davanloo Tajbakhsh

We analyze the complexity of learning directed acyclic graphical models from observational data in general settings without specific distributional assumptions. Our approach is information-theoretic and uses a local Markov boundary search…

Statistics Theory · Mathematics 2021-11-23 Ming Gao , Bryon Aragam

Causal structure learning, also known as causal discovery, aims to estimate causal relationships between variables as a form of a causal directed acyclic graph (DAG) from observational data. One of the major frameworks is the order-based…

Machine Learning · Statistics 2026-02-18 Kentaro Kanamori , Hirofumi Suzuki , Takuya Takagi

We study the problem of learning a directed acyclic graph from data generated according to an additive, non-linear structural equation model with Gaussian noise. We express each non-linear function through a basis expansion, and derive a…

Methodology · Statistics 2025-11-27 Xiaozhu Zhang , Nir Keret , Ali Shojaie , Armeen Taeb

How to obtain a graph from data samples is an important problem in graph signal processing. One way to formulate this graph learning problem is based on Gaussian maximum likelihood estimation, possibly under particular topology constraints.…

Signal Processing · Electrical Eng. & Systems 2017-11-02 Keng-Shih Lu , Antonio Ortega

We propose a novel formalism for describing Structural Causal Models (SCMs) as fixed-point problems on causally ordered variables, eliminating the need for Directed Acyclic Graphs (DAGs), and establish the weakest known conditions for their…

Machine Learning · Computer Science 2024-12-16 Meyer Scetbon , Joel Jennings , Agrin Hilmkil , Cheng Zhang , Chao Ma

The problem of learning structural equation models (SEMs) from data is a fundamental problem in causal inference. We develop a new algorithm --- which is computationally and statistically efficient and works in the high-dimensional regime…

Machine Learning · Computer Science 2019-01-30 Asish Ghoshal , Jean Honorio

This paper introduces new parameter-free first-order methods for convex optimization problems in which the objective function exhibits H\"{o}lder smoothness. Inspired by the recently proposed distance-over-gradient (DOG) technique, we…

Optimization and Control · Mathematics 2025-10-28 Yijin Ren , Haifeng Xu , Qi Deng