English
Related papers

Related papers: Differentiable DAG Sampling

200 papers

We present Re-weighted Gradient Descent (RGD), a novel optimization technique that improves the performance of deep neural networks through dynamic sample re-weighting. Leveraging insights from distributionally robust optimization (DRO)…

Machine Learning · Computer Science 2024-10-15 Ramnath Kumar , Kushal Majmundar , Dheeraj Nagaraj , Arun Sai Suggala

Discovering the underlying Directed Acyclic Graph (DAG) from time series observational data is highly challenging due to the dynamic nature and complex nonlinear interactions between variables. Existing methods typically search for the…

Machine Learning · Computer Science 2025-03-21 Jiajun Zhang , Boyang Qiang , Xiaoyu Guo , Weiwei Xing , Yue Cheng , Witold Pedrycz

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

In this paper, we propose a novel inference method for dynamic genetic networks which makes it possible to face with a number of time measurements n much smaller than the number of genes p. The approach is based on the concept of low order…

Statistics Theory · Mathematics 2009-05-29 Sophie Lèbre

With huge amounts of training data, deep learning has made great breakthroughs in many artificial intelligence (AI) applications. However, such large-scale data sets present computational challenges, requiring training to be distributed on…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-01 Shaohuai Shi , Qiang Wang , Xiaowen Chu , Bo Li

We deal with the combinatorial problem of learning directed acyclic graph (DAG) structure from observational data adhering to a linear structural equation model (SEM). Leveraging advances in differentiable, nonconvex characterizations of…

Machine Learning · Computer Science 2024-03-14 Seyed Saman Saboksayr , Gonzalo Mateos , Mariano Tepper

To represent the causal relationships between variables, a directed acyclic graph (DAG) is widely utilized in many areas, such as social sciences, epidemics, and genetics. Many causal structure learning approaches are developed to learn the…

Machine Learning · Statistics 2025-01-14 Jianian Wang , Rui Song

A growing number of applications like probabilistic machine learning, sparse linear algebra, robotic navigation, etc., exhibit irregular data flow computation that can be modeled with directed acyclic graphs (DAGs). The irregularity arises…

Hardware Architecture · Computer Science 2022-10-25 Nimish Shah , Wannes Meert , Marian Verhelst

Estimating the structure of directed acyclic graphs (DAGs) from observational data remains a significant challenge in machine learning. Most research in this area concentrates on learning a single DAG for the entire population. This paper…

Machine Learning · Statistics 2024-02-21 Ryan Thompson , Edwin V. Bonilla , Robert Kohn

Identifying causal relations among multi-variate time series is one of the most important elements towards understanding the complex mechanisms underlying the dynamic system. It provides critical tools for forecasting, simulations and…

Machine Learning · Computer Science 2023-02-22 Yang Sun , Yifan Xie

Precise knowledge of causal directed acyclic graphs (DAGs) is assumed for standard approaches towards valid adjustment set selection for unbiased estimation, but in practice, the DAG is often inferred from data or expert knowledge,…

Statistics Theory · Mathematics 2025-11-14 Zhongyi Hu , Stéphanie van der Pas

In recent years, there has been a growing research interest in decision-focused learning, which embeds optimization problems as a layer in learning pipelines and demonstrates a superior performance than the prediction-focused approach.…

Optimization and Control · Mathematics 2024-06-25 Xutao Ma , Chao Ning , Wenli Du

While training on samples drawn from independent and identical distribution has been a de facto paradigm for optimizing image classification networks, humans learn new concepts in an easy-to-hard manner and on the selected examples…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Bowen Cheng , Yunchao Wei , Jiahui Yu , Shiyu Chang , Jinjun Xiong , Wen-Mei Hwu , Thomas S. Huang , Humphrey Shi

We address the identifiablity and estimation of recursive max-linear structural equation models represented by an edge weighted directed acyclic graph (DAG). Such models are generally unidentifiable and we identify the whole class of DAGs…

Statistics Theory · Mathematics 2019-10-08 Nadine Gissibl , Claudia Klüppelberg , Steffen Lauritzen

Directed acyclic graphical models (DAGs) are often used to describe common structural properties in a family of probability distributions. This paper addresses the question of classifying DAGs up to an isomorphism. By considering Gaussian…

Information Theory · Computer Science 2014-12-24 Hajir Roozbehani , Yury Polyanskiy

This paper explores the role of Directed Acyclic Graphs (DAGs) as a representation of conditional independence relationships. We show that DAGs offer polynomially sound and complete inference mechanisms for inferring conditional…

Artificial Intelligence · Computer Science 2013-04-10 Dan Geiger , Judea Pearl

Efficient scheduling of directed acyclic graphs (DAGs) in heterogeneous environments is challenging due to resource capacities and dependencies. In practice, the need for adaptability across environments with varying resource pools and task…

Machine Learning · Computer Science 2026-03-25 Ruisong Zhou , Haijun Zou , Li Zhou , Chumin Sun , Zaiwen Wen

Causal structures for observational survival data provide crucial information regarding the relationships between covariates and time-to-event. We derive motivation from the information theoretic source coding argument, and show that…

Machine Learning · Computer Science 2021-11-03 Ansh Kumar Sharma , Rahul Kukreja , Ranjitha Prasad , Shilpa Rao

In this paper, we propose a score-based normalizing flow method called DAG-NF to learn dependencies of input observation data. Inspired by Grad-CAM in computer vision, we use jacobian matrix of output on input as causal relationships and…

Machine Learning · Computer Science 2020-10-08 Xiongren Chen

Learning the structure of causal directed acyclic graphs (DAGs) is useful in many areas of machine learning and artificial intelligence, with wide applications. However, in the high-dimensional setting, it is challenging to obtain good…

Machine Learning · Statistics 2024-05-27 Stephen Smith , Qing Zhou