English
Related papers

Related papers: Information Gradient for Directed Acyclic Graphs: …

200 papers

Score-based models have recently been introduced as a richer framework to model distributions in high dimensions and are generally more suitable for generative tasks. In score-based models, a generative task is formulated using a parametric…

Machine Learning · Computer Science 2023-02-07 Harsh Mishra , Jurijs Nazarovs , Manmohan Dogra , Sathya N. Ravi

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose a unified framework named Online Compressed Gradient Tracking (OCGT),…

Optimization and Control · Mathematics 2025-12-08 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao , Xiangyong Chen

Asynchronous computation and gradient compression have emerged as two key techniques for achieving scalability in distributed optimization for large-scale machine learning. This paper presents a unified analysis framework for distributed…

Optimization and Control · Mathematics 2018-11-30 Sarit Khirirat , Hamid Reza Feyzmahdavian , Mikael Johansson

We propose an adaptive step-size rule for decentralized optimization. Choosing a step-size that balances convergence and stability is challenging. This is amplified in the decentralized setting as agents observe only local (possibly…

Optimization and Control · Mathematics 2026-02-17 Aaron Fainman , Stefan Vlaski

We present a graphical approach to deriving inequality constraints for directed acyclic graph (DAG) models, where some variables are unobserved. In particular we show that the observed distribution of a discrete model is always restricted…

Statistics Theory · Mathematics 2012-09-14 Robin J. Evans

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

Bayesian networks are probabilistic graphical models widely employed to understand dependencies in high dimensional data, and even to facilitate causal discovery. Learning the underlying network structure, which is encoded as a directed…

Machine Learning · Statistics 2022-02-03 Jack Kuipers , Polina Suter , Giusi Moffa

We present a graphical criterion for covariate adjustment that is sound and complete for four different classes of causal graphical models: directed acyclic graphs (DAGs), maximum ancestral graphs (MAGs), completed partially directed…

Statistics Theory · Mathematics 2018-06-20 Emilija Perković , Johannes Textor , Markus Kalisch , Marloes H. Maathuis

Distributed learning has gained significant attention due to its advantages in scalability, privacy, and fault tolerance.In this paradigm, multiple agents collaboratively train a global model by exchanging parameters only with their…

Machine Learning · Computer Science 2026-03-31 Ziqin Chen , Yongqiang Wang

Federated learning allows a group of distributed clients to train a common machine learning model on private data. The exchange of model updates is managed either by a central entity or in a decentralized way, e.g. by a blockchain. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-04 Jossekin Beilharz , Bjarne Pfitzner , Robert Schmid , Paul Geppert , Bert Arnrich , Andreas Polze

Novel vehicular communication methods are mostly analyzed simulatively or analytically as real world performance tests are highly time-consuming and cost-intense. Moreover, the high number of uncontrollable effects makes it practically…

Networking and Internet Architecture · Computer Science 2019-11-22 Benjamin Sliwa , Christian Wietfeld

Parameterized feedforward control is at the basis of many successful control applications with varying references. The aim of this paper is to develop an efficient data-driven approach to learn the feedforward parameters for MIMO systems.…

Systems and Control · Electrical Eng. & Systems 2022-09-13 Leontine Aarnoudse , Tom Oomen

Estimating the structure of Bayesian networks as directed acyclic graphs (DAGs) from observational data is a fundamental challenge, particularly in causal discovery. Bayesian approaches excel by quantifying uncertainty and addressing…

Machine Learning · Computer Science 2026-02-17 Edwin V. Bonilla , Pantelis Elinas , He Zhao , Maurizio Filippone , Vassili Kitsios , Terry O'Kane

We consider a generic decentralized constrained optimization problem over static, directed communication networks, where each agent has exclusive access to only one convex, differentiable, local objective term and one convex constraint set.…

Optimization and Control · Mathematics 2023-11-09 Firooz Shahriari-Mehr , Ashkan Panahi

Gradient-type distributed optimization methods have blossomed into one of the most important tools for solving a minimization learning task over a networked agent system. However, only one gradient update per iteration is difficult to…

Optimization and Control · Mathematics 2024-03-06 Mou Wu , Haibin Liao , Zhengtao Ding , Yonggang Xiao

Estimating the structure of directed acyclic graphs (DAGs, also known as Bayesian networks) is a challenging problem since the search space of DAGs is combinatorial and scales superexponentially with the number of nodes. Existing approaches…

Machine Learning · Statistics 2018-11-06 Xun Zheng , Bryon Aragam , Pradeep Ravikumar , Eric P. Xing

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation. To this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

Recent recommender system advancements have focused on developing sequence-based and graph-based approaches. Both approaches proved useful in modeling intricate relationships within behavioral data, leading to promising outcomes in…

Information Retrieval · Computer Science 2024-03-18 Vladimir Baikalov , Evgeny Frolov

Multi-task learning (MTL) has been widely applied in online advertising and recommender systems. To address the negative transfer issue, recent studies have proposed optimization methods that thoroughly focus on the gradient alignment of…

Information Retrieval · Computer Science 2023-03-13 Xuanhua Yang , Jianxin Zhao , Shaoguo Liu , Liang Wang , Bo Zheng

We consider matrix completion for recommender systems from the point of view of link prediction on graphs. Interaction data such as movie ratings can be represented by a bipartite user-item graph with labeled edges denoting observed…

Machine Learning · Statistics 2017-10-27 Rianne van den Berg , Thomas N. Kipf , Max Welling