English
Related papers

Related papers: Learning Data Dependency with Communication Cost

200 papers

We study the scalability of consensus-based distributed optimization algorithms by considering two questions: How many processors should we use for a given problem, and how often should they communicate when communication is not free?…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-06 Konstantinos I. Tsianos , Sean Lawlor , Michael G. Rabbat

This work presents a two-stage neural architecture for learning and refining structural correspondences between graphs. First, we use localized node embeddings computed by a graph neural network to obtain an initial ranking of soft…

Machine Learning · Computer Science 2020-01-28 Matthias Fey , Jan E. Lenssen , Christopher Morris , Jonathan Masci , Nils M. Kriege

Understanding relationships between feature variables is one important way humans use to make decisions. However, state-of-the-art deep learning studies either focus on task-agnostic statistical dependency learning or do not model explicit…

Machine Learning · Computer Science 2021-03-04 Arshdeep Sekhon , Zhe Wang , Yanjun Qi

Coordination graph is a promising approach to model agent collaboration in multi-agent reinforcement learning. It conducts a graph-based value factorization and induces explicit coordination among agents to complete complicated tasks.…

Machine Learning · Computer Science 2022-09-20 Qianlan Yang , Weijun Dong , Zhizhou Ren , Jianhao Wang , Tonghan Wang , Chongjie Zhang

In a sensor network, in practice, the communication among sensors is subject to:(1) errors or failures at random times; (3) costs; and(2) constraints since sensors and networks operate under scarce resources, such as power, data rate, or…

Information Theory · Computer Science 2009-11-13 Soummya Kar , Jose M. F. Moura

This paper designs and implements an explainable recommendation model that integrates knowledge graphs with structure-aware attention mechanisms. The model is built on graph neural networks and incorporates a multi-hop neighbor aggregation…

Information Retrieval · Computer Science 2025-10-14 Shuangquan Lyu , Ming Wang , Huajun Zhang , Jiasen Zheng , Junjiang Lin , Xiaoxuan Sun

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

Machine Learning · Statistics 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

We address the joint problem of learning and scheduling in multi-hop wireless network without a prior knowledge on link rates. Previous scheduling algorithms need the link rate information, and learning algorithms often require a…

Networking and Internet Architecture · Computer Science 2023-12-11 Daehyun Park , Sunjung Kang , Changhee Joo

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

It is widely believed that the formation of brain network structure is under the pressure of optimal trade-off between reducing wiring cost and promoting communication efficiency. However, the question of whether this trade-off exists in…

Neurons and Cognition · Quantitative Biology 2020-12-10 Junji Ma , Jinbo Zhang , Ying Lin , Zhengjia Dai

Great research efforts have been devoted to exploiting deep neural networks in stock prediction. While long-range dependencies and chaotic property are still two major issues that lower the performance of state-of-the-art deep learning…

Statistical Finance · Quantitative Finance 2021-11-02 Junran Wu , Ke Xu , Xueyuan Chen , Shangzhe Li , Jichang Zhao

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Markov networks are probabilistic graphical models that employ undirected graphs to depict conditional independence relationships among variables. Our focus lies in constraint-based structure learning, which entails learning the undirected…

Machine Learning · Computer Science 2024-03-14 Tuukka Korhonen , Fedor V. Fomin , Pekka Parviainen

In this paper, learning of tree-structured Gaussian graphical models from distributed data is addressed. In our model, samples are stored in a set of distributed machines where each machine has access to only a subset of features. A central…

Machine Learning · Computer Science 2018-12-05 Mostafa Tavassolipour , Seyed Abolfazl Motahari , Mohammad-Taghi Manzuri Shalmani

Graph structure learning aims to learn connectivity in a graph from data. It is particularly important for many computer vision related tasks since no explicit graph structure is available for images for most cases. A natural way to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Yaohua Wang , FangYi Zhang , Ming Lin , Senzhang Wang , Xiuyu Sun , Rong Jin

This work reports the most relevant technical aspects in the problem of learning the \emph{Markov network structure} from data. Such problem has become increasingly important in machine learning, and many other application fields of machine…

Artificial Intelligence · Computer Science 2013-11-21 Federico Schlüter

Uniform sampling from graphical realizations of a given degree sequence is a fundamental component in simulation-based measurements of network observables, with applications ranging from epidemics, through social networks to Internet…

Physics and Society · Physics 2010-04-14 Charo I. Del Genio , Hyunju Kim , Zoltan Toroczkai , Kevin E. Bassler

In recent years, various deep learning architectures have been proposed to solve complex challenges (e.g. spatial dependency, temporal dependency) in traffic domain, which have achieved satisfactory performance. These architectures are…

Signal Processing · Electrical Eng. & Systems 2021-01-01 Jiexia Ye , Juanjuan Zhao , Kejiang Ye , Chengzhong Xu

A statistically principled way of conducting weighted network analysis is still lacking. Comparison of different populations of weighted networks is hard because topology is inherently dependent on wiring cost, where cost is defined as the…

Molecular Networks · Quantitative Biology 2015-05-27 Cedric E. Ginestet , Thomas E. Nichols , Ed T. Bullmore , Andrew Simmons

We consider the average-consensus problem in a multi-node network of finite size. Communication between nodes is modeled by a sequence of directed signals with arbitrary communication delays. Four distributed algorithms that achieve…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-23 Kevin Topley , Vikram Krishnamurthy