English
Related papers

Related papers: Distributed Learning over Noisy Communication Netw…

200 papers

The brain rapidly adapts to new contexts and learns from limited data, a coveted characteristic that artificial intelligence (AI) algorithms struggle to mimic. Inspired by the mechanical oscillatory rhythms of neural cells, we developed a…

Machine Learning · Computer Science 2026-03-17 Hoony Kang , Wolfgang Losert

We study data-driven learning of robust stochastic control for infinite-horizon systems with potentially continuous state and action spaces. In many managerial settings--supply chains, finance, manufacturing, services, and dynamic…

Machine Learning · Statistics 2025-11-18 Shengbo Wang , Jason Meng , Nian Si , Jose Blanchet , Zhengyuan Zhou

We propose a new method to probe the learning mechanism of Deep Neural Networks (DNN) by perturbing the system using Noise Injection Nodes (NINs). These nodes inject uncorrelated noise via additional optimizable weights to existing…

Machine Learning · Computer Science 2023-05-03 Noam Levi , Itay Bloch , Marat Freytsis , Tomer Volansky

In this paper, we consider the problem of clustering graph nodes and sparsifying graph edges over distributed graphs, when graph edges with possibly edge duplicates are observed at physically remote sites. Although edge duplicates across…

Data Structures and Algorithms · Computer Science 2023-02-21 Chun Jiang Zhu

Much research has been done on studying the diffusion of ideas or technologies on social networks including the \textit{Influence Maximization} problem and many of its variations. Here, we investigate a type of inverse problem. Given a…

Social and Information Networks · Computer Science 2014-04-28 Georgios Askalidis , Randall A. Berry , Vijay G. Subramanian

Understanding how recurrent neural circuits can learn to implement dynamical systems is a fundamental challenge in neuroscience. The credit assignment problem, i.e. determining the local contribution of each synapse to the network's global…

Neurons and Cognition · Quantitative Biology 2017-08-08 Alireza Alemi , Christian Machens , Sophie Denève , Jean-Jacques Slotine

Graph learning is often a necessary step in processing or representing structured data, when the underlying graph is not given explicitly. Graph learning is generally performed centrally with a full knowledge of the graph signals, namely…

Signal Processing · Electrical Eng. & Systems 2021-12-14 Isabela Cunha Maia Nobre , Mireille El Gheche , Pascal Frossard

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

Optimization and Control · Mathematics 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

To process and transfer large amounts of data in emerging wireless services, it has become increasingly appealing to exploit distributed data communication and learning. Specifically, edge learning (EL) enables local model training on…

Information Theory · Computer Science 2023-03-22 Wei Xu , Zhaohui Yang , Derrick Wing Kwan Ng , Marco Levorato , Yonina C. Eldar , M'erouane Debbah

-We develop a random binning scheme for strong coordination in a network of two nodes separated by a noisy channel, in which the input and output signals have to be coordinated with the source and its reconstruction. In the case of…

Information Theory · Computer Science 2017-05-17 Giulia Cervia , Laura Luzzi , Maël Le Treust , Matthieu Bloch

Distributed consensus protocols provide a mechanism for spreading information within clustered networks, allowing agents and clusters to make decisions without requiring direct access to the state of the ensemble. In this work, we propose a…

Systems and Control · Electrical Eng. & Systems 2025-12-12 Federico M. Zegers , Sean Phillips

Diffusion processes are instrumental to describe the movement of a continuous quantity in a generic network of interacting agents. Here, we present a probabilistic framework for diffusion in networks and propose to classify agent…

Social and Information Networks · Computer Science 2015-08-28 Wai Hong Ronald Chan , Matthias Wildemeersch , Tony Q. S. Quek

Longitudinal binary relational data can be better understood by implementing a latent space model for dynamic networks. This approach can be broadly extended to many types of weighted edges by using a link function to model the mean of the…

Methodology · Statistics 2020-05-19 Daniel K. Sewell , Yuguo Chen

This work considers the problem of mitigating information leakage between communication and sensing in systems jointly performing both operations. Specifically, a discrete memoryless state-dependent broadcast channel model is studied in…

Information Theory · Computer Science 2022-08-16 Onur Günlü , Matthieu Bloch , Rafael F. Schaefer , Aylin Yener

Reasoning about graphs evolving over time is a challenging concept in many domains, such as bioinformatics, physics, and social networks. We consider a common case in which edges can be short term interactions (e.g., messaging) or long term…

Machine Learning · Statistics 2020-06-22 Boris Knyazev , Carolyn Augusta , Graham W. Taylor

Deep learning with noisy labels is practically challenging, as the capacity of deep models is so high that they can totally memorize these noisy labels sooner or later during training. Nonetheless, recent studies on the memorization effects…

Machine Learning · Computer Science 2018-10-31 Bo Han , Quanming Yao , Xingrui Yu , Gang Niu , Miao Xu , Weihua Hu , Ivor Tsang , Masashi Sugiyama

We design a distributed algorithm for learning Nash equilibria over time-varying communication networks in a partial-decision information scenario, where each agent can access its own cost function and local feasible set, but can only…

Optimization and Control · Mathematics 2020-09-11 Mattia Bianchi , Sergio Grammatico

This paper aims at the study of controllability properties and induced controllability metrics on complex networks governed by a class of (discrete time) linear decision processes with mul-tiplicative noise. The dynamics are given by a…

Optimization and Control · Mathematics 2016-12-15 Tidiane Diallo , Dan Goreac

We consider the statistical mechanics of interfering transmissions in a wireless communications protocol. In this case, a connection between two nodes requires all other nodes within communication distance of the given two nodes to remain…

Statistical Mechanics · Physics 2009-11-10 M. B. Hastings

The problem of learning simultaneously several related tasks has received considerable attention in several domains, especially in machine learning with the so-called multitask learning problem or learning to learn problem [1], [2].…

Signal Processing · Electrical Eng. & Systems 2021-09-29 Roula Nassif , Stefan Vlaski , Cedric Richard , Jie Chen , Ali H. Sayed