English
Related papers

Related papers: Local Conditioning: Exact Message Passing for Cycl…

200 papers

This paper considers distributed resource allocation and sum-preserving constrained optimization over lossy networks, where the links are unreliable and subject to packet drops. We define the conditions to ensure convergence under packet…

Systems and Control · Electrical Eng. & Systems 2022-08-31 Mohammadreza Doostmohammadian , Usman A. Khan , Alireza Aghasi , Themistoklis Charalambous

Consider a distributed computing system in which the worker nodes are connected over a shared wireless channel. Nodes can store a fraction of the data set over which computation needs to be carried out, and a Map-Shuffle-Reduce protocol is…

Information Theory · Computer Science 2018-10-29 Sukjong Ha , Jingjing Zhang , Osvaldo Simeone , Joonhyuk Kang

In this paper, we propose a finite alphabet message passing algorithm for LDPC codes that replaces the standard min-sum variable node update rule by a mapping based on generic look-up tables. This mapping is designed in a way that maximizes…

Information Theory · Computer Science 2015-10-16 Alexios Balatsoukas-Stimming , Michael Meidlinger , Reza Ghanaatian , Gerald Matz , Andreas Burg

Training deep neural networks on large datasets containing high-dimensional data requires a large amount of computation. A solution to this problem is data-parallel distributed training, where a model is replicated into several…

Machine Learning · Computer Science 2021-03-18 Lusine Abrahamyan , Yiming Chen , Giannis Bekoulis , Nikos Deligiannis

In this paper, we investigate how local rules enforced at every node can influence the topology of a network. More precisely, we establish several results on the diameter of trees as a function of the number of nodes, as listed below. These…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Nicolas Bousquet , Laurent Feuilloley , Théo Pierron

This paper considers a network of collaborating agents for local resource allocation subject to nonlinear model constraints. In many applications, it is required (or desirable) that the solution be anytime feasible in terms of satisfying…

We consider the distributed source coding problem in which correlated data picked up by scattered sensors has to be encoded separately and transmitted to a common receiver, subject to a rate-distortion constraint. Although near-tooptimal…

Information Theory · Computer Science 2008-09-09 G. Maierbacher , J. Barros

We consider a coded distributed computing problem in a ring-based communication network, where $N$ computing nodes are arranged in a ring topology and each node can only communicate with its neighbors within a constant distance $d$. To…

Information Theory · Computer Science 2026-03-06 Zhenhao Huang , Minquan Cheng , Kai Wan , Qifu Tyler Sun , Youlong Wu

This paper investigates sensor scheduling for state estimation of complex networks over shared transmission channels. For a complex network of dynamical systems, referred to as nodes, a sensor network is adopted to measure and estimate the…

Systems and Control · Electrical Eng. & Systems 2023-01-12 Peihu Duan , Lidong He , Lingying Huang , Guanrong Chen , Ling Shi

Non-adaptive joint source network coding of correlated sources is discussed in this paper. By studying the information flow in the network, we propose quantized network coding as an alternative for packet forwarding. This technique has both…

Information Theory · Computer Science 2012-12-24 Mahdy Nabaee , Fabrice Labeau

Unsourced random access is a novel communication paradigm designed for handling a large number of uncoordinated users that sporadically transmit very short messages. Under this model, coded compressed sensing (CCS) has emerged as a…

Information Theory · Computer Science 2021-07-22 Jamison R. Ebert , Vamsi K. Amalladinne , Stefano Rini , Jean-Francois Chamberland , Krishna R. Narayanan

We review a number of message-passing algorithms that can be used to search through power-law networks. Most of these algorithms are meant to be improvements for peer-to-peer file sharing systems, and some may also shed some light on how…

Disordered Systems and Neural Networks · Physics 2007-05-23 Lada A. Adamic , Rajan M. Lukose , Bernardo A. Huberman

In this paper, a nonlinear system aiming at reducing the signal transmission rate in a networked control system is constructed by adding nonlinear constraints to a linear feedback control system. Its stability is investigated in detail. It…

Chaotic Dynamics · Physics 2015-06-19 Guofeng Zhang , Tongwen Chen

We consider distributed optimization on undirected connected graphs. We propose a novel distributed conditional gradient method with (O(1/\sqrt{k})) convergence. Compared with existing methods, each iteration of our method uses both…

Optimization and Control · Mathematics 2020-03-17 Yue Yu , Behçet Açıkmeşe

This paper deals with an optimization problem over a network of agents, where the cost function is the sum of the individual objectives of the agents and the constraint set is the intersection of local constraints. Most existing methods…

Optimization and Control · Mathematics 2018-06-20 Van Sy Mai , Eyad H. Abed

Event-triggered and self-triggered control have been proposed in recent years as promising control strategies to reduce communication resources in Networked Control Systems (NCSs). Based on the notion of set-invariance theory, this note…

Optimization and Control · Mathematics 2018-01-18 Kazumune Hashimoto , Dimos V. Dimarogonas , Shuichi Adachi

Works on implicit regularization have studied gradient trajectories during the optimization process to explain why deep networks favor certain kinds of solutions over others. In deep linear networks, it has been shown that gradient descent…

Machine Learning · Computer Science 2023-06-02 Dan Zhao

The non-uniform demand network coding problem is posed as a single-source and multiple-sink network transmission problem where the sinks may have heterogeneous demands. In contrast with multicast problems, non-uniform demand problems are…

Information Theory · Computer Science 2010-01-27 Joseph C. Koo , John Gill

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

A novel scenario-adapted distributed signaling technique in the context of opportunistic communications is presented in this work. Each opportunistic user acquires locally sampled observations from the wireless environment to determine the…

Information Theory · Computer Science 2021-11-01 Jordi Borras , Gregori Vazquez