English
Related papers

Related papers: Team-Optimal Distributed MMSE Estimation in Genera…

200 papers

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of…

Machine Learning · Statistics 2017-09-25 Ahmed Zaki , Partha P. Mitra , Lars K. Rasmussen , Saikat Chatterjee

When networked systems of autonomous agents carry out complex tasks, the control and coordination sought after generally depend on a few fundamental control primitives. Chief among these primitives is consensus, where agents are to converge…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-13 Bernadette Charron-Bost , Patrick Lambein-Monette

This work introduces a novel two-stage distributed framework to globally estimate constant parameters in a networked system, separating shared information from local estimation. The first stage uses dynamic average consensus to aggregate…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Ariana R. Mendez-Castillo , Rodrigo Aldana-Lopez , Antonio Ramirez-Trevino , Rosario Aragues , David Gomez-Gutierrez

This paper considers a distributed multi-agent optimization problem, with the global objective consisting of the sum of local objective functions of the agents. The agents solve the optimization problem using local computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Shripad Gade , Nitin H. Vaidya

This paper presents a consensus algorithm for a multi-agent system where each agent has access to its imperfect own state and neighboring state measurements. The measurements are subject to deterministic disturbances and the proposed…

Systems and Control · Computer Science 2014-09-22 Mohammad Zamani , Iman Shames , Valery Ugrinovskii

We study diffusion and consensus based optimization of a sum of unknown convex objective functions over distributed networks. The only access to these functions is through stochastic gradient oracles, each of which is only available at a…

Numerical Analysis · Computer Science 2015-09-01 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

Distributed estimation and processing in networks modeled by graphs have received a great deal of interest recently, due to the benefits of decentralised processing in terms of performance and robustness to communications link failure…

Multiagent Systems · Computer Science 2016-11-29 C. T. Healy , R. C. de Lamare

Minimum mean square error (MMSE) estimation of block sparse signals from noisy linear measurements is considered. Unlike in the standard compressive sensing setup where the non-zero entries of the signal are independently and uniformly…

Information Theory · Computer Science 2012-04-26 Mikko Vehkaperä , Saikat Chatterjee , Mikael Skoglund

We consider the problem of exploring an unknown tree with a team of $k$ initially colocated mobile agents. Each agent has limited energy and cannot, as a result, traverse more than $B$ edges. The goal is to maximize the number of nodes…

Data Structures and Algorithms · Computer Science 2018-02-20 Evangelos Bampas , Jérémie Chalopin , Shantanu Das , Jan Hackfeld , Christina Karousatou

We consider a multi-agent system where each agent has its own estimate of a given quantity and the goal is to reach consensus on the average. To this purpose, we propose a distributed consensus algorithm that guarantees convergence to the…

Optimization and Control · Mathematics 2016-08-31 Alessandro Falsone , Kostas Margellos , Simone Garatti , Maria Prandini

A distributed adaptive algorithm to estimate a time-varying signal, measured by a wireless sensor network, is designed and analyzed. One of the major features of the algorithm is that no central coordination among the nodes needs to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-22 Carlo Fischione , Alberto Speranzon , Karl H. Johansson , Alberto Sangiovanni-Vincentelli

Massive MIMO communication systems, by virtue of utilizing very large number of antennas, have a potential to yield higher spectral and energy efficiency in comparison with the conventional MIMO systems. In this paper, we consider uplink…

Information Theory · Computer Science 2015-07-30 Alam Zaib , Mudassir Masood , Anum Ali , Weiyu Xu , Tareq Y. Al-Naffouri

Generalized from the concept of consensus, this paper considers a group of edge agreements, i.e. constraints defined for neighboring agents, in which each pair of neighboring agents is required to satisfy one edge agreement constraint. Edge…

Optimization and Control · Mathematics 2023-12-04 Zehui Lu , Shaoshuai Mou

The interpretability of Mixture-of-Experts (MoE) models, especially those with heterogeneous designs, remains underexplored. Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE…

Computation and Language · Computer Science 2025-06-12 Junzhuo Li , Bo Wang , Xiuze Zhou , Peijie Jiang , Jia Liu , Xuming Hu

In this paper, the problem of online distributed zeroth-order optimization subject to a set constraint is studied via a multi-agent network, where each agent can communicate with its immediate neighbors via a time-varying directed graph.…

Systems and Control · Electrical Eng. & Systems 2025-11-05 Yanfu Qin , Kaihong Lu

This is Part II of a two-part work on the estimation for a multi-layer generalized linear model (ML-GLM) in large system limits. In Part I, we had analyzed the asymptotic performance of an exact MMSE estimator, and obtained a set of coupled…

Information Theory · Computer Science 2020-07-21 Qiuyun Zou , Haochuan Zhang , Hongwen Yang

Distributed algorithms for both discrete-time and continuous-time linearly solvable optimal control (LSOC) problems of networked multi-agent systems (MASs) are investigated in this paper. A distributed framework is proposed to partition the…

Machine Learning · Computer Science 2021-02-19 Neng Wan , Aditya Gahlawat , Naira Hovakimyan , Evangelos A. Theodorou , Petros G. Voulgaris

Sparse Mixture of Experts (SMoE) enables scalable parameter growth in large language models (LLMs) by selectively activating a subset of experts, and its large parameter count necessitates distributed deployment for inference. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-07 Yu Han , Lehan Pan , Jie Peng , Ziyang Tao , Hanqi Zhu , Wuyang Zhang , Yanyong Zhang

We study the problem of constrained distributed optimization in multi-agent networks when some of the computing agents may be faulty. In this problem, the system goal is to have all the non-faulty agents collectively minimize a global…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-06 Lili Su , Nitin H. Vaidya

The increasing distributed and renewable energy resources and controllable devices in distribution systems make fast distribution system state estimation (DSSE) crucial in system monitoring and control. We consider a large multi-phase…

Optimization and Control · Mathematics 2020-05-22 Xinyang Zhou , Zhiyuan Liu , Yi Guo , Changhong Zhao , Jianqiao Huang , Lijun Chen