English
Related papers

Related papers: Decentralized Probabilistic Auto-Scaling for Heter…

200 papers

We analyze the convergence of decentralized consensus algorithm with delayed gradient information across the network. The nodes in the network privately hold parts of the objective function and collaboratively solve for the consensus…

Optimization and Control · Mathematics 2018-01-17 Benjamin Sirb , Xiaojing Ye

Decentralized optimization enables multiple devices to learn a global machine learning model while each individual device only has access to its local dataset. By avoiding the need for training data to leave individual users' devices, it…

Machine Learning · Computer Science 2026-04-22 Ziqin Chen , Zuang Wang , Yongqiang Wang

Decentralized optimization is critical for solving large-scale machine learning problems over distributed networks, where multiple nodes collaborate through local communication. In practice, the variances of stochastic gradient estimators…

Optimization and Control · Mathematics 2026-02-13 Hongxu Chen , Ke Wei , Luo Luo

We propose an asynchronous, decentralized algorithm for consensus optimization. The algorithm runs over a network in which the agents communicate with their neighbors and perform local computation. In the proposed algorithm, each agent can…

Optimization and Control · Mathematics 2017-03-06 Tianyu Wu , Kun Yuan , Qing Ling , Wotao Yin , Ali H. Sayed

Cooperative decision making is a vision of future network management and control. Distributed connection preemption is an important example where nodes can make intelligent decisions on allocating resources and controlling traffic flows for…

Machine Learning · Computer Science 2009-01-08 Sung-eok Jeon , Chuanyi Ji

Decentralized optimization is widely used in large scale and privacy preserving machine learning and various distributed control and sensing systems. It is assumed that every agent in the network possesses a local objective function, and…

Optimization and Control · Mathematics 2023-01-31 Savelii Chezhegov , Anton Novitskii , Alexander Rogozin , Sergei Parsegov , Pavel Dvurechensky , Alexander Gasnikov

A symbolic approach to decentralized set-valued state estimation and prediction for systems that admit a hybrid state machine representations is proposed. The decentralized computational scheme represents a conj unction of a finite number…

Systems and Control · Computer Science 2013-02-28 Naim Bajcinca

We analyze convergence of decentralized cooperative online estimation algorithms by a network of multiple nodes via information exchanging in an uncertain environment. Each node has a linear observation of an unknown parameter with randomly…

Signal Processing · Electrical Eng. & Systems 2020-12-08 Jiexiang Wang , Tao Li , Xiwei Zhang

We investigate algorithms to find short paths in spatial networks with stochastic edge weights. Our formulation of the problem of finding short paths differs from traditional formulations because we specifically do not make two of the usual…

Social and Information Networks · Computer Science 2013-09-06 Till Hoffmann , Renaud Lambiotte , Mason A. Porter

Common techniques for the spatial discretisation of PDEs on a macroscale grid include finite difference, finite elements and finite volume methods. Such methods typically impose assumed microscale structures on the subgrid fields, so…

Dynamical Systems · Mathematics 2022-04-15 J. E. Bunder , A. J. Roberts

In this paper, a class of Decentralized Approximate Newton (DEAN) methods for addressing convex optimization on a networked system are developed, where nodes in the networked system seek for a consensus that minimizes the sum of their…

Optimization and Control · Mathematics 2020-12-01 Hejie Wei , Zhihai Qu , Xuyang Wu , Hao Wang , Jie Lu

In important applications involving multi-task networks with multiple objectives, agents in the network need to decide between these multiple objectives and reach an agreement about which single objective to follow for the network. In this…

Optimization and Control · Mathematics 2018-12-27 Sahar Khawatmi , Abdelhak M. Zoubir , Ali H. Sayed

We develop a methodology to automatically compute worst-case performance bounds for a class of decentralized algorithms that optimize the average of local functions distributed across a network. We extend the recently proposed PEP approach…

Optimization and Control · Mathematics 2022-03-14 Sebastien Colla , Julien M. Hendrickx

We develop a system-theoretic framework for the structured analysis of distributed optimization algorithms with decomposable cost functions. We model such algorithms as a network of interacting dynamical systems and derive tests for…

Optimization and Control · Mathematics 2026-04-14 Aron Karakai , Jaap Eising , Andrea Martinelli , Florian Dörfler

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

Distributed processing over networks relies on in-network processing and cooperation among neighboring agents. Cooperation is beneficial when agents share a common objective. However, in many applications agents may belong to different…

Optimization and Control · Mathematics 2023-07-19 Xiaochuan Zhao , Ali H. Sayed

In this paper we propose a new methodology for decision-making under uncertainty using recent advancements in the areas of nonlinear stochastic optimal control theory, applied mathematics, and machine learning. Grounded on the fundamental…

Robotics · Computer Science 2021-07-12 Marcus Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

This paper introduces a novel concept for addressing non-convexity in the cost functions of distributed economic model predictive control (DEMPC) systems. Specifically, the proposed algorithm enables agents to self-organize into a hierarchy…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Ali C. Kheirabadi , Ryozo Nagamune

This paper introduces GODDeS: a fully distributed self-organizing decision-theoretic routing algorithm designed to effectively exploit high quality paths in lossy ad-hoc wireless environments, typically with a large number of nodes. The…

Networking and Internet Architecture · Computer Science 2012-03-24 Ishanu Chattopadhyay

We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a…

Optimization and Control · Mathematics 2017-04-12 Angelia Nedić , Alex Olshevsky , César A. Uribe