English
Related papers

Related papers: Asynchronous Stochastic Block Projection Algorithm…

200 papers

The randomized Kaczmarz (RK) algorithm is one of the most computationally and memory-efficient iterative algorithms for solving large-scale linear systems. However, practical applications often involve noisy and potentially inconsistent…

Numerical Analysis · Mathematics 2025-10-10 El Houcine Bergou , Soumia Boucherouite , Aritra Dutta , Xin Li , Anna Ma

We study distributed stochastic gradient (D-SG) method and its accelerated variant (D-ASG) for solving decentralized strongly convex stochastic optimization problems where the objective function is distributed over several computational…

Optimization and Control · Mathematics 2021-10-05 Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar , Umut Simsekli , Lingjiong Zhu

The block Kaczmarz method is an iterative scheme for solving overdetermined least-squares problems. At each step, the algorithm projects the current iterate onto the solution space of a subset of the constraints. This paper describes a…

Numerical Analysis · Mathematics 2015-03-20 Deanna Needell , Joel A. Tropp

This paper investigates the distributed fixed point seeking problem of sum-separable stochastic operators over the multi-agent network. Based on inexact Krasnosel'ski\u{\i}--Mann iterations, the communication-efficient distributed algorithm…

Optimization and Control · Mathematics 2026-05-22 Fan Li , Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Tao Yang

We introduce a simple time-triggered protocol to achieve communication-efficient non-Bayesian learning over a network. Specifically, we consider a scenario where a group of agents interact over a graph with the aim of discerning the true…

Systems and Control · Electrical Eng. & Systems 2019-09-05 Aritra Mitra , John A. Richards , Shreyas Sundaram

We consider distributed optimization problems in which a group of agents are to collaboratively seek the global optimum through peer-to-peer communication networks. The problem arises in various application areas, such as resource…

Optimization and Control · Mathematics 2016-08-30 Jinming Xu , Shanying Zhu , Yeng Chai Soh , Lihua Xie

Multi-robot systems can greatly enhance efficiency through coordination and collaboration, yet in practice, full-time communication is rarely available and interactions are constrained to close-range exchanges. Existing methods either…

Robotics · Computer Science 2026-02-09 Xintong Zhang , Junfeng Chen , Yuxiao Zhu , Bing Luo , Meng Guo

In this paper, we study robust distributed sub-optimal coordination of linear agents subject to input nonlinearities. Inspired by the robust agreement literature, we formulate a bounded distributed sub-optimal coordination problem, in which…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Takumi Namba

This paper deals with an optimization problem over a network of agents, where the cost function is the sum of the individual objectives of the agents and the constraint set is the intersection of local constraints. Most existing methods…

Optimization and Control · Mathematics 2018-06-20 Van Sy Mai , Eyad H. Abed

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

Evolutionary optimization is a generic population-based metaheuristic that can be adapted to solve a wide variety of optimization problems and has proven very effective for combinatorial optimization problems. However, the potential of this…

Multiagent Systems · Computer Science 2020-09-03 Saaduddin Mahmud , Moumita Choudhury , Md. Mosaddek Khan , Long Tran-Thanh , Nicholas R. Jennings

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin

This paper studies optimization problems over multi-agent systems, in which all agents cooperatively minimize a global objective function expressed as a sum of local cost functions. Each agent in the systems uses only local computation and…

Optimization and Control · Mathematics 2025-05-26 Jinhui Hu , Xin Chen , Lifeng Zheng , Ling Zhang , Huaqing Li

Many problems of interest for cyber-physical network systems can be formulated as Mixed Integer Linear Programs in which the constraints are distributed among the agents. In this paper we propose a distributed algorithm to solve this class…

Optimization and Control · Mathematics 2017-12-06 Andrea Testa , Alessandro Rucco , Giuseppe Notarstefano

Existing block Kaczmarz methods face challenges in balancing computational efficiency and convergence for large sparse linear systems with scattered nonzero patterns, due to costly partitioning strategies and non-orthogonal projections. In…

Numerical Analysis · Mathematics 2025-06-24 Yu-Fang Liang , Hou-Biao Li

The Kaczmarz method is widely recognized as an efficient iterative algorithm for solving large-scale linear systems, owing to its simplicity and low memory requirements. However, the development of its nonlinear extensions for solving…

Numerical Analysis · Mathematics 2026-03-30 Renjie Ding , Dongling Wang , Jun Zou

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

In this paper, we consider a distributed stochastic optimization problem where the goal is to minimize the time average of a cost function subject to a set of constraints on the time averages of related stochastic processes called…

Information Theory · Computer Science 2017-01-11 B. N. Bharath , P. Vaishali

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

The Kaczmarz method is an algorithm for finding the solution to an overdetermined consistent system of linear equations Ax=b by iteratively projecting onto the solution spaces. The randomized version put forth by Strohmer and Vershynin…

Numerical Analysis · Mathematics 2011-02-15 Yonina C. Eldar , Deanna Needell