English
Related papers

Related papers: Convergence of a Distributed Kiefer-Wolfowitz Algo…

200 papers

In this paper, we study the convergence behavior of distributed iterative algorithms with quantized message passing. We first introduce general iterative function evaluation algorithms for solving fixed point problems distributively. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-19 Ying Cui , Vincent K. N. Lau

We propose two distributed iterative algorithms that can be used to solve, in finite time, the distributed optimization problem over quadratic local cost functions in large-scale networks. The first algorithm exhibits synchronous operation…

In this paper, a convergence proof for the recently proposed sparse possibilistic c-means (SPCM) algorithm is provided, utilizing the celebrated Zangwill convergence theorem. It is shown that the iterative sequence generated by SPCM…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Spyridoula D. Xenaki , Konstantinos D. Koutroumbas , Athanasios A. Rontogiannis

Convergence analysis of consensus algorithms is revisited in the light of the Hilbert distance. Tsitsiklis Lyapunov function is shown to be the Hilbert distance to consensus in log coordinates. Birkhoff theorem, which proves contraction of…

Optimization and Control · Mathematics 2016-11-18 Rodolphe Sepulchre , Alain Sarlette , Pierre Rouchon

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

This work proposes multi-agent systems setting for concurrent engineering system design optimization and gradually paves the way towards examining graph theoretic constructs in the context of multidisciplinary design optimization problem.…

Optimization and Control · Mathematics 2012-09-18 Amir Noori

We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple…

Machine Learning · Computer Science 2020-07-14 Sebastian Claici , Mikhail Yurochkin , Soumya Ghosh , Justin Solomon

We show the linear convergence of Dykstra's algorithm for sets intersecting in a manner slightly stronger than the usual constraint qualifications.

Optimization and Control · Mathematics 2019-02-22 C. H. Jeffrey Pang

We describe a distributed, asynchronous variant of Edmonds's exact algorithm for producing perfect matchings of minimum weight. The development of this algorithm is driven by an application to online error correction in quantum computing,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-27 Eric C. Peterson , Peter J. Karalekas

This paper has been withdrawn from the arXiv. It is now published by Elsevier in the Journal of Statistical Planning and Inference, under the modified title "Convergence properties of the expected improvement algorithm with fixed mean and…

Computation · Statistics 2010-06-15 Emmanuel Vazquez , Julien Bect

Inspired and underpinned by the idea of integral feedback, a distributed constant gain algorithm is proposed for multi-agent networks to solve convex optimization problems with local linear constraints. Assuming agent interactions are…

Optimization and Control · Mathematics 2021-11-19 Xuan Wang , Shaoshuai Mou , Brian. D. O. Anderson

This paper investigates the convergence of the randomized Kaczmarz algorithm for the problem of phase retrieval of complex-valued objects. While this algorithm has been studied for the real-valued case}, its generalization to the…

Information Theory · Computer Science 2020-10-14 Teng Zhang , Feng Yu

We consider minimizing a sum of non-smooth objective functions with set constraints in a distributed manner. As to this problem, we propose a distributed algorithm with an exponential convergence rate for the first time. By the exact…

Optimization and Control · Mathematics 2020-01-06 Weijian Li , Xianlin Zeng , Shu Liang , Yiguang Hong

This paper delves into the investigation of a distributed aggregative optimization problem within a network. In this scenario, each agent possesses its own local cost function, which relies not only on the local state variable but also on…

Optimization and Control · Mathematics 2025-04-01 Jiaxu Liu , Song Chen , Shengze Cai , Chao Xu , Jian Chu

Many large-scale constrained optimization problems can be formulated as bilevel distributed optimization tasks over undirected networks, where agents collaborate to minimize a global cost function while adhering to constraints, relying only…

Optimization and Control · Mathematics 2025-11-25 Ajay Tak , Mayank Baranwal

We propose a distributed algorithm for time synchronization in mobile wireless sensor networks. Each node can employ the algorithm to estimate the global time based on its local clock time. The problem of time synchronization is formulated…

Systems and Control · Computer Science 2014-12-30 Chenda Liao , Prabir Barooah

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber

We introduce a general mathematical framework for distributed algorithms, and a monotonicity property frequently satisfied in application. These properties are leveraged to provide finite-time guarantees for converging algorithms, suited…

Systems and Control · Electrical Eng. & Systems 2020-07-31 James Melbourne , Govind Saraswat , Vivek Khatana , Sourav Patel , Murti V. Salapaka

Distributed consensus optimization has received considerable attention in recent years; several distributed consensus-based algorithms have been proposed for (nonsmooth) convex and (smooth) nonconvex objective functions. However, the…

Optimization and Control · Mathematics 2019-11-05 Vyacheslav Kungurtsev

In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally…

Optimization and Control · Mathematics 2023-06-29 Luis M. Briceno-Arias , Francisco José Silva , Xianjin Yang