English
Related papers

Related papers: Convergence of a Distributed Kiefer-Wolfowitz Algo…

200 papers

In two earlier papers, we designed a distributed deterministic asynchronous algorithm for minimizing the sum of subdifferentiable and proximable functions and a regularizing quadratic on time-varying graphs based on Dykstra's algorithm, or…

Optimization and Control · Mathematics 2018-08-23 C. H. Jeffrey Pang

In this paper, a distributed stochastic gradient (SG) algorithm is proposed where the estimators are aimed to collectively estimate an unknown time-invariant parameter from a set of noisy measurements obtained by distributed sensors. The…

Systems and Control · Electrical Eng. & Systems 2022-03-08 Die Gan , Zhixin Liu

In this paper a new distributed asynchronous algorithm is proposed for time synchronization in networks with random communication delays, measurement noise and communication dropouts. Three different types of the drift correction algorithm…

Systems and Control · Computer Science 2018-02-05 Milos S. Stankovic , Srdjan S. Stankovic , Karl Henrik Johansson

The goal of this paper is to reconstruct spatially distributed dielectric constants from complex-valued scattered wave field by solving a 3D coefficient inverse problem for the Helmholtz equation at multi-frequencies. The data are generated…

Numerical Analysis · Mathematics 2016-12-14 Michael V. Klibanov , Dinh-Liem Nguyen , Loc H. Nguyen , Hui Liu

In this paper, we consider Wiener filters to reconstruct deterministic and (wide-band) stationary graph signals from their observations corrupted by random noises, and we propose distributed algorithms to implement Wiener filters and…

Signal Processing · Electrical Eng. & Systems 2022-05-10 Cong Zheng , Cheng Cheng , Qiyu Sun

This paper studies the convergence conditions and properties of the distributed adaptive signal fusion (DASF) algorithm, the framework itself having been introduced in a `Part I' companion paper. The DASF algorithm can be used to solve…

Signal Processing · Electrical Eng. & Systems 2023-05-12 Cem Ates Musluoglu , Charles Hovine , Alexander Bertrand

We propose a Jacobi-style distributed algorithm to solve convex, quadratically constrained quadratic programs (QCQPs), which arise from a broad range of applications. While small to medium-sized convex QCQPs can be solved efficiently by…

Optimization and Control · Mathematics 2021-10-15 Run Chen , Andrew L. Liu

We investigate the convergence rate of the distributed Dykstra's algorithm when some of the sets are defined as the level sets of convex functions. We carry out numerical experiments to compare with the theoretical results obtained.

Optimization and Control · Mathematics 2018-09-26 C. H. Jeffrey Pang

This paper presents the formulation and analysis of a novel distributed maximum likelihood algorithm that utilizes a first-order optimization scheme. The proposed approach utilizes a static average consensus algorithm to reach agreement on…

Optimization and Control · Mathematics 2018-03-09 Jemin George

This work focuses on the convergence analysis of adaptive distributed beamforming schemes that can be reformulated as local random search algorithms via a random search framework. Once reformulated as local random search algorithms, it is…

Systems and Control · Computer Science 2011-02-10 Chang-Ching Chen , Chia-Shiang Tseng , Che Lin

In this note we study the convergence of the survey decimation algorithm. An analytic formula for the reduction of the complexity during the decimation is derived. The limit of the converge of the algorithm are estimated in the random case:…

Computational Complexity · Computer Science 2007-05-23 Giorgio Parisi

Fueled by applications in sensor networks, these years have witnessed a surge of interest in distributed estimation and filtering. A new approach is hereby proposed for the Distributed Kalman Filter (DKF) by integrating a local covariance…

Systems and Control · Computer Science 2017-03-17 Ye Yuan , Ling Shi , Jun Liu , Zhiyong Chen , Hai-Tao Zhang , Jorge Goncalves

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

We consider several problems in the field of distributed optimization and hypothesis testing. We show how to obtain convergence times for these problems that scale linearly with the total number of nodes in the network by using a recent…

Optimization and Control · Mathematics 2017-05-24 Alex Olshevsky

In this article, we propose a new approach, optimize then agree for minimizing a sum $ f = \sum_{i=1}^n f_i(x)$ of convex objective functions over a directed graph. The optimize then agree approach decouples the optimization step and the…

Systems and Control · Electrical Eng. & Systems 2021-05-27 Vivek Khatana , Govind Saraswat , Sourav Patel , Murti V. Salapaka

In this paper, a distributed stochastic approximation algorithm is studied. Applications of such algorithms include decentralized estimation, optimization, control or computing. The algorithm consists in two steps: a local step, where each…

Optimization and Control · Mathematics 2013-12-03 Pascal Bianchi , Gersende Fort , Walid Hachem

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

Federated clustering, an integral aspect of federated machine learning, enables multiple data sources to collaboratively cluster their data, maintaining decentralization and preserving privacy. In this paper, we introduce a novel federated…

Machine Learning · Computer Science 2023-11-20 Patrick Holzer , Tania Jacob , Shubham Kavane

This paper proposes a novel class of distributed continuous-time coordination algorithms to solve network optimization problems whose cost function is a sum of local cost functions associated to the individual agents. We establish the…

Optimization and Control · Mathematics 2014-08-25 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

In this paper, we establish new convergence results for the quantized distributed gradient descent and suggest a novel strategy of choosing the stepsizes for the high-performance of the algorithm. Under the strongly convexity assumption on…

Optimization and Control · Mathematics 2023-07-03 Woocheol Choi , Myeong-Su Lee