English
Related papers

Related papers: Convergence of the D-iteration algorithm: converge…

200 papers

Distributed computing systems are well-known to suffer from the problem of slow or failed nodes; these are referred to as stragglers. Straggler mitigation (for distributed matrix computations) has recently been investigated from the…

Information Theory · Computer Science 2024-12-20 Anindya Bijoy Das , Aditya Ramamoorthy

This paper introduces a systematic methodological framework to design and analyze distributed algorithms for optimization and games over networks. Starting from a centralized method, we identify an aggregation function involving all the…

Optimization and Control · Mathematics 2025-05-26 Guido Carnevale , Nicola Mimmo , Giuseppe Notarstefano

Motivated by federated learning, we consider the hub-and-spoke model of distributed optimization in which a central authority coordinates the computation of a solution among many agents while limiting communication. We first study some past…

Machine Learning · Computer Science 2020-05-12 Reese Pathak , Martin J. Wainwright

Distributed algorithms to solve linear equations in multi-agent networks have attracted great research attention and many iteration-based distributed algorithms have been developed. The convergence speed is a key factor to be considered for…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-30 Haodi Ping , Yongcai Wang , Deying Li

When modeling propagation and scattering phenomena using integral equations discretized by the boundary element method, it is common practice to approximate the boundary of the scatterer with a mesh comprising elements of size approximately…

Computational Engineering, Finance, and Science · Computer Science 2025-06-13 V. Giunzioni , A. Merlini , F. P. Andriulli

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

On the basis of the explicit formulae for the action of the unitary group of exponentials corresponding to almost solvable extensions of a given closed symmetric operator with equal deficiency indices, we derive a new representation for the…

Spectral Theory · Mathematics 2018-05-21 Kirill D. Cherednichenko , Alexander V. Kiselev , Luis O. Silva

We discuss the distributed matching scheme in accelerators where control of transverse beam phase space, oscillation, and transport is accomplished by flexible distribution of focusing elements beyond dedicated matching sections. Besides…

Accelerator Physics · Physics 2018-08-07 Yu-Chiu Chao

Iterative algorithms are instrumental in modern numerical simulation for solving systems arising from the discretization of PDEs. They face however significant challenges in industrial applications, such as slow convergence, limit cycle…

Numerical Analysis · Mathematics 2026-05-05 Jeremy Kalfoun , Guillaume Pierrot , John Cagnol

The decentralized gradient descent (DGD) algorithm, and its sibling, diffusion, are workhorses in decentralized machine learning, distributed inference and estimation, and multi-agent coordination. We propose a novel, principled framework…

Signal Processing · Electrical Eng. & Systems 2025-06-04 Erik G. Larsson , Nicolo Michelusi

Score-based methods have recently seen increasing popularity in modeling and generation. Methods have been constructed to perform hypothesis testing and change-point detection with score functions, but these methods are in general not as…

Machine Learning · Statistics 2025-06-23 Sean Moushegian , Taposh Banerjee , Vahid Tarokh

In this paper we analyse convergence of projected fixed-point iteration on a Riemannian manifold of matrices with fixed rank. As a retraction method we use `projector splitting scheme'. We prove that the projector splitting scheme converges…

Numerical Analysis · Mathematics 2016-04-08 Denis Kolesnikov , Ivan Oseledets

We in this paper study the nonexpansive operators equipped with arbitrary metric and investigate the connections between firm nonexpansiveness, cocoerciveness and averagedness. The convergence of the associated fixed-point iterations is…

Optimization and Control · Mathematics 2022-10-11 Feng Xue

A mapping of the process on a continuous configuration space to the symbolic representation of the motion on a discrete state space will be combined with an iterative aggregation and disaggregation (IAD) procedure to obtain steady state…

Computational Physics · Physics 2017-12-06 Katja Biswas

We propose in this paper a unifying scheme for several algorithms from the literature dedicated to the solving of monotone inclusion problems involving compositions with linear continuous operators in infinite dimensional Hilbert spaces. We…

Optimization and Control · Mathematics 2017-05-08 Radu Ioan Bot , Ernö Robert Csetnek

We study the problem of minimizing a sum of local objective convex functions over a network of processors/agents. This problem naturally calls for distributed optimization algorithms, in which the agents cooperatively solve the problem…

Optimization and Control · Mathematics 2019-04-01 Fatemeh Mansoori , Ermin Wei

When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same…

Numerical Analysis · Mathematics 2025-01-23 Marcella Bonazzoli , Houssem Haddar , Tuan Anh Vu

An efficient, iterative semi-implicit (SI) numerical method for the time integration of stiff wave systems is presented. Physics-based assumptions are used to derive a convergent iterative formulation of the SI scheme which enables the…

Computational Physics · Physics 2008-07-02 N. F. Loureiro , G. W. Hammett

We consider the numerical approximation of the radiative transfer equation using discontinuous angular and continuous spatial approximations for the even parts of the solution. The even-parity equations are solved using a diffusion…

Numerical Analysis · Mathematics 2019-09-19 Olena Palii , Matthias Schlottbom

Unfolding problems often arise in the context of statistical data analysis. Such problematics occur when the probability distribution of a physical quantity is to be measured, but it is randomized (smeared) by some well understood process,…

Applications · Statistics 2016-12-09 Andras Laszlo