English
Related papers

Related papers: Distributed convergence detection based on global …

200 papers

Various spacecraft have sensors that repeatedly perform a prescribed scanning maneuver, and one may want high precision. Iterative Learning Control (ILC) records previous run tracking error, adjusts the next run command, aiming for zero…

Systems and Control · Electrical Eng. & Systems 2023-08-01 Richard W. Longman , Shuo Liu , Tarek A. Elsharhawy

Plotting the residuals is a recommended procedure to diagnose deviations from linear model assumptions, such as non-linearity, heteroscedasticity, and non-normality. The presence of structure in residual plots can be tested using the lineup…

Machine Learning · Statistics 2024-11-05 Weihao Li , Dianne Cook , Emi Tanaka , Susan VanderPlas , Klaus Ackermann

We consider a general class of regression models with normally distributed covariates, and the associated nonconvex problem of fitting these models from data. We develop a general recipe for analyzing the convergence of iterative algorithms…

Optimization and Control · Mathematics 2021-09-22 Kabir Aladin Chandrasekher , Ashwin Pananjady , Christos Thrampoulidis

Determining the degree of inherent parallelism in classical sequential algorithms and leveraging it for fast parallel execution is a key topic in parallel computing, and detailed analyses are known for a wide range of classical algorithms.…

Data Structures and Algorithms · Computer Science 2023-04-24 Alexander Fedorov , Diba Hashemi , Giorgi Nadiradze , Dan Alistarh

Causal-consistent reversible debugging allows one to explore concurrent computations back and forth in order to locate the source of an error. In this setting, backward steps can be chosen freely as long as they are "causal consistent",…

Programming Languages · Computer Science 2024-06-11 Juan José González-Abril , Germán Vidal

We present a novel class of methods to compute functions of matrices or their action on vectors that are suitable for parallel programming. Solving appropriate simple linear systems of equations in parallel (or computing the inverse of…

Numerical Analysis · Mathematics 2022-10-10 Sergio Blanes

With the increasing number of compute components, failures in future exa-scale computer systems are expected to become more frequent. This motivates the study of novel resilience techniques. Here, we extend a recently proposed…

Mathematical Software · Computer Science 2018-04-18 Markus Huber , Ulrich Rüde , Barbara Wohlmuth

In many applications one is interested to detect certain (known) patterns in the mean of a process with smallest delay. Using an asymptotic framework which allows to capture that feature, we study a class of appropriate sequential…

Statistics Theory · Mathematics 2018-05-01 Ansgar Steland

Some iterative calculations can be carried out by parallel communicating processors, and yield the same results whether or not the processors are synchronized. We show that this is the case if and only if the iteration is a contraction that…

Networking and Internet Architecture · Computer Science 2017-01-27 Alexander J. T. Gurney

We describe an asynchronous parallel stochastic coordinate descent algorithm for minimizing smooth unconstrained or separably constrained functions. The method achieves a linear convergence rate on functions that satisfy an essential strong…

Optimization and Control · Mathematics 2014-11-12 Ji Liu , Stephen J. Wright , Christopher Ré , Victor Bittorf , Srikrishna Sridhar

Dual decomposition is widely utilized in distributed optimization of multi-agent systems. In practice, the dual decomposition algorithm is desired to admit an asynchronous implementation due to imperfect communication, such as time delay…

Optimization and Control · Mathematics 2021-03-05 Yifan Su , Zhaojian Wang , Ming Cao , Mengshuo Jia , Feng Liu

We consider the problems of reaching average consensus and solving consensus-based optimization over unreliable communication networks wherein packets may be dropped accidentally during transmission. Existing work either assumes that the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-11 Lili Su

A general asynchronous alternating iterative model is designed, for which convergence is theoretically ensured both under classical spectral radius bound and, then, for a classical class of matrix splittings for $\mathsf H$-matrices. The…

Numerical Analysis · Mathematics 2023-12-29 Guillaume Gbikpi-Benissan , Qinmeng Zou , Frédéric Magoulès

Changes, planned or unexpected, are common during the execution of real-life processes. Detecting these changes is a must for optimizing the performance of organizations running such processes. Most of the algorithms present in the…

Artificial Intelligence · Computer Science 2025-10-28 Victor Gallego-Fontenla , Juan C. Vidal , Manuel Lama

We present a method of concatenated quantum error correction in which improved classical processing is used with existing quantum codes and fault-tolerant circuits to more reliably correct errors. Rather than correcting each level of a…

Quantum Physics · Physics 2012-10-26 Zachary W. E. Evans , Ashley M. Stephens

This paper proposes a fully distributed termination method for distributed optimization algorithms solved by multiple agents. The proposed method guarantees terminating a distributed optimization algorithm after satisfying the global…

Optimization and Control · Mathematics 2024-01-31 Mohannad Alkhraijah , Daniel K. Molzahn

Standard gradient-based iteration algorithms for optimization, such as gradient descent and its various proximal-based extensions to nonsmooth problems, are known to converge slowly for ill-conditioned problems, sometimes requiring many…

Numerical Analysis · Mathematics 2026-03-24 G. H. M. Araújo , O. A. Krzysik , H. De Sterck

With distributed computing and mobile applications becoming ever more prevalent, synchronizing diverging replicas of the same data is a common problem. Reconciliation -- bringing two replicas of the same data structure as close as possible…

Information Theory · Computer Science 2022-08-10 Elod P. Csirmaz , Laszlo Csirmaz

We develop a gradient-like algorithm to minimize a sum of peer objective functions based on coordination through a peer interconnection network. The coordination admits two stages: the first is to constitute a gradient, possibly with…

Optimization and Control · Mathematics 2023-07-19 Sandushan Ranaweera , Chathuranga Weeraddana , Prathapasinghe Dharmawansa , Carlo Fischione

A class of two-bit bit flipping algorithms for decoding low-density parity-check codes over the binary symmetric channel was proposed in [1]. Initial results showed that decoders which employ a group of these algorithms operating in…

Information Theory · Computer Science 2012-05-22 Dung Viet Nguyen , Bane Vasic , Michael W. Marcellin