English
Related papers

Related papers: Asynchronous Systems and Binary Diagonal Random Ma…

200 papers

Modern machine learning paradigms, such as deep learning, occur in or close to the interpolation regime, wherein the number of model parameters is much larger than the number of data samples. In this work, we propose a regularity condition…

Machine Learning · Computer Science 2023-06-06 Chaoyue Liu , Dmitriy Drusvyatskiy , Mikhail Belkin , Damek Davis , Yi-An Ma

In many iterative optimization methods, fixed-point theory enables the analysis of the convergence rate via the contraction factor associated with the linear approximation of the fixed-point operator. While this factor characterizes the…

Systems and Control · Electrical Eng. & Systems 2022-06-22 Trung Vu , Raviv Raich

We consider communication over binary-input memoryless output-symmetric channels using low-density parity-check codes and message-passing decoding. The asymptotic (in the length) performance of such a combination for a fixed number of…

Information Theory · Computer Science 2008-02-12 Satish Babu Korada , Ruediger Urbanke

Synchronous federated learning (FL) scales poorly with the number of clients due to the straggler effect. Algorithms like FedAsync and GeneralizedFedAsync address this limitation by enabling asynchronous communication between clients and…

Machine Learning · Computer Science 2025-10-23 Abdelkrim Alahyane , Céline Comte , Matthieu Jonckheere , Éric Moulines

We derive lower bounds on the convergence speed of a widely used class of distributed averaging algorithms. In particular, we prove that any distributed averaging algorithm whose state consists of a single real number and whose (possibly…

Optimization and Control · Mathematics 2015-03-13 Alex Olshevsky , John N. Tsitsiklis

Reflecting boundary conditions cause two one-dimensional random walks to synchronize if a common direction is chosen in each step. The mean synchronization time and its standard deviation are calculated analytically. Both quantities are…

Disordered Systems and Neural Networks · Physics 2007-05-23 Andreas Ruttor , Georg Reents , Wolfgang Kinzel

We consider processing an n x d matrix A in a stream with row-wise updates according to a recent algorithm called Frequent Directions (Liberty, KDD 2013). This algorithm maintains an l x d matrix Q deterministically, processing each row in…

Data Structures and Algorithms · Computer Science 2013-08-23 Mina Ghashami , Jeff M. Phillips

We study the problem of change point localization in dynamic networks models. We assume that we observe a sequence of independent adjacency matrices of the same size, each corresponding to a realization of an unknown inhomogeneous Bernoulli…

Methodology · Statistics 2020-10-22 Daren Wang , Yi Yu , Alessandro Rinaldo

Symmetries are ubiquitous in network systems and have profound impacts on the observable dynamics. At the most fundamental level, many synchronization patterns are induced by underlying network symmetry, and a high degree of symmetry is…

Adaptation and Self-Organizing Systems · Physics 2019-02-18 Joseph D. Hart , Yuanzhao Zhang , Rajarshi Roy , Adilson E. Motter

We consider a node-monitor pair, where updates are generated stochastically (according to a known distribution) at the node that it wishes to send to the monitor. The node is assumed to incur a fixed cost for each transmission, and the…

Information Theory · Computer Science 2021-04-23 Kumar Saurav , Rahul Vaze

An asymptotic technique is developed to find the Signal-to-Interference-plus-Noise-Ratio (SINR) and spectral efficiency of a link with N receiver antennas in wireless networks with non-homogeneous distributions of nodes. It is found that…

Information Theory · Computer Science 2015-03-17 Siddhartan Govindasamy , Daniel W. Bliss

Step-asynchronous successive overrelaxation updates the values contained in a single vector using the usual Gau\ss-Seidel-like weighted rule, but arbitrarily mixing old and new values, the only constraint being temporal coherence: you…

Data Structures and Algorithms · Computer Science 2014-04-15 Sebastiano Vigna

In the distributed backup-placement problem each node of a network has to select one neighbor, such that the maximum number of nodes that make the same selection is minimized. This is a natural relaxation of the perfect matching problem, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-19 Leonid Barenboim , Gal Oren

In this paper we try to end the debate concerning the suitability of different updating schemes in random Boolean networks (RBNs). We quantify for the first time loose attractors in asyncrhonous RBNs, which allows us to analyze the…

Adaptation and Self-Organizing Systems · Physics 2011-11-10 Carlos Gershenson

We give an effective bound of the joint spectral radius $\rho(\Sigma)$ for a finite set $\Sigma$ of nonnegative matrices: For every $n$, \[ \sqrt[n]{\left(\frac{V}{UD}\right)^{D} \max_C \max_{i,j\in C} \max_{A_1,\dots,A_n\in\Sigma}(A_1\dots…

Functional Analysis · Mathematics 2022-10-26 Vuong Bui

We present a computational method for open-loop minimum-norm control synthesis for fixed-endpoint transfer of bilinear ensemble systems that are indexed by two continuously varying parameters. We suppose that one ensemble parameter scales…

Optimization and Control · Mathematics 2024-10-15 Luke S. Baker , Andre Luiz P. de Lima , Anatoly Zlotnik , Jr-Shin Li , Michael J. Martin

Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov…

Machine Learning · Computer Science 2025-11-11 Di Zhang

We study synchronization processes in networks of slightly non identical chaotic systems, for which a complete invariant synchronization manifold does not rigorously exist. We show and quantify how a slightly dispersed distribution in…

We study the local complete synchronization of discrete-time dynamical networks with time-varying couplings. Our conditions for the temporal variation of the couplings are rather general and include both variations in the network structure…

Dynamical Systems · Mathematics 2008-12-16 Wenlian Lu , Fatihcan M. Atay , Jürgen Jost

The detection rate for compact binary mergers has grown as the sensitivity of the global network of ground based gravitational wave detectors has improved, now reaching the stage where robust automation of the analyses is essential.…

General Relativity and Quantum Cosmology · Physics 2021-06-02 Neil J. Cornish