English
Related papers

Related papers: Computable convergence rate bound for ratio consen…

200 papers

The present paper is devoted to estimating the speed of convergence towards consensus for a general class of discrete-time multi-agent systems. In the systems considered here, both the topology of the interconnection graph and the weight of…

Optimization and Control · Mathematics 2020-10-02 David Angeli , Pierre-Alexandre Bliman

Denote by $A$ the adjacency matrix of an Erdos-Renyi graph with bounded average degree. We consider the problem of maximizing $\langle A-E\{A\},X\rangle$ over the set of positive semidefinite matrices $X$ with diagonal entries $X_{ii}=1$.…

Discrete Mathematics · Computer Science 2015-12-25 Andrea Montanari , Subhabrata Sen

We propose a hybrid resampling method to approximate finitely supported Wasserstein barycenters on large-scale datasets, which can be combined with any exact solver. Nonasymptotic bounds on the expected error of the objective value as well…

Computation · Statistics 2021-05-28 Florian Heinemann , Axel Munk , Yoav Zemel

Consensus conditions and convergence speeds are crucial for distributed consensus algorithms of networked systems. Based on a basic first-order average-consensus protocol with time-varying topologies and additive noises, this paper first…

Optimization and Control · Mathematics 2017-04-26 Ge Chen , Le Yi Wang , Chen Chen , George Yin

Confidence bounds are an essential tool for rigorously quantifying the uncertainty of predictions. They are a core component in many sequential learning and decision-making algorithms, with tighter confidence bounds giving rise to…

Machine Learning · Statistics 2024-11-12 Hamish Flynn , David Reeb

In this paper, we establish explicit convergence rates for the stochastic smooth approximations of infimal convolutions introduced and developed in \cite{MR4581306,MR4923371}. In particular, we quantify the convergence of the associated…

Optimization and Control · Mathematics 2026-02-23 Diego Morales , Pedro Pérez-Aros , Emilio Vilches

This paper considers a distributionally robust chance constraint model with a general ambiguity set. We show that a sample based approximation of this model converges under suitable sufficient conditions. We also show that upper and lower…

Optimization and Control · Mathematics 2025-01-17 Jiaqi Lei , Sanjay Mehrotra

This paper studies proofs of strong convergence of various iterative algorithms for computing the unique zeros of set-valued accretive operators that also satisfy some weak form of uniform accretivity at zero. More precisely, we extract…

Optimization and Control · Mathematics 2020-04-27 Ulrich Kohlenbach , Thomas Powell

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

Statistics Theory · Mathematics 2016-07-21 Jana Janková , Sara van de Geer

We develop a generic method for bounding the convergence rate of an averaging algorithm running in a multi-agent system with a time-varying network, where the associated stochastic matrices have a time-independent Perron vector. This method…

Multiagent Systems · Computer Science 2020-07-10 Bernadette Charron-Bost

Approximate agreement is one of the few variants of consensus that can be solved in a wait-free manner in asynchronous systems where processes communicate by reading and writing to shared memory. In this work, we consider a natural…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-17 Dan Alistarh , Faith Ellen , Joel Rybicki

We developed a corporative stochastic approximation (CSA) type algorithm for semi-infinite programming (SIP), where the cut generation problem is solved inexactly. First, we provide general error bounds for inexact CSA. Then, we propose two…

Optimization and Control · Mathematics 2018-12-24 Bo Wei , William B. Haskell , Sixiang Zhao

When randomized ensembles such as bagging or random forests are used for binary classification, the prediction error of the ensemble tends to decrease and stabilize as the number of classifiers increases. However, the precise relationship…

Probability · Mathematics 2019-05-01 Miles E. Lopes

In this work, we provide a fundamental unified convergence theorem used for deriving expected and almost sure convergence results for a series of stochastic optimization methods. Our unified theorem only requires to verify several…

Optimization and Control · Mathematics 2022-10-20 Xiao Li , Andre Milzarek

We introduce the concept of community consensus in the presence of malicious agents using a well-known median-based consensus algorithm. We consider networks that have multiple well-connected regions that we term communities, characterized…

Multiagent Systems · Computer Science 2024-06-27 Cristina Gava , Aron Vekassy , Matthew Cavorsi , Stephanie Gil , Frederik Mallmann-Trenn

In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given…

Optimization and Control · Mathematics 2022-01-25 Jia Wang , Ying Yang

Large-scale quantum computation will only be achieved if experimentally implementable quantum error correction procedures are devised that can tolerate experimentally achievable error rates. We describe a quantum error correction procedure…

Quantum Physics · Physics 2011-02-22 David S. Wang , Austin G. Fowler , Lloyd C. L. Hollenberg

We study the convergence of a random iterative sequence of a family of operators on infinite dimensional Hilbert spaces, inspired by the Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless regression, as studied in [1].…

Functional Analysis · Mathematics 2022-09-02 Soumyadip Ghosh , Yingdong Lu , Tomasz J. Nowicki

In this note, we propose a framework for proving computational lower bounds in norm approximation by leveraging a reverse detection--estimation gap. The starting point is a testing problem together with an estimator whose error is…

Statistics Theory · Mathematics 2026-04-07 Runshi Tang , Yuefeng Han , Anru R. Zhang

Stochastic-approximation gradient methods are attractive for large-scale convex optimization because they offer inexpensive iterations. They are especially popular in data-fitting and machine-learning applications where the data arrives in…

Optimization and Control · Mathematics 2014-01-09 Michael P. Friedlander , Gabriel Goh