English
Related papers

Related papers: Centroid Approximation with Multidimensional Appro…

200 papers

Source-free domain adaptation (SFDA) aims to transfer knowledge learned from a source domain to an unlabeled target domain, where the source data is unavailable during adaptation. Existing approaches for SFDA focus on self-training usually…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Idit Diamant , Roy H. Jennings , Oranit Dror , Hai Victor Habi , Arnon Netzer

This paper discusses distributed approaches for the solution of random convex programs (RCP). RCPs are convex optimization problems with a (usually large) number N of randomly extracted constraints; they arise in several applicative areas,…

Optimization and Control · Mathematics 2012-07-27 Luca Carlone , Vaibhav Srivastava , Francesco Bullo , Giuseppe Calafiore

The problem of saddle-point avoidance for non-convex optimization is quite challenging in large scale distributed learning frameworks, such as Federated Learning, especially in the presence of Byzantine workers. The celebrated…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-30 Avishek Ghosh , Raj Kumar Maity , Arya Mazumdar , Kannan Ramchandran

Reaching agreement in the presence of arbitrary faults is a fundamental problem in distributed computation, which has been shown to be unsolvable if one-third of the processes can fail, unless signed messages are used. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-20 Vicent Cholvi

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

Arma is a Byzantine Fault Tolerant (BFT) consensus system designed to achieve horizontal scalability across all hardware resources: network bandwidth, CPU, and disk I/O. As opposed to preceding BFT protocols, Arma separates the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-29 Yacov Manevich , Hagar Meir , Kaoutar Elkhiyaoui , Yoav Tock , May Buzaglo

This paper presents an algorithm for the efficient approximation of the saddle-extremum persistence diagram of a scalar field. Vidal et al. introduced recently a fast algorithm for such an approximation (by interrupting a progressive…

Graphics · Computer Science 2021-08-13 Jules Vidal , Julien Tierny

In large-scale distributed learning, security issues have become increasingly important. Particularly in a decentralized environment, some computing units may behave abnormally, or even exhibit Byzantine failures -- arbitrary and…

Machine Learning · Computer Science 2021-02-26 Dong Yin , Yudong Chen , Kannan Ramchandran , Peter Bartlett

We consider the problem of distributed mean estimation (DME), in which $n$ machines are each given a local $d$-dimensional vector $x_v \in \mathbb{R}^d$, and must cooperate to estimate the mean of their inputs $\mu = \frac 1n\sum_{v = 1}^n…

Machine Learning · Computer Science 2021-04-08 Peter Davies , Vijaykrishna Gurunathan , Niusha Moshrefi , Saleh Ashkboos , Dan Alistarh

Communication efficiency and robustness are two major issues in modern distributed learning framework. This is due to the practical situations where some computing nodes may have limited communication power or may behave adversarial…

Machine Learning · Statistics 2021-03-02 Xingcai Zhou , Le Chang , Pengfei Xu , Shaogao Lv

In the a posteriori approach of multiobjective optimization the Pareto front is approximated by a finite set of solutions in the objective space. The quality of the approximation can be measured by different indicators that take into…

Artificial Intelligence · Computer Science 2015-03-27 Luis Marti , Christian Grimme , Pascal Kerschke , Heike Trautmann , Günter Rudolph

We prove the existence of an algorithm $A$ for computing 2-d or 3-d convex hulls that is optimal for every point set in the following sense: for every sequence $\sigma$ of $n$ points and for every algorithm $A'$ in a certain class…

Computational Geometry · Computer Science 2015-05-04 Peyman Afshani , Jérémy Barbay , Timothy Chan

We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in…

Machine Learning · Computer Science 2021-12-08 Dan Alistarh , Janne H. Korhonen

In this paper, we investigate the problem of decentralized consensus optimization over directed graphs with limited communication bandwidth. We introduce a novel decentralized optimization algorithm that combines the Reduced Consensus…

Optimization and Control · Mathematics 2025-08-11 Xu Du , Karl H. Johansson , Apostolos I. Rikos

In this paper, we show that applying adaptive methods directly to distributed minimax problems can result in non-convergence due to inconsistency in locally computed adaptive stepsizes. To address this challenge, we propose D-AdaST, a…

Optimization and Control · Mathematics 2024-06-06 Yan Huang , Xiang Li , Yipeng Shen , Niao He , Jinming Xu

This paper studies consensus of discrete-time multi-agent systems under time-varying directed communication, state and input constraints using a distributed multi-step model predictive control (MPC) framework. Consensus is recast as…

Optimization and Control · Mathematics 2026-02-18 Navid Noroozi

MCMC algorithms such as Metropolis-Hastings algorithms are slowed down by the computation of complex target distributions as exemplified by huge datasets. We offer in this paper a useful generalisation of the Delayed Acceptance approach,…

Computation · Statistics 2015-03-06 Marco Banterle , Clara Grazian , Anthony Lee , Christian P. Robert

This paper addresses distributed consensus optimization problems with mixed-integer variables, with a specific focus on Boolean variables. We introduce a novel distributed algorithm that extends the Consensus Augmented Lagrangian…

Optimization and Control · Mathematics 2026-04-17 Boyu Han , Xu Du , Karl H. Johansson , Apostolos I. Rikos

Distributed multi-task learning provides significant advantages in multi-agent networks with heterogeneous data sources where agents aim to learn distinct but correlated models simultaneously.However, distributed algorithms for learning…

Machine Learning · Computer Science 2021-01-11 Jiani Li , Waseem Abbas , Xenofon Koutsoukos

This paper presents a novel approach for resilient distributed consensus in multiagent networks when dealing with adversarial agents imprecision in states observed by normal agents. Traditional resilient distributed consensus algorithms…

Systems and Control · Electrical Eng. & Systems 2024-03-15 Christopher A. Lee , Waseem Abbas