English
Related papers

Related papers: A Resilient Convex Combination for consensus-based…

200 papers

We address the problem of distributed uncon- strained convex optimization under separability assumptions, i.e., the framework where each agent of a network is endowed with a local private multidimensional convex cost, is subject to…

Optimization and Control · Mathematics 2015-11-06 Damiano Varagnolo , Filippo Zanella , Angelo Cenedese , Gianluigi Pillonetto , Luca Schenato

Distributed learning has become a necessity for training ever-growing models by sharing calculation among several devices. However, some of the devices can be faulty, deliberately or not, preventing the proper convergence. As a matter of…

Machine Learning · Computer Science 2022-02-08 Jason Akoun , Sebastien Meyer

Multilayer networks provide a more comprehensive framework for exploring real-world and engineering systems than traditional single-layer networks, consisting of multiple interacting networks. However, despite significant research in…

Optimization and Control · Mathematics 2024-11-12 C. D. Rodríguez-Camargo , A. F. Urquijo-Rodríguez , E. A. Mojica-Nava

Population protocols model information spreading and computation in network systems where pairwise node exchanges are determined by an external random scheduler and nodes have small memory. Most of the population protocols in the literature…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-06 Costas Busch , Dariusz R. Kowalski

We propose an approach to construction of robust non-Euclidean iterative algorithms for convex composite stochastic optimization based on truncation of stochastic gradients. For such algorithms, we establish sub-Gaussian confidence bounds…

Statistics Theory · Mathematics 2019-07-08 Anatoli Juditsky , Alexander Nazin , Arkadi Nemirovsky , Alexandre Tsybakov

In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may…

Machine Learning · Computer Science 2019-11-12 Liping Li , Wei Xu , Tianyi Chen , Georgios B. Giannakis , Qing Ling

This paper deals with distributed finite-sum optimization for learning over networks in the presence of malicious Byzantine attacks. To cope with such attacks, most resilient approaches so far combine stochastic gradient descent (SGD) with…

Machine Learning · Computer Science 2023-07-19 Zhaoxian Wu , Qing Ling , Tianyi Chen , Georgios B. Giannakis

We present a fully distributed collision avoidance algorithm based on convex optimization for a team of mobile robots. This method addresses the practical case in which agents sense each other via measurements from noisy on-board sensors…

Optimization and Control · Mathematics 2019-06-04 Guillermo Angeris , Kunal Shah , Mac Schwager

In this work we study binary classification problems where we assume that our training data is subject to uncertainty, i.e. the precise data points are not known. To tackle this issue in the field of robust machine learning the aim is to…

Machine Learning · Computer Science 2022-03-04 Jannis Kurtz

We consider a distributionally robust formulation of stochastic optimization problems arising in statistical learning, where robustness is with respect to uncertainty in the underlying data distribution. Our formulation builds on…

Optimization and Control · Mathematics 2021-06-09 Mert Gürbüzbalaban , Andrzej Ruszczyński , Landi Zhu

This paper investigates the problem of resilient control for multi-agent systems in the presence of Byzantine adversaries via an active secure neighbor selection framework. A pre-discriminative graph is first constructed to characterize the…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Jinming Gao , Yijing Wang , Wentao Zhang , Rui Zhao , Yang Shi , Zhiqiang Zuo

Primal-dual methods in online optimization give several of the state-of-the art results in both of the most common models: adversarial and stochastic/random order. Here we try to provide a more unified analysis of primal-dual algorithms to…

Data Structures and Algorithms · Computer Science 2020-11-04 Marco Molinaro

This two-part paper discusses robustification methodologies for linear-iterative distributed algorithms for consensus and coordination problems in multicomponent systems, in which unreliable communication links may drop packets. We consider…

Systems and Control · Computer Science 2011-09-30 Alejandro D. Dominguez-Garcia , Christoforos N. Hadjicostis , Nitin H. Vaidya

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

Optimization and Control · Mathematics 2020-10-06 Francesco Farina , Giuseppe Notarstefano

Concerning huge-scale aggregative convex programming of a linear objective subject to the affine constraints of equality and inequality and the quadratic constraints of inequality, convex and aggregatively computable, an algorithm is…

Optimization and Control · Mathematics 2026-05-05 Luoyi Tao

Numerous distributed tasks have to be handled in a setting where a fraction of nodes behaves Byzantine, that is, deviates arbitrarily from the intended protocol. Resilient, deterministic protocols rely on the detection of majorities to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Philipp Schneider

We propose a retrieval-augmented convolutional network and propose to train it with local mixup, a novel variant of the recently proposed mixup algorithm. The proposed hybrid architecture combining a convolutional network and an…

Machine Learning · Computer Science 2018-02-27 Jake Zhao , Kyunghyun Cho

We present new algorithms to perform fast probabilistic collision queries between convex as well as non-convex objects. Our approach is applicable to general shapes, where one or more objects are represented using Gaussian probability…

Robotics · Computer Science 2016-10-13 Jae Sung Park , Chonhyon Park , Dinesh Manocha

This paper describes a simple and efficient asynchronous Binary Byzantine faulty tolerant consensus algorithm. In the algorithm, non-faulty nodes perform an initial broadcast followed by a executing a series of rounds each consisting of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-12 Tyler Crain

This paper introduces a deterministic Byzantine consensus algorithm that relies on a new weak coordinator. As opposed to previous algorithms that cannot terminate in the presence of a faulty or slow coordinator, our algorithm can terminate…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Tyler Crain , Vincent Gramoli , Mikel Larrea , Michel Raynal