English
Related papers

Related papers: Near-Optimal Resilient Aggregation Rules for Distr…

200 papers

In this paper, we consider two types of robust models of the $k$-median/$k$-means problems: the outlier-version ($k$-MedO/$k$-MeaO) and the penalty-version ($k$-MedP/$k$-MeaP), in which we can mark some points as outliers and discard them.…

Data Structures and Algorithms · Computer Science 2021-01-01 Yishui Wang , Rolf H. Möhring , Chenchen Wu , Dachuan Xu , Dongmei Zhang

Deep networks have gained immense popularity in Computer Vision and other fields in the past few years due to their remarkable performance on recognition/classification tasks surpassing the state-of-the art. One of the keys to their success…

Machine Learning · Computer Science 2018-06-04 Rudrasis Chakraborty , Chun-Hao Yang , Baba C. Vemuri

In decentralized machine learning, different devices communicate in a peer-to-peer manner to collaboratively learn from each other's data. Such approaches are vulnerable to misbehaving (or Byzantine) devices. We introduce F-RG, a general…

Optimization and Control · Mathematics 2025-06-12 Renaud Gaucher , Aymeric Dieuleveut , Hadrien Hendrikx

Despite the recent success of artificial neural networks, more biologically plausible learning methods may be needed to resolve the weaknesses of backpropagation trained models such as catastrophic forgetting and adversarial attacks.…

Machine Learning · Computer Science 2022-08-09 Ole Christian Eidheim

The presence of outliers is prevalent in machine learning applications and may produce misleading results. In this paper a new method for dealing with outliers and anomal samples is proposed. To overcome the outlier issue, the proposed…

Machine Learning · Computer Science 2016-07-05 Parsa Bagherzadeh , Hadi Sadoghi Yazdi

This paper studies the Byzantine Agreement problem where the nodes have access to a predictor that flags nodes for suspicion of faulty (Byzantine) behavior. We focus on algorithmic resilience -- the maximum number of faulty nodes an…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Julien Dallot , Darya Melnyk , Tijana Milentijevic , Stefan Schmid , Patrik Welters

In federated learning, most existing robust aggregation rules (AGRs) combat Byzantine attacks in the IID setting, where client data is assumed to be independent and identically distributed. In this paper, we address label skewness, a more…

Machine Learning · Computer Science 2024-03-21 Wenxuan Bao , Jun Wu , Jingrui He

The presence of outliers can prevent clustering algorithms from accurately determining an appropriate group structure within a data set. We present outlierMBC, a model-based approach for sequentially removing outliers and clustering the…

Methodology · Statistics 2025-06-30 Ultán P. Doherty , Paul D. McNicholas , Arthur White

Federated learning faces increasing threats from model poisoning attacks, which harms its application to improve privacy. Existing defense methods typically rely on fixed thresholds or perform clustering with a fixed number of clusters to…

Cryptography and Security · Computer Science 2026-05-22 Tianyun Zhang , Zhen Yang , Haozhao Wang , Ru Zhang , Yongfeng Huang

Clustering stands as one of the most prominent challenges in unsupervised machine learning. Among centroid-based methods, the classic $k$-means algorithm, based on Lloyd's heuristic, is widely used. Nonetheless, it is a well-known fact that…

Machine Learning · Statistics 2025-01-30 Supratik Basu , Jyotishka Ray Choudhury , Debolina Paul , Swagatam Das

We propose a novel robust aggregation rule for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-25 Cong Xie , Oluwasanmi Koyejo , Indranil Gupta

This paper presents a resilient distributed algorithm for solving a system of linear algebraic equations over a multi-agent network in the presence of Byzantine agents capable of arbitrarily introducing untrustworthy information in…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Jingxuan Zhu , Alvaro Velasquez , Ji Liu

This paper studies distributed diffusion adaptation over clustered multi-task networks in the presence of impulsive interferences and Byzantine attacks. We develop a robust resilient diffusion least mean Geman-McClure-estimation (RDLMG)…

Machine Learning · Computer Science 2022-06-28 Tao Yu , Rodrigo C. de Lamare , Yi Yu

Clustering with outliers is one of the most fundamental problems in Computer Science. Given a set $X$ of $n$ points and two integers $k$ and $m$, the clustering with outliers aims to exclude $m$ points from $X$ and partition the remaining…

Data Structures and Algorithms · Computer Science 2023-02-21 Akanksha Agrawal , Tanmay Inamdar , Saket Saurabh , Jie Xue

Recent advances in center-based clustering continue to improve upon the drawbacks of Lloyd's celebrated $k$-means algorithm over $60$ years after its introduction. Various methods seek to address poor local minima, sensitivity to outliers,…

Machine Learning · Statistics 2021-10-28 Debolina Paul , Saptarshi Chakraborty , Swagatam Das , Jason Xu

In this paper, we study the problem of {\em $k$-center clustering with outliers}. The problem has many important applications in real world, but the presence of outliers can significantly increase the computational complexity. Though a…

Machine Learning · Computer Science 2023-01-10 Hu Ding , Ruomin Huang , Kai Liu , Haikuo Yu , Zixiu Wang

The resilient consensus problem is investigated in this paper for a class of networked Euler-Lagrange systems with event-triggered communication in the presence of Byzantine attacks. One challenge that we face in addressing the considered…

Optimization and Control · Mathematics 2025-07-22 Yuliang Fu , Guanghui Wen , Dan Zhao , Wei Xing Zheng , Xiaolei Li

We study the clustering problem for mixtures of bounded covariance distributions, under a fine-grained separation assumption. Specifically, given samples from a $k$-component mixture distribution $D = \sum_{i =1}^k w_i P_i$, where each $w_i…

Machine Learning · Computer Science 2023-12-20 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Thanasis Pittas

Clustering is a fundamental tool in statistical machine learning in the presence of heterogeneous data. Most recent results focus primarily on optimal mislabeling guarantees when data are distributed around centroids with sub-Gaussian…

Statistics Theory · Mathematics 2024-10-24 Soham Jana , Jianqing Fan , Sanjeev Kulkarni

Federated recommendation systems can provide good performance without collecting users' private data, making them attractive. However, they are susceptible to low-cost poisoning attacks that can degrade their performance. In this paper, we…

Machine Learning · Computer Science 2020-06-16 Chen Chen , Jingfeng Zhang , Anthony K. H. Tung , Mohan Kankanhalli , Gang Chen