English
Related papers

Related papers: Fair Distributed Machine Learning with Imbalanced …

200 papers

When deployed in the world, a learning agent such as a recommender system or a chatbot often repeatedly interacts with another learning agent (such as a user) over time. In many such two-agent systems, each agent learns separately and the…

Machine Learning · Computer Science 2024-06-24 Kate Donahue , Nicole Immorlica , Meena Jagadeesan , Brendan Lucier , Aleksandrs Slivkins

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva

Federated Learning has gained attention for its ability to enable multiple nodes to collaboratively train machine learning models without sharing raw data. At the same time, Generative AI -- particularly Generative Adversarial Networks…

Machine Learning · Computer Science 2026-01-19 Youssef Tawfilis , Hossam Amer , Minar El-Aasser , Tallal Elshabrawy

In this study, we consider classification problems based on neural networks in data-imbalanced environment. Learning from an imbalanced data set is one of the most important and practical problems in the field of machine learning. A…

Machine Learning · Statistics 2019-12-02 Muneki Yasuda , Seishirou Ueno

We investigate the generalisation performance of Distributed Gradient Descent with Implicit Regularisation and Random Features in the homogenous setting where a network of agents are given data sampled independently from the same unknown…

Machine Learning · Statistics 2020-07-02 Dominic Richards , Patrick Rebeschini , Lorenzo Rosasco

Fully decentralised federated learning enables collaborative training of individual machine learning models on a distributed network of communicating devices while keeping the training data localised on each node. This approach avoids…

Machine Learning · Computer Science 2025-05-23 Arash Badie-Modiri , Chiara Boldrini , Lorenzo Valerio , János Kertész , Márton Karsai

Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones and vehicles. Due to the limitations of communication costs and security…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-05 Hao Chen , Yu Ye , Ming Xiao , Mikael Skoglund , H. Vincent Poor

This paper addresses the increasingly prominent problem of anomaly detection in distributed systems. It proposes a detection method based on federated contrastive learning. The goal is to overcome the limitations of traditional centralized…

Machine Learning · Computer Science 2025-06-25 Renzi Meng , Heyi Wang , Yumeng Sun , Qiyuan Wu , Lian Lian , Renhan Zhang

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert

As the complexity of our neural network models grow, so too do the data and computation requirements for successful training. One proposed solution to this problem is training on a distributed network of computational devices, thus…

Machine Learning · Computer Science 2020-05-22 Kyle Crandall , Dustin Webb

Federated Learning (FL) is an innovative distributed machine learning paradigm that enables neural network training across devices without centralizing data. While this addresses issues of information sharing and data privacy, challenges…

Machine Learning · Computer Science 2024-12-09 Jiayu Liu , Yong Wang , Nianbin Wang , Jing Yang , Xiaohui Tao

Variational inequalities are a formalism that includes games, minimization, saddle point, and equilibrium problems as special cases. Methods for variational inequalities are therefore universal approaches for many applied tasks, including…

Decentralized training of deep learning models is a key element for enabling data privacy and on-device learning over networks. In realistic learning scenarios, the presence of heterogeneity across different clients' local datasets poses an…

Machine Learning · Computer Science 2021-06-21 Tao Lin , Sai Praneeth Karimireddy , Sebastian U. Stich , Martin Jaggi

This paper considers the problem of detecting impaired and noisy nodes over network. In a distributed algorithm, lots of processing units are incorporating and communicating with each other to reach a global goal. Due to each one's state in…

Multiagent Systems · Computer Science 2019-10-23 Mahdi Shamsi , Alireza Moslemi Haghighi , Farokh Marvasti

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

The label distribution skew induced data heterogeniety has been shown to be a significant obstacle that limits the model performance in federated learning, which is particularly developed for collaborative model training over decentralized…

Machine Learning · Computer Science 2023-03-16 Jian Xu , Meiling Yang , Wenbo Ding , Shao-Lun Huang

This paper considers distributed M-estimation under heterogeneous distributions among distributed data blocks. A weighted distributed estimator is proposed to improve the efficiency of the standard "Split-And-Conquer" (SaC) estimator for…

Statistics Theory · Mathematics 2022-09-15 Jia Gu , Songxi Chen

In this paper, we focus on the fairness issues regarding unsupervised outlier detection. Traditional algorithms, without a specific design for algorithmic fairness, could implicitly encode and propagate statistical bias in data and raise…

Machine Learning · Computer Science 2021-06-10 Hanyu Song , Peizhao Li , Hongfu Liu

Distributed machine learning has been widely studied in order to handle exploding amount of data. In this paper, we study an important yet less visited distributed learning problem where features are inherently distributed or vertically…

Machine Learning · Computer Science 2019-07-19 Yaochen Hu , Peng Liu , Linglong Kong , Di Niu

Federated Learning (FL) is a distributed machine learning protocol that allows a set of agents to collaboratively train a model without sharing their datasets. This makes FL particularly suitable for settings where data privacy is desired.…

Machine Learning · Computer Science 2021-12-03 Mustafa Safa Ozdayi , Murat Kantarcioglu