English
Related papers

Related papers: Measuring Heterogeneity in Machine Learning with D…

200 papers

The theory underlying robust distributed learning algorithms, designed to resist adversarial machines, matches empirical observations when data is homogeneous. Under data heterogeneity however, which is the norm in practical scenarios,…

Machine Learning · Computer Science 2023-10-31 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Rafaël Pinot , Geovani Rizk

There is an increasing interest in a fast-growing machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), exploiting UEs' local computation and training data.…

Machine Learning · Computer Science 2020-12-23 Canh T. Dinh , Nguyen H. Tran , Minh N. H. Nguyen , Choong Seon Hong , Wei Bao , Albert Y. Zomaya , Vincent Gramoli

Federated Learning (FL) is a distributed learning scheme that enables deep learning to be applied to sensitive data streams and applications in a privacy-preserving manner. This paper focuses on the use of FL for analyzing smart energy…

Machine Learning · Computer Science 2024-04-05 Abhishek Duttagupta , Jin Zhao , Shanker Shreejith

In myriad statistical applications, data are collected from related but heterogeneous sources. These sources share some commonalities while containing idiosyncratic characteristics. One of the most fundamental challenges in such scenarios…

Methodology · Statistics 2024-03-29 Naichen Shi , Raed Al Kontar , Salar Fattahi

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

We introduce the diffusion and superposition distances as two metrics to compare signals supported in the nodes of a network. Both metrics consider the given vectors as initial temperature distributions and diffuse heat trough the edges of…

Social and Information Networks · Computer Science 2014-12-01 Santiago Segarra , Weiyu Huang , Alejandro Ribeiro

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

Data heterogeneity is one of the most challenging issues in federated learning, which motivates a variety of approaches to learn personalized models for participating clients. One such approach in deep neural networks based tasks is…

Machine Learning · Computer Science 2023-06-22 Jian Xu , Xinyi Tong , Shao-Lun Huang

Energy theft poses a significant threat to the stability and efficiency of smart grids, leading to substantial economic losses and operational challenges. Traditional centralized machine learning approaches for theft detection require…

Machine Learning · Computer Science 2026-02-19 Diego Labate , Dipanwita Thakur , Giancarlo Fortino

We consider several estimation and learning problems that networked agents face when making decisions given their uncertainty about an unknown variable. Our methods are designed to efficiently deal with heterogeneity in both size and…

Applications · Statistics 2016-11-11 M. Amin Rahimian , Ali Jadbabaie

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

The paper presents new metrics to quantify and test for (i) the equality of distributions and (ii) the independence between two high-dimensional random vectors. We show that the energy distance based on the usual Euclidean distance cannot…

Methodology · Statistics 2019-10-01 Shubhadeep Chakraborty , Xianyang Zhang

In this paper, we investigate the effect of data heterogeneity across clients on the performance of distributed learning systems, i.e., one-round Federated Learning, as measured by the associated generalization error. Specifically, $K$…

Machine Learning · Computer Science 2025-05-21 Masoud Kavian , Romain Chor , Milad Sefidgaran , Abdellatif Zaidi

To tackle the scarcity and privacy issues associated with domain-specific datasets, the integration of federated learning in conjunction with fine-tuning has emerged as a practical solution. However, our findings reveal that federated…

Machine Learning · Computer Science 2024-01-26 Mengyao Du , Miao Zhang , Yuwen Pu , Kai Xu , Shouling Ji , Quanjun Yin

Federated Learning (FL) is a decentralized machine learning approach where local models are trained on distributed clients, allowing privacy-preserving collaboration by sharing model updates instead of raw data. However, the added…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-17 Pratik Agrawal , Philipp Wiesner , Odej Kao

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Federated learning is a distributed machine learning approach where multiple clients collaboratively train a model without sharing their local data, which contributes to preserving privacy. A challenge in federated learning is managing…

Machine Learning · Computer Science 2025-03-04 Rickard Brännvall

Federated learning enables a collaborative training and optimization of global models among a group of devices without sharing local data samples. However, the heterogeneity of data in federated learning can lead to unfair representation of…

Machine Learning · Computer Science 2023-11-03 Weikang Chen , Junping Du , Yingxia Shao , Jia Wang , Yangxi Zhou

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

Electrical load prediction has become an integral part of power system operation. Deep learning models have found popularity for this purpose. However, to achieve a desired prediction accuracy, they require huge amounts of data for…

Machine Learning · Computer Science 2021-11-16 Nastaran Gholizadeh , Petr Musilek