English
Related papers

Related papers: Measuring Heterogeneity in Machine Learning with D…

200 papers

Federated Learning (FL) confronts a significant challenge known as data heterogeneity, which impairs model performance and convergence. Existing methods have made notable progress in addressing this issue. However, improving performance in…

Machine Learning · Computer Science 2025-10-24 Zhiqin Yang , Yonggang Zhang , Chenxin Li , Yiu-ming Cheung , Bo Han , Yixuan Yuan

We consider a distributed system, consisting of a heterogeneous set of devices, ranging from low-end to high-end. These devices have different profiles, e.g., different energy budgets, or different hardware specifications, determining their…

Machine Learning · Computer Science 2020-06-11 Martin Rapp , Ramin Khalili , Jörg Henkel

As an intrinsic and fundamental property of big data, data heterogeneity exists in a variety of real-world applications, such as precision medicine, autonomous driving, financial applications, etc. For machine learning algorithms, the…

Machine Learning · Computer Science 2023-04-04 Jiashuo Liu , Jiayun Wu , Bo Li , Peng Cui

Federated learning has attracted significant attention as a privacy-preserving framework for training personalised models on multi-source heterogeneous data. However, most existing approaches are unable to handle scenarios where subgroup…

Methodology · Statistics 2025-10-14 Changxin Yang , Zhongyi Zhu , Heng Lian

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

We consider a distributed estimation method in a setting with heterogeneous streams of correlated data distributed across nodes in a network. In the considered approach, linear models are estimated locally (i.e., with only local data)…

Machine Learning · Computer Science 2021-02-11 Lingzhou Hong , Alfredo Garcia , Ceyhun Eksin

Federated learning (FL) typically faces data heterogeneity, i.e., distribution shifting among clients. Sharing clients' information has shown great potentiality in mitigating data heterogeneity, yet incurs a dilemma in preserving privacy…

Machine Learning · Computer Science 2023-10-12 Zhiqin Yang , Yonggang Zhang , Yu Zheng , Xinmei Tian , Hao Peng , Tongliang Liu , Bo Han

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang

Federated learning is a collaborative model training method that iterates model updates by multiple clients and aggregation of the updates by a central server. Device and statistical heterogeneity of participating clients cause significant…

Machine Learning · Computer Science 2023-08-29 Ayano Nakai-Kasai , Tadashi Wadayama

In designing wireless sensor networks, it is important to reduce energy dissipation and prolong network lifetime. In this paper, a new model with energy and monitored objects heterogeneity is proposed for heterogeneous wireless sensor…

Networking and Internet Architecture · Computer Science 2011-06-01 Tang Liu , Jian Peng , Jin Yang , Chunli Wang

Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the…

Machine Learning · Computer Science 2022-12-01 Young Geun Kim , Carole-Jean Wu

An approach to distributed machine learning is to train models on local datasets and aggregate these models into a single, stronger model. A popular instance of this form of parallelization is federated learning, where the nodes…

Machine Learning · Computer Science 2019-11-19 Linara Adilova , Julia Rosenzweig , Michael Kamp

Federated learning is an efficient framework designed to facilitate collaborative model training across multiple distributed devices while preserving user data privacy. A significant challenge of federated learning is data-level…

Machine Learning · Computer Science 2024-08-26 Shunxin Guo , Hongsong Wang , Shuxia Lin , Zhiqiang Kou , Xin Geng

Federated Learning allows training of data stored in distributed devices without the need for centralizing training data, thereby maintaining data privacy. Addressing the ability to handle data heterogeneity (non-identical and independent…

Machine Learning · Computer Science 2021-07-01 Pravin Chandran , Raghavendra Bhat , Avinash Chakravarthi , Srikanth Chandar

In recent years, machine learning has demonstrated impressive capability in handling molecular science tasks. To support various molecular properties at scale, machine learning models are trained in the multi-task learning paradigm.…

Machine Learning · Computer Science 2024-10-15 Yuxuan Ren , Dihan Zheng , Chang Liu , Peiran Jin , Yu Shi , Lin Huang , Jiyan He , Shengjie Luo , Tao Qin , Tie-Yan Liu

A number of machine learning algorithms are using a metric, or a distance, in order to compare individuals. The Euclidean distance is usually employed, but it may be more efficient to learn a parametric distance such as Mahalanobis metric.…

Machine Learning · Computer Science 2016-12-16 Hoel Le Capitaine

Decentralized learning provides an effective framework to train machine learning models with data distributed over arbitrary communication graphs. However, most existing approaches toward decentralized learning disregard the interaction…

Machine Learning · Computer Science 2022-04-14 Yatin Dandi , Anastasia Koloskova , Martin Jaggi , Sebastian U. Stich

We consider Heterogeneous Transfer Learning (HTL) from a source to a new target domain for high-dimensional regression with differing feature sets. Most homogeneous TL methods assume that target and source domains share the same feature…

Machine Learning · Statistics 2025-12-02 Jae Ho Chang , Massimiliano Russo , Subhadeep Paul

Federated Learning (FL) is a distributed learning paradigm that can coordinate heterogeneous edge devices to perform model training without sharing private data. While prior works have focused on analyzing FL convergence with respect to…

Machine Learning · Computer Science 2025-09-09 Weijie Liu , Xiaoxi Zhang , Jingpu Duan , Carlee Joe-Wong , Zhi Zhou , Xu Chen

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee