English
Related papers

Related papers: Federated Training of Dual Encoding Models on Smal…

200 papers

Federated Learning (FL) enables decentralized machine learning while preserving data privacy, making it ideal for sensitive applications where data cannot be shared. While FL has been widely studied in supervised contexts, its application…

Machine Learning · Computer Science 2026-01-09 Mirko Nardi , Lorenzo Valerio , Andrea Passarella

Federated learning (FL) enables learning from decentralized privacy-sensitive data, with computations on raw data confined to take place at edge clients. This paper introduces mixed FL, which incorporates an additional loss term calculated…

Machine Learning · Computer Science 2022-06-28 Sean Augenstein , Andrew Hard , Lin Ning , Karan Singhal , Satyen Kale , Kurt Partridge , Rajiv Mathews

Coupled tensor decomposition (CTD) can extract joint features from multimodal data in various applications. It can be employed for federated learning networks with data confidentiality. Federated CTD achieves data privacy protection by…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-06 Xiangtao Zhang , Eleftherios Kofidis , Ce Zhu , Le Zhang , Yipeng Liu

Federated learning is a promising distributed learning paradigm that enables collaborative model training without exposing local client data, thereby protecting data privacy. However, it also brings new threats and challenges. The…

Cryptography and Security · Computer Science 2026-04-14 Nina Cai , Jinguang Han , Weizhi Meng

Learning image representations on decentralized data can bring many benefits in cases where data cannot be aggregated across data silos. Softmax cross entropy loss is highly effective and commonly used for learning image representations.…

Machine Learning · Computer Science 2022-03-10 Sagar M. Waghmare , Hang Qi , Huizhong Chen , Mikhail Sirotenko , Tomer Meron

Federated Learning (FL) has emerged as a means of distributed learning using local data stored at clients with a coordinating server. Recent studies showed that FL can suffer from poor performance and slower convergence when training data…

Machine Learning · Computer Science 2023-08-17 Van Sy Mai , Richard J. La , Tao Zhang

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data…

Machine Learning · Computer Science 2021-05-18 Dhruv Guliani , Francoise Beaufays , Giovanni Motta

Federated learning opens a number of research opportunities due to its high communication efficiency in distributed training problems within a star network. In this paper, we focus on improving the communication efficiency for fully…

Machine Learning · Computer Science 2019-12-11 Songtao Lu , Yawen Zhang , Yunlong Wang , Christina Mack

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Recent developments and emerging use cases, such as smart Internet of Things (IoT) and Edge AI, have sparked considerable interest in the training of neural networks over fully decentralized (serverless) networks. One of the major…

Machine Learning · Computer Science 2025-01-30 Eunjeong Jeong , Marios Kountouris

Non-IID data present a tough challenge for federated learning. In this paper, we explore a novel idea of facilitating pairwise collaborations between clients with similar data. We propose FedAMP, a new method employing federated attentive…

Machine Learning · Computer Science 2021-12-15 Yutao Huang , Lingyang Chu , Zirui Zhou , Lanjun Wang , Jiangchuan Liu , Jian Pei , Yong Zhang

Clustered federated learning (FL) has been shown to produce promising results by grouping clients into clusters. This is especially effective in scenarios where separate groups of clients have significant differences in the distributions of…

Machine Learning · Computer Science 2022-09-22 Saeed Vahidian , Mahdi Morafah , Weijia Wang , Vyacheslav Kungurtsev , Chen Chen , Mubarak Shah , Bill Lin

Federated learning (FL) enables collaborative training without raw data sharing, but still risks training data memorization. Existing FL memorization detection techniques focus on one sample at a time, underestimating more subtle risks of…

Federated learning is a form of distributed learning with the key challenge being the non-identically distributed nature of the data in the participating clients. In this paper, we extend federated learning to the setting where multiple…

Machine Learning · Computer Science 2022-07-12 Neelkamal Bhuyan , Sharayu Moharir

As an emerging technology, federated learning (FL) involves training machine learning models over distributed edge devices, which attracts sustained attention and has been extensively studied. However, the heterogeneity of client data…

Machine Learning · Computer Science 2022-12-29 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

As a promising distributed machine learning paradigm, Federated Learning (FL) has attracted increasing attention to deal with data silo problems without compromising user privacy. By adopting the classic one-to-multi training scheme (i.e.,…

Machine Learning · Computer Science 2024-07-08 Ming Hu , Peiheng Zhou , Zhihao Yue , Zhiwei Ling , Yihao Huang , Anran Li , Yang Liu , Xiang Lian , Mingsong Chen

Federated learning is a distributed machine learning paradigm through centralized model aggregation. However, standard federated learning relies on a centralized server, making it vulnerable to server failures. While existing solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-03 Hongliang Zhang , Fenghua Xu , Zhongyuan Yu , Shanchen Pang , Chunqiang Hu , Jiguo Yu

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

We propose an efficient protocol for decentralized training of deep neural networks from distributed data sources. The proposed protocol allows to handle different phases of model training equally well and to quickly adapt to concept…

Machine Learning · Computer Science 2018-11-14 Michael Kamp , Linara Adilova , Joachim Sicking , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

Federated learning benefits from cross-training strategies, which enables models to train on data from distinct sources to improve generalization capability. However, due to inherent differences in data distributions, the optimization goals…

Artificial Intelligence · Computer Science 2025-09-17 Zhuang Qi , Lei Meng , Ruohan Zhang , Yu Wang , Xin Qi , Xiangxu Meng , Han Yu , Qiang Yang