English
Related papers

Related papers: Mosaic Learning: A Framework for Decentralized Lea…

200 papers

Collaborative self-supervised learning has recently become feasible in highly distributed environments by dividing the network layers between client devices and a central server. However, state-of-the-art methods, such as MocoSFL, are…

Machine Learning · Computer Science 2025-03-18 Marcin Przewięźlikowski , Marcin Osial , Bartosz Zieliński , Marek Śmieja

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

Federated Learning (FL) enables distributed learning across multiple clients without sharing raw data. When statistical heterogeneity across clients is severe, Clustered Federated Learning (CFL) can improve performance by grouping similar…

Machine Learning · Computer Science 2026-01-15 Sota Sugawara , Yuji Kawamata , Akihiro Toyoda , Tomoru Nakayama , Yukihiko Okada

This letter proposes two novel proactive cooperative caching approaches using deep learning (DL) to predict users' content demand in a mobile edge caching network. In the first approach, a (central) content server takes responsibilities to…

Networking and Internet Architecture · Computer Science 2018-12-14 Yuris Mulya Saputra , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz , Dusit Niyato , Dong In Kim

Distributed Learning (DL) enables the training of machine learning models across multiple devices, yet it faces challenges like non-IID data distributions and device capability disparities, which can impede training efficiency.…

Machine Learning · Computer Science 2025-02-20 Mengchen Fan , Keren Li , Tianyun Zhang , Qing Tian , Baocheng Geng

Distributed Machine Learning refers to the practice of training a model on multiple computers or devices that can be called nodes. Additionally, serverless computing is a new paradigm for cloud computing that uses functions as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-28 Amine Barrak , Fabio Petrillo , Fehmi Jaafar

We consider the fully decentralized machine learning scenario where many users with personal datasets collaborate to learn models through local peer-to-peer exchanges, without a central coordinator. We propose to train personalized models…

Machine Learning · Computer Science 2024-12-20 Valentina Zantedeschi , Aurélien Bellet , Marc Tommasi

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

We introduce Mosaic, a probabilistic weather forecasting model that addresses three failure modes of spectral degradation in ML-based weather prediction: spectral damping (statistical), high-frequency aliasing (architectural), and residual…

Machine Learning · Computer Science 2026-05-19 Maksim Zhdanov , Ana Lucic , Max Welling , Jan-Willem van de Meent

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Deep Metric Learning (DML) methods have been proven relevant for visual similarity learning. However, they sometimes lack generalization properties because they are trained often using an inappropriate sample selection strategy or due to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jorge Gonzalez-Zapata , Ivan Reyes-Amezcua , Daniel Flores-Araiza , Mauricio Mendez-Ruiz , Gilberto Ochoa-Ruiz , Andres Mendez-Vazquez

Federated learning (FL) enables collaborative training without pooling raw data, but standard FL relies on a central coordinator, which introduces a single point of failure and concentrates trust in the orchestration infrastructure.…

Machine Learning · Computer Science 2026-03-11 Edoardo Gabrielli , Anthony Di Pietro , Dario Fenoglio , Giovanni Pica , Gabriele Tolomei

Federated Learning is an algorithm suited for training models on decentralized data, but the requirement of a central "server" node is a bottleneck. In this document, we first introduce the notion of Decentralized Federated Learning (DFL).…

Machine Learning · Computer Science 2021-08-10 Zhuofan Zhang , Mi Zhou , Kaicheng Niu , Chaouki Abdallah

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

Information Theory · Computer Science 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

Diffusion-based large language models (dLLMs) have emerged as a promising paradigm, utilizing simultaneous denoising to enable global planning and iterative refinement. While these capabilities are particularly advantageous for long-context…

Machine Learning · Computer Science 2026-01-13 Liang Zheng , Bowen Shi , Yitao Hu , Jiawei Zhang , Ruofan Li , Sheng Chen , Wenxin Li , Keqiu Li

Federated learning is a distributed machine learning paradigm that allows multiple participants to train a shared model by exchanging model updates instead of their raw data. However, its performance is degraded compared to centralized…

Machine Learning · Computer Science 2025-08-07 Hyungbin Kim , Incheol Baek , Yon Dohn Chung

Advanced researches on connected vehicles have recently targeted to the integration of vehicle-to-everything (V2X) networks with Machine Learning (ML) tools and distributed decision making. Federated learning (FL) is emerging as a new…

Machine Learning · Computer Science 2022-09-23 Xiaoyan Liu , Zehui Dong , Zhiwei Xu , Siyuan Liu , Jie Tian

Decomposing knowledge into interchangeable pieces promises a generalization advantage when there are changes in distribution. A learning agent interacting with its environment is likely to be faced with situations requiring novel…

Machine Learning · Computer Science 2021-05-20 Kanika Madan , Nan Rosemary Ke , Anirudh Goyal , Bernhard Schölkopf , Yoshua Bengio

Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

Federated learning is a distributed machine learning paradigm through centralized model aggregation. However, standard federated learning relies on a centralized server, making it vulnerable to server failures. While existing solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-03 Hongliang Zhang , Fenghua Xu , Zhongyuan Yu , Shanchen Pang , Chunqiang Hu , Jiguo Yu