English
Related papers

Related papers: Efficient Federated Learning Tiny Language Models …

200 papers

Federated Learning (FL) offers a promising paradigm for training Large Language Models (LLMs) in a decentralized manner while preserving data privacy and minimizing communication overhead. This survey examines recent advancements in…

Machine Learning · Computer Science 2025-05-12 Youyang Qu , Ming Liu , Tianqing Zhu , Longxiang Gao , Shui Yu , Wanlei Zhou

Federated Learning (FL) is an increasingly popular machine learning paradigm in which multiple nodes try to collaboratively learn under privacy, communication and multiple heterogeneity constraints. A persistent problem in federated…

Machine Learning · Computer Science 2022-02-24 Elnur Gasanov , Ahmed Khaled , Samuel Horváth , Peter Richtárik

Federated Learning (FL) enables collaborative training across decentralized data, but faces key challenges of bidirectional communication overhead and client-side data heterogeneity. To address communication costs while embracing data…

Machine Learning · Computer Science 2026-02-03 Jiacheng Cheng , Xu Zhang , Guanghui Qiu , Yifang Zhang , Yinchuan Li , Kaiyuan Feng

Semantic communication can significantly improve bandwidth utilization in wireless systems by exploiting the meaning behind raw data. However, the advancements achieved through semantic communication are closely dependent on the development…

Information Theory · Computer Science 2026-02-25 Loc X. Nguyen , Ji Su Yoon , Huy Q. Le , Yu Qiao , Avi Deb Raha , Eui-Nam Huh , Walid Saad , Dusit Niyato , Zhu Han , Choong Seon Hong

Federated learning (FL) is an emerging machine learning paradigm involving multiple clients, e.g., mobile phone devices, with an incentive to collaborate in solving a machine learning problem coordinated by a central server. FL was proposed…

Machine Learning · Computer Science 2022-07-04 Samuel Horváth

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

Federated Learning (FL) enables decentralized machine learning while preserving data privacy. This paper proposes a novel client selection framework that integrates differential privacy and fault tolerance. The adaptive client selection…

Machine Learning · Computer Science 2025-02-04 William Marfo , Deepak K. Tosh , Shirley V. Moore

Federated learning (FL) leverages client-server communications to train global models on decentralized data. However, communication noise or errors can impair model accuracy. To address this problem, we propose a novel FL algorithm that…

Machine Learning · Computer Science 2025-12-15 Ehsan Lari , Reza Arablouei , Vinay Chakravarthi Gogineni , Stefan Werner

Federated learning (FL) enables resource-constrained edge nodes to collaboratively learn a global model under the orchestration of a central server while keeping privacy-sensitive data locally. The…

Machine Learning · Computer Science 2021-04-07 Hongda Wu , Ping Wang

One of the most critical challenges for deploying distributed learning solutions, such as federated learning (FL), in wireless networks is the limited battery capacity of mobile clients. While it is a common belief that the major energy…

Information Theory · Computer Science 2024-10-23 Linping Qu , Yuyi Mao , Shenghui Song , Chi-Ying Tsui

Semantic communication has emerged as a pillar for the next generation of communication systems due to its capabilities in alleviating data redundancy. Most semantic communication systems are built upon advanced deep learning models whose…

Machine Learning · Computer Science 2025-02-07 Loc X. Nguyen , Huy Q. Le , Ye Lin Tun , Pyae Sone Aung , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

Motivated by the increasing computational capacity of wireless user equipments (UEs), e.g., smart phones, tablets, or vehicles, as well as the increasing concerns about sharing private data, a new machine learning model has emerged, namely…

Information Theory · Computer Science 2019-10-10 Howard H. Yang , Zuozhu Liu , Tony Q. S. Quek , H. Vincent Poor

New technological advancements in wireless networks have enlarged the number of connected devices. The unprecedented surge of data volume in wireless systems empowered by artificial intelligence (AI) opens up new horizons for providing…

Networking and Internet Architecture · Computer Science 2023-03-01 Mohammad Al-Quraan , Lina Mohjazi , Lina Bariah , Anthony Centeno , Ahmed Zoha , Sami Muhaidat , Mérouane Debbah , Muhammad Ali Imran

Current data compression methods, such as sparsification in Federated Averaging (FedAvg), effectively enhance the communication efficiency of Federated Learning (FL). However, these methods encounter challenges such as the straggler problem…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-28 Zichen Tang , Junlin Huang , Rudan Yan , Yuxin Wang , Zhenheng Tang , Shaohuai Shi , Amelie Chi Zhou , Xiaowen Chu

In this paper, we propose a neural-based coding scheme in which an artificial neural network is exploited to automatically compress and decompress speech signals by a trainable approach. Having a two-stage training phase, the system can be…

Sound · Computer Science 2016-01-25 Mahmood Yousefi-Azar , Farbod Razzazi

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

Federated Learning (FL) enables model training across decentralized devices by communicating solely local model updates to an aggregation server. Although such limited data sharing makes FL more secure than centralized approached, FL…

Cryptography and Security · Computer Science 2024-06-14 Vasileios Tsouvalas , Samaneh Mohammadi , Ali Balador , Tanir Ozcelebi , Francesco Flammini , Nirvana Meratnia

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

We present a scalable and efficient neural waveform coding system for speech compression. We formulate the speech coding problem as an autoencoding task, where a convolutional neural network (CNN) performs encoding and decoding as a neural…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Kai Zhen , Jongmo Sung , Mi Suk Lee , Seungkwon Beak , Minje Kim