English
Related papers

Related papers: Efficient Federated Learning Tiny Language Models …

200 papers

In order to achieve the dual goals of privacy and learning across distributed data, Federated Learning (FL) systems rely on frequent exchanges of large files (model updates) between a set of clients and the server. As such FL systems are…

Machine Learning · Computer Science 2023-01-12 Parikshit Hegde , Gustavo de Veciana , Aryan Mokhtari

Federated learning can train models without directly providing local data to the server. However, the frequent updating of the local model brings the problem of large communication overhead. Recently, scholars have achieved the…

Machine Learning · Computer Science 2024-05-07 Ying Zhuansun , Dandan Li , Xiaohong Huang , Caijun Sun

A fundamental issue for federated learning (FL) is how to achieve optimal model performance under highly dynamic communication environments. This issue can be alleviated by the fact that modern edge devices usually can connect to the edge…

Machine Learning · Computer Science 2021-09-21 Haizhou Du , Xiaojie Feng , Qiao Xiang , Haoyu Liu

Federated learning (FL) enables a neural network (NN) to be trained using privacy-sensitive data on mobile devices while retaining all the data on their local storages. However, FL asks the mobile devices to perform heavy communication and…

Networking and Internet Architecture · Computer Science 2022-02-11 Sohei Itahara , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto

Federated Learning (FL) solves many of this decade's concerns regarding data privacy and computation challenges. FL ensures no data leaves its source as the model is trained at where the data resides. However, FL comes with its own set of…

Machine Learning · Computer Science 2021-08-13 Srikanth Chandar , Pravin Chandran , Raghavendra Bhat , Avinash Chakravarthi

Mobile devices are indispensable sources of big data. Federated learning (FL) has a great potential in exploiting these private data by exchanging locally trained models instead of their raw data. However, mobile devices are often energy…

Machine Learning · Computer Science 2021-12-08 Hankyul Baek , Won Joon Yun , Soyi Jung , Jihong Park , Mingyue Ji , Joongheon Kim , Mehdi Bennis

Federated Learning (FL) is a promising distributed learning mechanism which still faces two major challenges, namely privacy breaches and system efficiency. In this work, we reconceptualize the FL system from the perspective of network…

Machine Learning · Computer Science 2024-01-10 Yuchen Shi , Zheqi Zhu , Pingyi Fan , Khaled B. Letaief , Chenghui Peng

Hybrid Language Models (HLMs) combine the low-latency efficiency of Small Language Models (SLMs) on edge devices with the high accuracy of Large Language Models (LLMs) on centralized servers. Unlike traditional end-to-end LLM inference,…

Machine Learning · Computer Science 2025-07-02 Faranaksadat Solat , Joohyung Lee , Mohamed Seif , Dusit Niyato , H. Vincent Poor

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Federated Learning (FL) is a recent model training paradigm in which client devices collaboratively train a model without ever aggregating their data. Crucially, this scheme offers users potential privacy and security benefits by only ever…

Machine Learning · Computer Science 2024-11-11 Raja Vavekanand , Kira Sam

Recent advances in machine learning, wireless communication, and mobile hardware technologies promisingly enable federated learning (FL) over massive mobile edge devices, which opens new horizons for numerous intelligent mobile…

Machine Learning · Computer Science 2020-12-23 Liang Li , Dian Shi , Ronghui Hou , Hui Li , Miao Pan , Zhu Han

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

Machine Learning · Computer Science 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

Federated learning (FL), as an emerging collaborative learning paradigm, has garnered significant attention due to its capacity to preserve privacy within distributed learning systems. In these systems, clients collaboratively train a…

Machine Learning · Computer Science 2024-05-29 Xi Zhu , Songcan Yu , Junbo Wang , Qinglin Yang

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant…

Machine Learning · Computer Science 2023-03-29 Chaoqun You , Kun Guo , Gang Feng , Peng Yang , Tony Q. S. Quek

Federated learning (FL) ameliorates privacy concerns in settings where a central server coordinates learning from data distributed across many clients. The clients train locally and communicate the models they learn to the server;…

Machine Learning · Computer Science 2020-10-16 Monica Ribero , Haris Vikalo

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Federated learning (FL) enables a loose set of participating clients to collaboratively learn a global model via coordination by a central server and with no need for data sharing. Existing FL approaches that rely on complex algorithms with…

Machine Learning · Computer Science 2023-12-27 Kazim Ergun , Rishikanth Chandrasekaran , Tajana Rosing
‹ Prev 1 2 3 10 Next ›