中文
相关论文

相关论文: Empowering Federated Learning for Massive Models w…

200 篇论文

Federated Learning (FL) has emerged as a powerful paradigm for decentralized machine learning, enabling collaborative model training across diverse clients without sharing raw data. However, traditional FL approaches often face limitations…

机器学习 · 计算机科学 2025-10-22 Ali Forootani , Raffaele Iervolino

Federated learning (FL) is a distributed machine learning paradigm enabling collaborative model training while preserving data privacy. In today's landscape, where most data is proprietary, confidential, and distributed, FL has become a…

机器学习 · 计算机科学 2025-03-11 Zilinghan Li , Shilan He , Ze Yang , Minseok Ryu , Kibaek Kim , Ravi Madduri

In this paper, we introduce a method for fine-tuning Large Language Models (LLMs), inspired by Multi-Task learning in a federated manner. Our approach leverages the structure of each client's model and enables a learning scheme that…

机器学习 · 计算机科学 2024-10-22 Ahmed Elbakary , Chaouki Ben Issaid , Tamer ElBatt , Karim Seddik , Mehdi Bennis

Intelligent, large-scale IoT ecosystems have become possible due to recent advancements in sensing technologies, distributed learning, and low-power inference in embedded devices. In traditional cloud-centric approaches, raw data is…

机器学习 · 计算机科学 2023-05-16 Theo Chow , Usman Raza , Ioannis Mavromatis , Aftab Khan

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

机器学习 · 计算机科学 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Previous studies on federated learning (FL) often encounter performance degradation due to data heterogeneity among different clients. In light of the recent advances in multimodal large language models (MLLMs), such as GPT-4v and LLaVA,…

人工智能 · 计算机科学 2024-12-03 Jianyi Zhang , Hao Frank Yang , Ang Li , Xin Guo , Pu Wang , Haiming Wang , Yiran Chen , Hai Li

This paper provides a comprehensive study of Federated Learning (FL) with an emphasis on components, challenges, applications and FL environment. FL can be applicable in multiple fields and domains in real-life models. in the medical…

计算机视觉与模式识别 · 计算机科学 2022-01-25 Dhurgham Hassan Mahlool , Mohammed Hamzah Abed

Artificial Intelligence for scientific applications increasingly requires training large models on data that cannot be centralized due to privacy constraints, data sovereignty, or the sheer volume of data generated. Federated learning (FL)…

机器学习 · 计算机科学 2026-03-23 Yijiang Li , Zilinghan Li , Kyle Chard , Ian Foster , Todd Munson , Ravi Madduri , Kibaek Kim

Federated Learning (FL) is emerging as a promising technology to build machine learning models in a decentralized, privacy-preserving fashion. Indeed, FL enables local training on user devices, avoiding user data to be transferred to…

机器学习 · 计算机科学 2020-11-19 Nicolas Kourtellis , Kleomenis Katevas , Diego Perino

Federated Learning (FL) has emerged as a promising distributed learning paradigm with an added advantage of data privacy. With the growing interest in having collaboration among data owners, FL has gained significant attention of…

机器学习 · 计算机科学 2023-04-11 Afsana Khan , Marijn ten Thij , Anna Wilbik

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

机器学习 · 计算机科学 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Artificial Intelligence (AI) is expected to play an instrumental role in the next generation of wireless systems, such as sixth-generation (6G) mobile network. However, massive data, energy consumption, training complexity, and sensitive…

机器学习 · 计算机科学 2023-12-11 Maryam Ben Driss , Essaid Sabir , Halima Elbiaze , Walid Saad

In the growing world of artificial intelligence, federated learning is a distributed learning framework enhanced to preserve the privacy of individuals' data. Federated learning lays the groundwork for collaborative research in areas where…

机器学习 · 计算机科学 2023-11-21 Elaheh Jafarigol , Theodore Trafalis , Talayeh Razzaghi , Mona Zamankhani

Federated machine learning is a versatile and flexible tool to utilize distributed data from different sources, especially when communication technology develops rapidly and an unprecedented amount of data could be collected on mobile…

机器学习 · 计算机科学 2024-03-12 Tianyi Zhang , Shirui Zhang , Ziwei Chen , Dianbo Liu

Federated learning has shown enormous promise as a way of training ML models in distributed environments while reducing communication costs and protecting data privacy. However, the rise of complex cyber-physical systems, such as the…

机器学习 · 计算机科学 2023-05-01 Omer Rana , Theodoros Spyridopoulos , Nathaniel Hudson , Matt Baughman , Kyle Chard , Ian Foster , Aftab Khan

Federated Learning (FL) is a decentralized machine learning (ML) technique that allows a number of participants to train an ML model collaboratively without having to share their private local datasets with others. When participants are…

机器学习 · 计算机科学 2023-12-19 Youssra Cheriguene , Wael Jaafar , Halim Yanikomeroglu , Chaker Abdelaziz Kerrache

Recent developments in Artificial Intelligence techniques have enabled their successful application across a spectrum of commercial and industrial settings. However, these techniques require large volumes of data to be aggregated in a…

密码学与安全 · 计算机科学 2023-04-04 Dengsheng Chen , Vince Tan , Zhilin Lu , Jie Hu

Recently, the development of mobile edge computing has enabled exhilarating edge artificial intelligence (AI) with fast response and low communication cost. The location information of edge devices is essential to support the edge AI in…

信号处理 · 电气工程与系统科学 2022-08-25 Xin Cheng , Tingting Liu , Feng Shu , Chuan Ma , Jun Li , Jiangzhou Wang

In the emerging paradigm of Federated Learning (FL), large amount of clients such as mobile devices are used to train possibly high-dimensional models on their respective data. Combining (dimension-wise) adaptive gradient methods (e.g.…

机器学习 · 计算机科学 2022-06-24 Belhal Karimi , Ping Li , Xiaoyun Li

Federated learning (FL) is a distributed model for deep learning that integrates client-server architecture, edge computing, and real-time intelligence. FL has the capability of revolutionizing machine learning (ML) but lacks in the…