English
Related papers

Related papers: Position: Federated Foundation Language Model Post…

200 papers

Federated learning (FL) has emerged as a promising paradigm for enabling the collaborative training of models without centralized access to the raw data on local devices. In the typical FL paradigm (e.g., FedAvg), model weights are sent to…

Machine Learning · Computer Science 2024-12-25 Guangyu Sun , Umar Khalid , Matias Mendieta , Pu Wang , Chen Chen

Data privacy has become an increasingly important concern in real-world big data applications such as machine learning. To address the problem, federated learning (FL) has been a promising solution to building effective machine learning…

Machine Learning · Computer Science 2023-03-28 Yilun Jin , Yang Liu , Kai Chen , Qiang Yang

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Federated learning (FL) allows a set of agents to collaboratively train a model without sharing their potentially sensitive data. This makes FL suitable for privacy-preserving applications. At the same time, FL is susceptible to adversarial…

Machine Learning · Computer Science 2021-08-02 Mustafa Safa Ozdayi , Murat Kantarcioglu , Yulia R. Gel

Over the last years, topic modeling has emerged as a powerful technique for organizing and summarizing big collections of documents or searching for particular patterns in them. However, privacy concerns may arise when cross-analyzing data…

Machine Learning · Computer Science 2023-06-13 Lorena Calvo-Bartolomé , Jerónimo Arenas-García

Federated Learning Networks (FLNs) have been envisaged as a promising paradigm to collaboratively train models among mobile devices without exposing their local privacy data. Due to the need for frequent model updates and communications,…

Cryptography and Security · Computer Science 2021-10-07 Yuan-Ai Xie , Jiawen Kang , Dusit Niyato , Nguyen Thi Thanh Van , Nguyen Cong Luong , Zhixin Liu , Han Yu

The recent success of large language models (LLMs) has sparked a growing interest in training large-scale models. As the model size continues to scale, concerns are growing about the depletion of high-quality, well-curated training data.…

Machine Learning · Computer Science 2025-11-18 Xuanyu Chen , Nan Yang , Shuai Wang , Dong Yuan

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, particularly in task generalization for both text and vision data. While fine-tuning these models can significantly enhance their performance on…

Machine Learning · Computer Science 2025-01-15 Navyansh Mahla , Kshitij Sharad Jadhav , Ganesh Ramakrishnan

Federated Learning (FL) is a popular distributed machine learning paradigm that enables jointly training a global model without sharing clients' data. However, its repetitive server-client communication gives room for backdoor attacks with…

Machine Learning · Computer Science 2023-01-20 Pei Fang , Jinghui Chen

Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern.…

Federated Learning (FL) has attracted considerable interest due to growing privacy concerns and regulations like the General Data Protection Regulation (GDPR), which stresses the importance of privacy-preserving and fair machine learning…

Machine Learning · Computer Science 2025-04-17 Sarang S , Harsh D. Chothani , Qilei Li , Ahmed M. Abdelmoniem , Arnab K. Paul

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

In recent years, data and computing resources are typically distributed in the devices of end users, various regions or organizations. Because of laws or regulations, the distributed data and computing resources cannot be directly shared…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-28 Ji Liu , Jizhou Huang , Yang Zhou , Xuhong Li , Shilei Ji , Haoyi Xiong , Dejing Dou

Federated Learning (FL) offers a framework for training models collaboratively while preserving data privacy of each client. Recently, research has focused on Federated Source-Free Domain Adaptation (FFREEDA), a more realistic scenario…

Machine Learning · Computer Science 2026-03-16 Kosuke Kihara , Junki Mori , Taiki Miyagawa , Akinori F. Ebihara

Data privacy has become a major concern in healthcare due to the increasing digitization of medical records and data-driven medical research. Protecting sensitive patient information from breaches and unauthorized access is critical, as…

The foundation models (FMs) have been used to generate synthetic public datasets for the heterogeneous federated learning (HFL) problem where each client uses a unique model architecture. However, the vulnerabilities of integrating FMs,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-01 Xi Li , Chen Wu , Jiaqi Wang

Recent developments in Artificial Intelligence techniques have enabled their successful application across a spectrum of commercial and industrial settings. However, these techniques require large volumes of data to be aggregated in a…

Cryptography and Security · Computer Science 2023-04-04 Dengsheng Chen , Vince Tan , Zhilin Lu , Jie Hu

Foundation models (FMs) are general-purpose artificial intelligence (AI) models that have recently enabled multiple brand-new generative AI applications. The rapid advances in FMs serve as an important contextual backdrop for the vision of…

Networking and Internet Architecture · Computer Science 2024-05-08 Zihan Chen , Howard H. Yang , Y. C. Tay , Kai Fong Ernest Chong , Tony Q. S. Quek

We survey applications of pretrained foundation models in robotics. Traditional deep learning models in robotics are trained on small datasets tailored for specific tasks, which limits their adaptability across diverse applications. In…