English
Related papers

Related papers: SPEAR++: Scaling Gradient Inversion via Sparsely-U…

200 papers

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

Machine Learning · Computer Science 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Federated learning (FL) emerged as a promising learning paradigm to enable a multitude of participants to construct a joint ML model without exposing their private training data. Existing FL designs have been shown to exhibit…

Cryptography and Security · Computer Science 2021-08-17 Lingjuan Lyu , Chen Chen

Federated learning (FL) is an emerging distributed machine learning framework for collaborative model training with a network of clients (edge devices). FL offers default client privacy by allowing clients to keep their sensitive data on…

Machine Learning · Computer Science 2020-04-24 Wenqi Wei , Ling Liu , Margaret Loper , Ka-Ho Chow , Mehmet Emre Gursoy , Stacey Truex , Yanzhao Wu

Instruction-following is a fundamental capability of language models, requiring the model to recognize even the most subtle requirements in the instructions and accurately reflect them in its output. Such an ability is well-suited for and…

Computation and Language · Computer Science 2025-03-18 Jiale Cheng , Xiao Liu , Cunxiang Wang , Xiaotao Gu , Yida Lu , Dan Zhang , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

As a new distributed computing framework that can protect data privacy, federated learning (FL) has attracted more and more attention in recent years. It receives gradients from users to train the global model and releases the trained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Can Liu , Jin Wang

Recent studies have shown that distributed machine learning is vulnerable to gradient inversion attacks, where private training data can be reconstructed by analyzing the gradients of the models shared in training. Previous attacks…

Machine Learning · Computer Science 2024-10-07 Weijun Li , Qiongkai Xu , Mark Dras

Split Learning (SL) is a collaborative learning approach that improves privacy by keeping data on the client-side while sharing only the intermediate output with a server. However, the distributed nature of SL introduces new security…

Machine Learning · Computer Science 2025-08-15 Tanveer Khan , Antonis Michalas

Federated learning allows distributed users to collaboratively train a model while keeping each user's data private. Recently, a growing body of work has demonstrated that an eavesdropping attacker can effectively recover image data from…

Computation and Language · Computer Science 2022-10-19 Samyak Gupta , Yangsibo Huang , Zexuan Zhong , Tianyu Gao , Kai Li , Danqi Chen

The traditional framework of federated learning (FL) requires each client to re-train their models in every iteration, making it infeasible for resource-constrained mobile devices to train deep-learning (DL) models. Split learning (SL)…

Machine Learning · Computer Science 2023-03-21 Manas Wadhwa , Gagan Raj Gupta , Ashutosh Sahu , Rahul Saini , Vidhi Mittal

Federated learning synchronizes models through gradient transmission and aggregation. However, these gradients pose significant privacy risks, as sensitive training data is embedded within them. Existing gradient inversion attacks suffer…

Cryptography and Security · Computer Science 2025-11-18 Jiayang Meng , Tao Huang , Hong Chen , Chen Hou , Guolong Zheng

Federated Learning with Model Distillation (FedMD) is a nascent collaborative learning paradigm, where only output logits of public datasets are transmitted as distilled knowledge, instead of passing on private model parameters that are…

Cryptography and Security · Computer Science 2023-07-04 Hideaki Takahashi , Jingjing Liu , Yang Liu

With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost…

Machine Learning · Computer Science 2024-06-11 Weixi Song , Zuchao Li , Lefei Zhang , Hai Zhao , Bo Du

In recent years, there have been great advances in the field of decentralized learning with private data. Federated learning (FL) and split learning (SL) are two spearheads possessing their pros and cons, and are suited for many user…

Machine Learning · Computer Science 2021-12-14 Shraman Pal , Mansi Uniyal , Jihong Park , Praneeth Vepakomma , Ramesh Raskar , Mehdi Bennis , Moongu Jeon , Jinho Choi

Distributed machine learning has been widely used in recent years to tackle the large and complex dataset problem. Therewith, the security of distributed learning has also drawn increasing attentions from both academia and industry. In this…

Machine Learning · Computer Science 2022-06-13 Zihao Zhao , Mengen Luo , Wenbo Ding

Federated Prompt Learning has emerged as a communication-efficient and privacy-preserving paradigm for adapting large vision-language models like CLIP across decentralized clients. However, the security implications of this setup remain…

Cryptography and Security · Computer Science 2026-01-28 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Federated Learning (FL) emerged as a paradigm for conducting machine learning across broad and decentralized datasets, promising enhanced privacy by obviating the need for direct data sharing. However, recent studies show that attackers can…

Computation and Language · Computer Science 2024-11-28 Xueluan Gong , Yuji Wang , Shuaike Li , Mengyuan Sun , Songze Li , Qian Wang , Kwok-Yan Lam , Chen Chen

Federated learning enables the training of machine learning models on distributed data without compromising user privacy, as data remains on personal devices and only model updates, such as gradients, are shared with a central coordinator.…

Machine Learning · Computer Science 2024-09-30 Micha V. Nowak , Tim P. Bott , David Khachaturov , Frank Puppe , Adrian Krenzer , Amar Hekalo

The past decade has seen a rapid adoption of Artificial Intelligence (AI), specifically the deep learning networks, in Internet of Medical Things (IoMT) ecosystem. However, it has been shown recently that the deep learning networks can be…

Cryptography and Security · Computer Science 2022-08-10 Sunder Ali Khowaja , Ik Hyun Lee , Kapal Dev , Muhammad Aslam Jarwar , Nawab Muhammad Faseeh Qureshi

Real-world data is usually segmented by attributes and distributed across different parties. Federated learning empowers collaborative training without exposing local data or models. As we demonstrate through designed attacks, even with a…

Machine Learning · Computer Science 2021-04-30 Shuang Zhang , Liyao Xiang , Xi Yu , Pengzhi Chu , Yingqi Chen , Chen Cen , Li Wang

Federated Learning (FL) has become very popular since it enables clients to train a joint model collaboratively without sharing their private data. However, FL has been shown to be susceptible to backdoor and inference attacks. While in the…

Cryptography and Security · Computer Science 2023-08-02 Huimin Li , Phillip Rieger , Shaza Zeitouni , Stjepan Picek , Ahmad-Reza Sadeghi