中文
相关论文

相关论文: TAG: Gradient Attack on Transformer-based Language…

200 篇论文

Transformers, a cornerstone of deep-learning architectures for sequential data, have achieved state-of-the-art results in tasks like Natural Language Processing (NLP). Models such as BERT and GPT-3 exemplify their success and have driven…

机器学习 · 计算机科学 2025-01-22 Ali Abbasi Tadi , Dima Alhadidi , Luis Rueda

Adversarial attacks against deep learning models represent a major threat to the security and reliability of natural language processing (NLP) systems. In this paper, we propose a modification to the BERT-Attack framework, integrating…

机器学习 · 计算机科学 2024-08-01 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

Gradient inversion attacks are often presented as a serious privacy threat in federated learning, with recent work reporting increasingly strong reconstructions under favorable experimental settings. However, it remains unclear whether such…

密码学与安全 · 计算机科学 2026-02-10 Viktor Valadi , Mattias Åkesson , Johan Östman , Fazeleh Hoseini , Salman Toor , Andreas Hellander

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

密码学与安全 · 计算机科学 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

Federated learning, i.e., a mobile edge computing framework for deep learning, is a recent advance in privacy-preserving machine learning, where the model is trained in a decentralized manner by the clients, i.e., data curators, preventing…

机器学习 · 计算机科学 2018-12-06 Zhibo Wang , Mengkai Song , Zhifei Zhang , Yang Song , Qian Wang , Hairong Qi

Model inversion (MI) attacks have raised increasing concerns about privacy, which can reconstruct training data from public models. Indeed, MI attacks can be formalized as an optimization problem that seeks private data in a certain space.…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Xiaojian Yuan , Kejiang Chen , Jie Zhang , Weiming Zhang , Nenghai Yu , Yang Zhang

Federated Learning (FL) has emerged as a promising approach for collaborative model training without sharing private data. However, privacy concerns regarding information exchanged during FL have received significant research attention.…

机器学习 · 计算机科学 2023-06-14 Bowen Li , Hanlin Gu , Ruoxin Chen , Jie Li , Chentao Wu , Na Ruan , Xueming Si , Lixin Fan

In Federated Learning (FL) and many other distributed training frameworks, collaborators can hold their private data locally and only share the network weights trained with the local data after multiple iterations. Gradient inversion is a…

机器学习 · 计算机科学 2023-06-02 Junyi Zhu , Ruicong Yao , Matthew B. Blaschko

Transfer learning has become a common solution to address training data scarcity in practice. It trains a specified student model by reusing or fine-tuning early layers of a well-trained teacher model that is usually publicly available.…

密码学与安全 · 计算机科学 2022-06-24 Yufei Chen , Chao Shen , Cong Wang , Yang Zhang

Split learning is a promising paradigm for privacy-preserving distributed learning. The learning model can be cut into multiple portions to be collaboratively trained at the participants by exchanging only the intermediate results at the…

机器学习 · 计算机科学 2024-03-25 Junlin Liu , Xinchen Lyu , Qimei Cui , Xiaofeng Tao

Deep Gradient Leakage (DGL) is a highly effective attack that recovers private training images from gradient vectors. This attack casts significant privacy challenges on distributed learning from clients with sensitive data, where clients…

机器学习 · 计算机科学 2024-01-10 Haobo Zhang , Junyuan Hong , Yuyang Deng , Mehrdad Mahdavi , Jiayu Zhou

Parameter-transfer is a well-known and versatile approach for meta-learning, with applications including few-shot learning, federated learning, and reinforcement learning. However, parameter-transfer algorithms often require sharing models…

机器学习 · 计算机科学 2020-02-24 Jeffrey Li , Mikhail Khodak , Sebastian Caldas , Ameet Talwalkar

This paper investigates the privacy-preserving distributed optimization problem, aiming to protect agents' private information from potential attackers during the optimization process. Gradient tracking, an advanced technique for improving…

机器学习 · 计算机科学 2025-09-24 Furan Xie , Bing Liu , Li Chai

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

机器学习 · 计算机科学 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

密码学与安全 · 计算机科学 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Federated Learning (FL) has emerged as a potentially powerful privacy-preserving machine learning methodology, since it avoids exchanging data between participants, but instead exchanges model parameters. FL has traditionally been applied…

密码学与安全 · 计算机科学 2022-10-17 Han Wu , Zilong Zhao , Lydia Y. Chen , Aad van Moorsel

Federated learning (FL) has emerged as a privacy-preserving machine learning approach where multiple parties share gradient information rather than original user data. Recent work has demonstrated that gradient inversion attacks can exploit…

机器学习 · 计算机科学 2024-05-07 Jin Qian , Kaimin Wei , Yongdong Wu , Jilian Zhang , Jipeng Chen , Huan Bao

Federated learning (FL) is an emerging distributed machine learning paradigm proposed for privacy preservation. Unlike traditional centralized learning approaches, FL enables multiple users to collaboratively train a shared global model…

密码学与安全 · 计算机科学 2024-10-01 Hangyu Zhu , Liyuan Huang , Zhenping Xie

Federated Learning (FL) has emerged as a leading paradigm for decentralized, privacy preserving machine learning training. However, recent research on gradient inversion attacks (GIAs) have shown that gradient updates in FL can leak…

密码学与安全 · 计算机科学 2024-05-20 Yichuan Shi , Olivera Kotevska , Viktor Reshniak , Abhishek Singh , Ramesh Raskar

Diffusion models are becoming defector generative models, which generate exceptionally high-resolution image data. Training effective diffusion models require massive real data, which is privately owned by distributed parties. Each data…

人工智能 · 计算机科学 2024-06-03 Jiyue Huang , Chi Hong , Lydia Y. Chen , Stefanie Roos