English
Related papers

Related papers: Gradient Inversion Transcript: Leveraging Robust G…

200 papers

Federated learning is considered as an effective privacy-preserving learning mechanism that separates the client's data and model training process. However, federated learning is still under the risk of privacy leakage because of the…

Machine Learning · Computer Science 2022-06-03 Yuxuan Wan , Han Xu , Xiaorui Liu , Jie Ren , Wenqi Fan , Jiliang Tang

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the…

Cryptography and Security · Computer Science 2021-12-02 Yangsibo Huang , Samyak Gupta , Zhao Song , Kai Li , Sanjeev Arora

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Learner performance data collected by Intelligent Tutoring Systems (ITSs), such as responses to questions, is essential for modeling and predicting learners' knowledge states. However, missing responses due to skips or incomplete attempts…

Researchers train neural simulators on uniformly sampled numerical simulation data. But under the same budget, does systematically sampled data provide the most effective information? A fundamental yet unformalized problem is how to sample…

Machine Learning · Computer Science 2026-03-20 Wenshuo Wang , Fan Zhang

This study explores the limitations of traditional Cybersecurity Awareness and Training (CSAT) programs and proposes an innovative solution using Generative Pre-Trained Transformers (GPT) to address these shortcomings. Traditional…

Cryptography and Security · Computer Science 2024-05-08 Nabil Al-Dhamari , Nathan Clarke

Although federated learning has increasingly gained attention in terms of effectively utilizing local devices for data privacy enhancement, recent studies show that publicly shared gradients in the training process can reveal the private…

Cryptography and Security · Computer Science 2021-09-22 Jieren Deng , Yijue Wang , Ji Li , Chao Shang , Hang Liu , Sanguthevar Rajasekaran , Caiwen Ding

Gradient inversion attacks threaten client privacy in federated learning by reconstructing training samples from clients' shared gradients. Gradients aggregate contributions from multiple records and existing attacks may fail to disentangle…

Machine Learning · Computer Science 2026-04-17 Francesco Diana , Chuan Xu , André Nusser , Giovanni Neglia

Federated learning is a private-by-design distributed learning paradigm where clients train local models on their own data before a central server aggregates their local updates to compute a global model. Depending on the aggregation method…

Machine Learning · Computer Science 2022-07-15 Jin Xu , Chi Hong , Jiyue Huang , Lydia Y. Chen , Jérémie Decouchant

The gradient inversion attack has been demonstrated as a significant privacy threat to federated learning (FL), particularly in continuous domains such as vision models. In contrast, it is often considered less effective or highly dependent…

Machine Learning · Computer Science 2025-07-30 Xinguo Feng , Zhongkui Ma , Zihan Wang , Eu Joe Chegne , Mengyao Ma , Alsharif Abuadbba , Guangdong Bai

All text-based language problems can be reduced to either generation or embedding. Current models only perform well at one or the other. We introduce generative representational instruction tuning (GRIT) whereby a large language model is…

Computation and Language · Computer Science 2025-03-04 Niklas Muennighoff , Hongjin Su , Liang Wang , Nan Yang , Furu Wei , Tao Yu , Amanpreet Singh , Douwe Kiela

Pretrained large language models (LLMs) are able to solve a wide variety of tasks through transfer learning. Various explainability methods have been developed to investigate their decision making process. TracIn (Pruthi et al., 2020) is…

Computation and Language · Computer Science 2023-02-14 Maximilian Mozes , Tolga Bolukbasi , Ann Yuan , Frederick Liu , Nithum Thain , Lucas Dixon

Federated Learning (FL) has recently emerged as a promising distributed machine learning framework to preserve clients' privacy, by allowing multiple clients to upload the gradients calculated from their local data to a central server.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hao Fang , Bin Chen , Xuan Wang , Zhi Wang , Shu-Tao Xia

This paper presents a holistic approach to gradient leakage resilient distributed Stochastic Gradient Descent (SGD). First, we analyze two types of strategies for privacy-enhanced federated learning: (i) gradient pruning with random…

Machine Learning · Computer Science 2023-05-12 Wenqi Wei , Ling Liu , Jingya Zhou , Ka-Ho Chow , Yanzhao Wu

Collaborative training of neural networks leverages distributed data by exchanging gradient information between different clients. Although training data entirely resides with the clients, recent work shows that training data can be…

Machine Learning · Computer Science 2021-10-22 Daniel Scheliga , Patrick Mäder , Marco Seeland

We introduce Perturbative Gradient Training (PGT), a novel training paradigm that overcomes a critical limitation of physical reservoir computing: the inability to perform backpropagation due to the black-box nature of physical reservoirs.…

Machine Learning · Computer Science 2025-06-06 Cliff B. Abbott , Mark Elo , Dmytro A. Bozhko

Federated Learning (FL) enables collaborative training of Machine Learning (ML) models across multiple clients while preserving their privacy. Rather than sharing raw data, federated clients transmit locally computed updates to train the…

Cryptography and Security · Computer Science 2025-10-24 Vincenzo Carletti , Pasquale Foggia , Carlo Mazzocca , Giuseppe Parrella , Mario Vento

We revisit the classic problem of document-level role-filler entity extraction (REE) for template filling. We argue that sentence-level approaches are ill-suited to the task and introduce a generative transformer-based encoder-decoder…

Computation and Language · Computer Science 2021-02-01 Xinya Du , Alexander M. Rush , Claire Cardie

Gradient inversion attacks are often presented as a serious privacy threat in federated learning, with recent work reporting increasingly strong reconstructions under favorable experimental settings. However, it remains unclear whether such…

Cryptography and Security · Computer Science 2026-02-10 Viktor Valadi , Mattias Åkesson , Johan Östman , Fazeleh Hoseini , Salman Toor , Andreas Hellander

Model Inversion (MI), in which an adversary abuses access to a trained Machine Learning (ML) model attempting to infer sensitive information about its original training data, has attracted increasing research attention. During MI, the…

Machine Learning · Computer Science 2021-11-09 Qian Wang , Daniel Kurz