English
Related papers

Related papers: Reconstructing Training Data from Model Gradient, …

200 papers

Distributed machine learning paradigms, such as federated learning, have been recently adopted in many privacy-critical applications for speech analysis. However, such frameworks are vulnerable to privacy leakage attacks from shared…

Machine Learning · Computer Science 2023-02-22 Zhuohang Li , Jiaxin Zhang , Jian Liu

Graph federated learning is of essential importance for training over large graph datasets while protecting data privacy, where each client stores a subset of local graph data, while the server collects the local gradients and broadcasts…

Machine Learning · Computer Science 2025-08-05 Divya Anand Sinha , Ruijie Du , Yezi Liu , Athina Markopolou , Yanning Shen

Unlearning algorithms aim to remove deleted data's influence from trained models at a cost lower than full retraining. However, prior guarantees of unlearning in literature are flawed and don't protect the privacy of deleted records. We…

Machine Learning · Statistics 2023-02-15 Rishav Chourasia , Neil Shah

Federated learning (FL) allows the collaborative training of AI models without needing to share raw data. This capability makes it especially interesting for healthcare applications where patient and data privacy is of utmost concern.…

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

Machine Learning · Computer Science 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

Computation and Language · Computer Science 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

The use of personal data for training machine learning systems comes with a privacy threat and measuring the level of privacy of a model is one of the major challenges in machine learning today. Identifying training data based on a trained…

Machine Learning · Computer Science 2022-03-24 Ganesh Del Grosso , Hamid Jalalzai , Georg Pichler , Catuscia Palamidessi , Pablo Piantanida

Federated Learning (FL) is a distributed learning paradigm that enhances users privacy by eliminating the need for clients to share raw, private data with the server. Despite the success, recent studies expose the vulnerability of FL to…

Machine Learning · Computer Science 2023-12-15 Jing Wu , Munawar Hayat , Mingyi Zhou , Mehrtash Harandi

Interpretability is often pointed out as a key requirement for trustworthy machine learning. However, learning and releasing models that are inherently interpretable leaks information regarding the underlying training data. As such…

Artificial Intelligence · Computer Science 2024-04-04 Julien Ferry , Ulrich Aïvodji , Sébastien Gambs , Marie-José Huguet , Mohamed Siala

Recent advances in neural network based language models lead to successful deployments of such models, improving user experience in various applications. It has been demonstrated that strong performance of language models comes along with…

Cryptography and Security · Computer Science 2021-02-24 Huseyin A. Inan , Osman Ramadan , Lukas Wutschitz , Daniel Jones , Victor Rühle , James Withers , Robert Sim

Training deep neural networks via federated learning allows clients to share, instead of the original data, only the model trained on their data. Prior work has demonstrated that in practice a client's private information, unrelated to the…

Cryptography and Security · Computer Science 2021-06-01 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Hamed Haddadi , Soteris Demetriou

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

Cryptography and Security · Computer Science 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Federated learning enables multiple users to build a joint model by sharing their model updates (gradients), while their raw data remains local on their devices. In contrast to the common belief that this provides privacy benefits, we here…

Diffusion models are becoming defector generative models, which generate exceptionally high-resolution image data. Training effective diffusion models require massive real data, which is privately owned by distributed parties. Each data…

Artificial Intelligence · Computer Science 2024-06-03 Jiyue Huang , Chi Hong , Lydia Y. Chen , Stefanie Roos

Federated Learning (FL) is a distributed learning framework, in which the local data never leaves clients devices to preserve privacy, and the server trains models on the data via accessing only the gradients of those local data. Without…

Machine Learning · Computer Science 2021-10-29 Jinwoo Jeon , Jaechang Kim , Kangwook Lee , Sewoong Oh , Jungseul Ok

Unlike traditional central training, federated learning (FL) improves the performance of the global model by sharing and aggregating local models rather than local data to protect the users' privacy. Although this training approach appears…

Machine Learning · Computer Science 2022-01-27 Jiahui Geng , Yongli Mou , Feifei Li , Qing Li , Oya Beyan , Stefan Decker , Chunming Rong

As the scale and size of the data increases significantly nowadays, federal learning (Bonawitz et al. [2019]) for high performance computing and machine learning has been much more important than ever before (Abadi et al. [2016]). People…

Machine Learning · Computer Science 2022-11-16 Yanchong Zheng

Current methods for reconstructing training data from trained classifiers are restricted to very small models, limited training set sizes, and low-resolution images. Such restrictions hinder their applicability to real-world scenarios. In…

Machine Learning · Computer Science 2024-07-23 Yakir Oz , Gilad Yehudai , Gal Vardi , Itai Antebi , Michal Irani , Niv Haim

The Deep Leakage from Gradient (DLG) attack has emerged as a prevalent and highly effective method for extracting sensitive training data by inspecting exchanged gradients. This approach poses a substantial threat to the privacy of…

Machine Learning · Computer Science 2023-11-27 Chenyang Li , Zhao Song , Weixin Wang , Chiwun Yang

Training fair machine learning models becomes more and more important. As many powerful models are trained by collaboration among multiple parties, each holding some sensitive data, it is natural to explore the feasibility of training fair…

Machine Learning · Computer Science 2024-11-05 Xin Che , Jingdi Hu , Zirui Zhou , Yong Zhang , Lingyang Chu