English
Related papers

Related papers: Information Leakage from Data Updates in Machine L…

200 papers

Federated Learning (FL) enables multiple clients, such as mobile phones and IoT devices, to collaboratively train a global machine learning model while keeping their data localized. However, recent studies have revealed that the training…

Machine Learning · Computer Science 2025-04-17 Francesco Diana , Othmane Marfoq , Chuan Xu , Giovanni Neglia , Frédéric Giroire , Eoin Thomas

The success of machine learning is fueled by the increasing availability of computing power and large training datasets. The training data is used to learn new models or update existing ones, assuming that it is sufficiently representative…

Model inversion attacks involve reconstructing the training data of a target model, which raises serious privacy concerns for machine learning models. However, these attacks, especially learning-based methods, are likely to suffer from low…

Cryptography and Security · Computer Science 2023-06-27 Shuai Zhou , Tianqing Zhu , Dayong Ye , Xin Yu , Wanlei Zhou

As in-the-wild data are increasingly involved in the training stage, machine learning applications become more susceptible to data poisoning attacks. Such attacks typically lead to test-time accuracy degradation or controlled misprediction.…

Cryptography and Security · Computer Science 2022-11-02 Yufei Chen , Chao Shen , Yun Shen , Cong Wang , Yang Zhang

As machine learning becomes widely used for automated decisions, attackers have strong incentives to manipulate the results and models generated by machine learning algorithms. In this paper, we perform the first systematic study of…

Cryptography and Security · Computer Science 2021-09-29 Matthew Jagielski , Alina Oprea , Battista Biggio , Chang Liu , Cristina Nita-Rotaru , Bo Li

Recent works have demonstrated that it is possible to reconstruct training images and their labels from gradients of an image-classification model when its architecture is known. Unfortunately, there is still an incomplete theoretical…

Machine Learning · Computer Science 2022-10-25 Cangxiong Chen , Neill D. F. Campbell

Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a…

Machine Learning · Computer Science 2021-06-08 Ilia Shumailov , Zakhar Shumaylov , Dmitry Kazhdan , Yiren Zhao , Nicolas Papernot , Murat A. Erdogdu , Ross Anderson

Crowdsourced data used in machine learning services might carry sensitive information about attributes that users do not want to share. Various methods have been proposed to minimize the potential information leakage of sensitive attributes…

Machine Learning · Computer Science 2020-10-27 Han Zhao , Jianfeng Chi , Yuan Tian , Geoffrey J. Gordon

Past work has shown that large language models are susceptible to privacy attacks, where adversaries generate sequences from a trained model and detect which sequences are memorized from the training set. In this work, we show that the…

Cryptography and Security · Computer Science 2022-12-21 Nikhil Kandpal , Eric Wallace , Colin Raffel

Language Models (LMs) have been shown to leak information about training data through sentence-level membership inference and reconstruction attacks. Understanding the risk of LMs leaking Personally Identifiable Information (PII) has…

Machine Learning · Computer Science 2023-04-25 Nils Lukas , Ahmed Salem , Robert Sim , Shruti Tople , Lukas Wutschitz , Santiago Zanella-Béguelin

Machine Learning models, extensively used for various multimedia applications, are offered to users as a blackbox service on the Cloud on a pay-per-query basis. Such blackbox models are commercially valuable to adversaries, making them…

Cryptography and Security · Computer Science 2020-02-04 Vasisht Duddu , D. Vijay Rao

Gathering cyber threat intelligence from open sources is becoming increasingly important for maintaining and achieving a high level of security as systems become larger and more complex. However, these open sources are often subject to…

Cryptography and Security · Computer Science 2022-07-25 Markus Bayer , Tobias Frey , Christian Reuter

Online personalized recommendation services are generally hosted in the cloud where users query the cloud-based model to receive recommended input such as merchandise of interest or news feed. State-of-the-art recommendation models rely on…

Computational Engineering, Finance, and Science · Computer Science 2022-12-14 Hanieh Hashemi , Wenjie Xiong , Liu Ke , Kiwan Maeng , Murali Annavaram , G. Edward Suh , Hsien-Hsin S. Lee

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong

Collaborative machine learning settings like federated learning can be susceptible to adversarial interference and attacks. One class of such attacks is termed model inversion attacks, characterised by the adversary reverse-engineering the…

Machine Learning · Computer Science 2022-03-02 Dmitrii Usynin , Daniel Rueckert , Georgios Kaissis

With the rapid expansion of data lakes storing health data and hosting AI algorithms, a prominent concern arises: how safe is it to export machine learning models from these data lakes? In particular, deep network models, widely used for…

Cryptography and Security · Computer Science 2025-12-09 Huiyu Li , Nicholas Ayache , Hervé Delingette

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Model Inversion attacks aim to reconstruct information from private training data by exploiting access to a target model. Nearly all recent MI studies evaluate attack success using a standard framework that computes attack accuracy through…

Machine Learning · Computer Science 2026-05-15 Sy-Tuyen Ho , Koh Jun Hao , Ngoc-Bao Nguyen , Alexander Binder , Ngai-Man Cheung

Federated learning has emerged as a promising paradigm for collaborative model training while preserving data privacy. However, recent studies have shown that it is vulnerable to various privacy attacks, such as data reconstruction attacks.…

Cryptography and Security · Computer Science 2024-07-25 Xiaojin Zhang , Wei Chen

Transfer learning is widely used for transferring knowledge from a source domain to the target domain where the labeled data is scarce. Recently, deep transfer learning has achieved remarkable progress in various applications. However, the…

Computation and Language · Computer Science 2020-09-07 Cen Chen , Bingzhe Wu , Minghui Qiu , Li Wang , Jun Zhou