English
Related papers

Related papers: When Machine Learning Models Leak: An Exploration …

200 papers

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

A common assumption in the social learning literature is that agents exchange information in an unselfish manner. In this work, we consider the scenario where a subset of agents aims at driving the network beliefs to the wrong hypothesis.…

Systems and Control · Electrical Eng. & Systems 2021-03-30 Konstantinos Ntemos , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

The widespread adoption of synthetic data raises new questions about how models generating the data can influence other large language models (LLMs) via distilled data. To start, our work exhaustively characterizes the impact of passive…

Computation and Language · Computer Science 2024-07-22 Luísa Shimabucoro , Sebastian Ruder , Julia Kreutzer , Marzieh Fadaee , Sara Hooker

Synthetic data inherits the differential privacy guarantees of the model used to generate it. Additionally, synthetic data may benefit from privacy amplification when the generative model is kept hidden. While empirical studies suggest this…

Machine Learning · Computer Science 2025-06-06 Clément Pierquin , Aurélien Bellet , Marc Tommasi , Matthieu Boussard

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

Cryptography and Security · Computer Science 2022-09-07 Bargav Jayaraman , David Evans

Machine unlearning has become a promising solution for fulfilling the "right to be forgotten", under which individuals can request the deletion of their data from machine learning models. However, existing studies of machine unlearning…

Cryptography and Security · Computer Science 2024-04-05 Hongsheng Hu , Shuo Wang , Tian Dong , Minhui Xue

This paper studies model-inversion attacks, in which the access to a model is abused to infer information about the training data. Since its first introduction, such attacks have raised serious concerns given that training data usually…

Machine Learning · Computer Science 2020-04-21 Yuheng Zhang , Ruoxi Jia , Hengzhi Pei , Wenxiao Wang , Bo Li , Dawn Song

Property inference attacks reveal statistical properties about a training set but are difficult to distinguish from the primary purposes of statistical machine learning, which is to produce models that capture statistical properties about a…

Machine Learning · Computer Science 2021-09-28 Anshuman Suri , David Evans

"Overlearning" means that a model trained for a seemingly simple objective implicitly learns to recognize attributes and concepts that are (1) not part of the learning objective, and (2) sensitive from a privacy or bias perspective. For…

Machine Learning · Computer Science 2020-02-11 Congzheng Song , Vitaly Shmatikov

Data poisoning attacks compromise the integrity of machine-learning models by introducing malicious training samples to influence the results during test time. In this work, we investigate backdoor data poisoning attack on deep neural…

Machine Learning · Computer Science 2019-12-04 Mahesh Subedar , Nilesh Ahuja , Ranganath Krishnan , Ibrahima J. Ndiour , Omesh Tickoo

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Machine learning and data mining techniques are utiized for enhancement of the security of any network. Researchers used machine learning for pattern detection, anomaly detection, dynamic policy setting, etc. The methods allow the program…

Cryptography and Security · Computer Science 2024-08-31 Aviral Srivastava , Dhyan Thakkar , Sharda Valiveti , Pooja Shah , Gaurang Raval

Increasing use of ML technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing leakages of sensitive…

Cryptography and Security · Computer Science 2020-12-08 Shagufta Mehnaz , Ninghui Li , Elisa Bertino

Safeguarding the Intellectual Property (IP) of data has become critically important as machine learning applications continue to proliferate, and their success heavily relies on the quality of training data. While various mechanisms exist…

Machine Learning · Computer Science 2024-04-18 Biao Wu , Qiang Huang , Anthony K. H. Tung

Machine learning models, especially deep neural networks have been shown to be susceptible to privacy attacks such as membership inference where an adversary can detect whether a data point was used for training a black-box model. Such…

Machine Learning · Computer Science 2020-07-20 Shruti Tople , Amit Sharma , Aditya Nori

Generative models are subject to overfitting and thus may potentially leak sensitive information from the training data. In this work. we investigate the privacy risks that can potentially arise from the use of generative adversarial…

Cryptography and Security · Computer Science 2024-04-02 Abdallah Alshantti , Adil Rasheed , Frank Westad

Hyperparameters are critical in machine learning, as different hyperparameters often result in models with significantly different performance. Hyperparameters may be deemed confidential because of their commercial value and the…

Cryptography and Security · Computer Science 2019-09-10 Binghui Wang , Neil Zhenqiang Gong

The problem of model collapse has presented new challenges in iterative training of generative models, where such training with synthetic data leads to an overall degradation of performance. This paper looks at the problem from a…

Machine Learning · Statistics 2026-02-19 Soham Bakshi , Sunrit Chakraborty

Transfer learning is a useful machine learning framework that allows one to build task-specific models (student models) without significantly incurring training costs using a single powerful model (teacher model) pre-trained with a large…

Machine Learning · Computer Science 2020-10-28 Seng Pei Liew , Tsubasa Takahashi

Deep neural networks are increasingly deployed for scene analytics, including to evaluate the attention and reaction of people exposed to out-of-home advertisements. However, the features extracted by a deep neural network that was trained…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Chau Yi Li , Andrea Cavallaro