English
Related papers

Related papers: A Note On Interpreting Canary Exposure

200 papers

Fine-tuning large language models on private data for downstream applications poses significant privacy risks in potentially exposing sensitive information. Several popular community platforms now offer convenient distribution of a large…

Machine Learning · Computer Science 2024-09-02 Md Rafi Ur Rashid , Jing Liu , Toshiaki Koike-Akino , Shagufta Mehnaz , Ye Wang

Explainable Artificial Intelligence (XAI) has emerged as a pillar of Trustworthy AI and aims to bring transparency in complex models that are opaque by nature. Despite the benefits of incorporating explanations in models, an urgent need is…

Artificial Intelligence · Computer Science 2025-12-04 Sonal Allana , Mohan Kankanhalli , Rozita Dara

Deep Neural Networks (DNNs) have revolutionized various domains with their exceptional performance across numerous applications. However, Model Inversion (MI) attacks, which disclose private information about the training dataset by abusing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Hao Fang , Yixiang Qiu , Hongyao Yu , Wenbo Yu , Jiawei Kong , Baoli Chong , Bin Chen , Xuan Wang , Shu-Tao Xia , Ke Xu

Bias in data can have unintended consequences that propagate to the design, development, and deployment of machine learning models. In the financial services sector, this can result in discrimination from certain financial instruments and…

Cryptography and Security · Computer Science 2019-11-12 Reginald Bryant , Celia Cintas , Isaac Wambugu , Andrew Kinai , Komminist Weldemariam

As machine learning systems grow in scale, so do their training data requirements, forcing practitioners to automate and outsource the curation of training data in order to achieve state-of-the-art performance. The absence of trustworthy…

Machine Learning · Computer Science 2021-04-02 Micah Goldblum , Dimitris Tsipras , Chulin Xie , Xinyun Chen , Avi Schwarzschild , Dawn Song , Aleksander Madry , Bo Li , Tom Goldstein

Most of our lives are conducted in the cyberspace. The human notion of privacy translates into a cyber notion of privacy on many functions that take place in the cyberspace. This article focuses on three such functions: how to privately…

Cryptography and Security · Computer Science 2021-08-03 Sennur Ulukus , Salman Avestimehr , Michael Gastpar , Syed Jafar , Ravi Tandon , Chao Tian

Distributed machine learning generally aims at training a global model based on distributed data without collecting all the data to a centralized location, where two different approaches have been proposed: collecting and aggregating local…

Machine Learning · Computer Science 2020-07-08 Hanlin Lu , Changchang Liu , Ting He , Shiqiang Wang , Kevin S. Chan

An exploratory data analysis is an essential step for every data analyst to gain insights, evaluate data quality and (if required) select a machine learning model for further processing. While privacy-preserving machine learning is on the…

Machine Learning · Computer Science 2021-07-15 Saskia Nuñez von Voigt , Mira Pauli , Johanna Reichert , Florian Tschorsch

The development of artificial intelligence has significantly transformed people's lives. However, it has also posed a significant threat to privacy and security, with numerous instances of personal information being exposed online and…

Cryptography and Security · Computer Science 2024-02-28 Le Yang , Miao Tian , Duan Xin , Qishuo Cheng , Jiajian Zheng

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

Machine Learning · Computer Science 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning…

Machine Learning · Computer Science 2021-09-07 Ashly Lau , Jonathan Passerat-Palmbach

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

Cryptography and Security · Computer Science 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum

Machine learning models can leak information regarding the dataset they have trained. In this paper, we present the first membership inference attack against black-boxed object detection models that determines whether the given data records…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Yeachan Park , Myungjoo Kang

Privacy attacks on Machine Learning (ML) models often focus on inferring the existence of particular data points in the training data. However, what the adversary really wants to know is if a particular individual's (subject's) data was…

Machine Learning · Computer Science 2023-06-05 Anshuman Suri , Pallika Kanani , Virendra J. Marathe , Daniel W. Peterson

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

Machine learning models leak information about their training data every time they reveal a prediction. This is problematic when the training data needs to remain private. Private prediction methods limit how much information about the…

Machine Learning · Computer Science 2020-07-13 Laurens van der Maaten , Awni Hannun

Membership inference attacks (MIAs) against machine learning (ML) models aim to determine whether a given data point was part of the model training data. These attacks may pose significant privacy risks to individuals whose sensitive data…

Cryptography and Security · Computer Science 2025-11-24 Mona Khalil , Alberto Blanco-Justicia , Najeeb Jebreel , Josep Domingo-Ferrer

The last decade has seen a rise of Deep Learning with its applications ranging across diverse domains. But usually, the datasets used to drive these systems contain data which is highly confidential and sensitive. Though, Deep Learning…

Cryptography and Security · Computer Science 2022-12-09 Vishal Jignesh Gandhi , Sanchit Shokeen , Saloni Koshti

The explosive growth of machine learning has made it a critical infrastructure in the era of artificial intelligence. The extensive use of data poses a significant threat to individual privacy. Various countries have implemented…

Cryptography and Security · Computer Science 2024-06-11 Hengzhu Liu , Ping Xiong , Tianqing Zhu , Philip S. Yu

Machine learning on encrypted data has received a lot of attention thanks to recent breakthroughs in homomorphic encryption and secure multi-party computation. It allows outsourcing computation to untrusted servers without sacrificing…

Machine Learning · Computer Science 2021-09-24 Theo Ryffel , Edouard Dufour-Sans , Romain Gay , Francis Bach , David Pointcheval