English
Related papers

Related papers: Formalizing Distribution Inference Risks

200 papers

Targeted training-set attacks inject malicious instances into the training set to cause a trained model to mislabel one or more specific test instances. This work proposes the task of target identification, which determines whether a…

Machine Learning · Computer Science 2022-09-07 Zayd Hammoudeh , Daniel Lowd

Machine learning models used for distributed architectures consisting of servers and clients require large amounts of data to achieve high accuracy. Data obtained from clients are collected on a central server for model training. However,…

Cryptography and Security · Computer Science 2025-09-18 Ozer Ozturk , Busra Buyuktanir , Gozde Karatas Baydogmus , Kazim Yildiz

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

Membership inference attacks allow a malicious entity to predict whether a sample is used during training of a victim model or not. State-of-the-art membership inference attacks have shown to achieve good accuracy which poses a great…

Machine Learning · Computer Science 2022-03-07 Shahbaz Rezaei , Xin Liu

As machine learning becomes more widely used, the need to study its implications in security and privacy becomes more urgent. Although the body of work in privacy has been steadily growing over the past few years, research on the privacy…

Cryptography and Security · Computer Science 2023-09-19 Maria Rigaki , Sebastian Garcia

The membership inference problem for publicly released statistics from a private dataset is well-studied. When developing and formally analyzing attack strategies, however, the focus has been on attacks that model the population using only…

Cryptography and Security · Computer Science 2026-05-29 Lisa Oakley , Sam Stites , Cameron Moy , Steven Holtzen , Alina Oprea , Marco Gaboardi

Regression models for supervised learning problems with a continuous target are commonly understood as models for the conditional mean of the target given predictors. This notion is simple and therefore appealing for interpretation and…

Methodology · Statistics 2018-01-09 Torsten Hothorn , Achim Zeileis

Distribution shift is a common situation in machine learning tasks, where the data used for training a model is different from the data the model is applied to in the real world. This issue arises across multiple technical settings: from…

Machine Learning · Computer Science 2024-05-24 Nicolas Acevedo , Carmen Cortez , Chris Brooks , Rene Kizilcec , Renzhe Yu

Machine learning algorithms, however effective, are known to be vulnerable in adversarial scenarios where a malicious user may inject manipulated instances. In this work we focus on evasion attacks, where a model is trained in a safe…

Machine Learning · Computer Science 2020-04-08 Stefano Calzavara , Claudio Lucchese , Federico Marcuzzi , Salvatore Orlando

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership inference attacks exploit…

Cryptography and Security · Computer Science 2021-12-07 Christopher A. Choquette-Choo , Florian Tramer , Nicholas Carlini , Nicolas Papernot

We introduce the notion of property signatures, a representation for programs and program specifications meant for consumption by machine learning algorithms. Given a function with input type $\tau_{in}$ and output type $\tau_{out}$, a…

Programming Languages · Computer Science 2020-02-24 Augustus Odena , Charles Sutton

Adversarial attacks for machine learning models have become a highly studied topic both in academia and industry. These attacks, along with traditional security threats, can compromise confidentiality, integrity, and availability of…

Cryptography and Security · Computer Science 2020-12-10 Jakub Breier , Adrian Baldwin , Helen Balinsky , Yang Liu

The paper examines the potential of deep learning to support decisions in financial risk management. We develop a deep learning model for predicting whether individual spread traders secure profits from future trades. This task embodies…

Risk Management · Quantitative Finance 2019-11-19 Yaodong Yang , Alisa Kolesnikova , Stefan Lessmann , Tiejun Ma , Ming-Chien Sung , Johnnie E. V. Johnson

Membership Inference Attacks exploit the vulnerabilities of exposing models trained on customer data to queries by an adversary. In a recently proposed implementation of an auditing tool for measuring privacy leakage from sensitive…

Machine Learning · Computer Science 2020-09-21 Abhinav Aggarwal , Zekun Xu , Oluwaseyi Feyisetan , Nathanael Teissier

Machine learning models are vulnerable to data inference attacks, such as membership inference and model inversion attacks. In these types of breaches, an adversary attempts to infer a data record's membership in a dataset or even…

Cryptography and Security · Computer Science 2022-03-15 Dayong Ye , Sheng Shen , Tianqing Zhu , Bo Liu , Wanlei Zhou

Phishing attacks are the most common type of cyber-attacks used to obtain sensitive information and have been affecting individuals as well as organisations across the globe. Various techniques have been proposed to identify the phishing…

Cryptography and Security · Computer Science 2021-01-08 Sohail Ahmed Khan , Wasiq Khan , Abir Hussain

We present a new approach to assessing the robustness of neural networks based on estimating the proportion of inputs for which a property is violated. Specifically, we estimate the probability of the event that the property is violated…

Machine Learning · Statistics 2019-02-25 Stefan Webb , Tom Rainforth , Yee Whye Teh , M. Pawan Kumar

Aggregate location data is often used to support smart services and applications, e.g., generating live traffic maps or predicting visits to businesses. In this paper, we present the first study on the feasibility of membership inference…

Cryptography and Security · Computer Science 2017-11-30 Apostolos Pyrgelis , Carmela Troncoso , Emiliano De Cristofaro

Machine learning (ML) has been widely adopted in various privacy-critical applications, e.g., face recognition and medical image analysis. However, recent research has shown that ML models are vulnerable to attacks against their training…

Machine Learning · Computer Science 2021-09-20 Zheng Li , Yang Zhang

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

Cryptography and Security · Computer Science 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang