中文
相关论文

相关论文: A Statistical Threshold for Adversarial Classifica…

200 篇论文

We study the $\ell_2$ mechanism for computing a $d$-dimensional statistic with bounded $\ell_2$ sensitivity under approximate differential privacy. Across a range of privacy parameters, we find that the $\ell_2$ mechanism obtains lower…

密码学与安全 · 计算机科学 2025-02-25 Matthew Joseph , Alex Kulesza , Alexander Yu

We propose a data-driven framework for optimizing privacy-preserving data release mechanisms to attain the information-theoretically optimal tradeoff between minimizing distortion of useful data and concealing specific sensitive…

信息论 · 计算机科学 2019-06-13 Ardhendu Tripathy , Ye Wang , Prakash Ishwar

Voting plays a central role in bringing crowd wisdom to collective decision making, meanwhile data privacy has been a common ethical/legal issue in eliciting preferences from individuals. This work studies the problem of aggregating…

密码学与安全 · 计算机科学 2019-08-15 Shaowei Wang , Jiachun Du , Wei Yang , Xinrong Diao , Zichun Liu , Yiwen Nie , Liusheng Huang , Hongli Xu

LLM agents increasingly have access to private user data and act on the user's behalf when interacting with third-party systems. The user defines what may and must not be shared, and the agent must robustly follow that intent even when…

人工智能 · 计算机科学 2026-05-20 Qiaoyuan Zheng , Yiqu Yang , Qi Gao , Imanol Schlag

In large-scale statistical learning, data collection and model fitting are moving increasingly toward peripheral devices---phones, watches, fitness trackers---away from centralized data collection. Concomitant with this rise in…

机器学习 · 统计学 2019-06-04 Abhishek Bhowmick , John Duchi , Julien Freudiger , Gaurav Kapoor , Ryan Rogers

We present a novel way to compare the statistical cost of privacy mechanisms using their Dobrushin coefficient. Specifically, we provide upper and lower bounds for the Dobrushin coefficient of a privacy mechanism in terms of its maximal…

信息论 · 计算机科学 2018-01-22 Mario Diaz , Lalitha Sankar , Peter Kairouz

We consider a counter-adversarial sequential decision-making problem where an agent computes its private belief (posterior distribution) of the current state of the world, by filtering private information. According to its private belief,…

系统与控制 · 电气工程与系统科学 2020-04-09 Inês Lourenço , Robert Mattila , Cristian R. Rojas , Bo Wahlberg

Differential privacy is a cryptographically-motivated definition of privacy which has gained significant attention over the past few years. Differentially private solutions enforce privacy by adding random noise to a function computed over…

机器学习 · 计算机科学 2012-07-03 Kamalika Chaudhuri , Daniel Hsu

Despite the widespread use of machine learning algorithms to solve problems of technological, economic, and social relevance, provable guarantees on the performance of these data-driven algorithms are critically lacking, especially when the…

机器学习 · 计算机科学 2019-03-18 Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While…

系统与控制 · 电气工程与系统科学 2021-12-03 Yunhai Han , Sonia Martínez

A novel definition for data privacy in quantum computing based on quantum hypothesis testing is presented in this paper. The parameters in this privacy notion possess an operational interpretation based on the success/failure of an…

量子物理 · 物理学 2023-02-27 Farhad Farokhi

In distributed learning settings, models are iteratively updated with shared gradients computed from potentially sensitive user data. While previous work has studied various privacy risks of sharing gradients, our paper aims to provide a…

机器学习 · 计算机科学 2024-09-02 Zhuohang Li , Andrew Lowy , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Bradley Malin , Ye Wang

Differential privacy (DP), provides a framework for provable privacy protection against arbitrary adversaries, while allowing the release of summary statistics and synthetic data. We address the problem of releasing a noisy real-valued…

统计方法学 · 统计学 2024-11-04 Jordan Awan , Aleksandra Slavkovic

Deep Reinforcement Learning (RL) agents are susceptible to adversarial noise in their observations that can mislead their policies and decrease their performance. However, an adversary may be interested not only in decreasing the reward,…

机器学习 · 计算机科学 2022-12-13 Dennis Gross , Thiago D. Simao , Nils Jansen , Guillermo A. Perez

Machine learning models are increasingly made available to the masses through public query interfaces. Recent academic work has demonstrated that malicious users who can query such models are able to infer sensitive information about…

密码学与安全 · 计算机科学 2017-12-27 Yunhui Long , Vincent Bindschaedler , Carl A. Gunter

Training reliable deep learning models which avoid making overconfident but incorrect predictions is a longstanding challenge. This challenge is further exacerbated when learning has to be differentially private: protection provided to…

机器学习 · 计算机科学 2023-05-31 Stephan Rabanser , Anvith Thudi , Abhradeep Thakurta , Krishnamurthy Dvijotham , Nicolas Papernot

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

机器学习 · 统计学 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

Scientific collaborations benefit from collaborative learning of distributed sources, but remain difficult to achieve when data are sensitive. In recent years, privacy preserving techniques have been widely studied to analyze distributed…

密码学与安全 · 计算机科学 2022-06-30 Guanhong Miao , A. Adam Ding , Samuel S. Wu

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

密码学与安全 · 计算机科学 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu

There is great potential for damage from adversarial learning (AL) attacks on machine-learning based systems. In this paper, we provide a contemporary survey of AL, focused particularly on defenses against attacks on statistical…

机器学习 · 计算机科学 2020-03-11 David J. Miller , Zhen Xiang , George Kesidis