中文
相关论文

相关论文: Learning under $p$-Tampering Attacks

200 篇论文

We propose the first study of adversarial attacks on online learning to rank. The goal of the adversary is to misguide the online learning to rank algorithm to place the target item on top of the ranking list linear times to time horizon…

机器学习 · 计算机科学 2023-05-31 Zichen Wang , Rishab Balasubramanian , Hui Yuan , Chenyu Song , Mengdi Wang , Huazheng Wang

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Model inversion attacks pose a significant privacy threat to machine learning models by reconstructing sensitive data from their outputs. While various defenses have been proposed to counteract these attacks, they often come at the cost of…

密码学与安全 · 计算机科学 2024-12-11 Shuai Zhou , Dayong Ye , Tianqing Zhu , Wanlei Zhou

Deep learning models are vulnerable to adversarial examples, which can fool a target classifier by imposing imperceptible perturbations onto natural examples. In this work, we consider the practical and challenging decision-based black-box…

机器学习 · 计算机科学 2021-05-11 Qi-An Fu , Yinpeng Dong , Hang Su , Jun Zhu

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

密码学与安全 · 计算机科学 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

With the great success of deep neural networks, adversarial learning has received widespread attention in various studies, ranging from multi-class learning to multi-label learning. However, existing adversarial attacks toward multi-label…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Yuchen Sun , Qianqian Xu , Zitai Wang , Qingming Huang

Recent research has successfully demonstrated new types of data poisoning attacks. To address this problem, some researchers have proposed both offline and online data poisoning detection defenses which employ machine learning algorithms to…

密码学与安全 · 计算机科学 2021-05-24 Jack W. Stokes , Paul England , Kevin Kane

We study reward poisoning attacks in reinforcement learning (RL), where an adversary manipulates rewards within constrained budgets to force the target RL agent to adopt a policy that aligns with the attacker's objectives. Prior works on…

The growing interest for adversarial examples, i.e. maliciously modified examples which fool a classifier, has resulted in many defenses intended to detect them, render them inoffensive or make the model more robust against them. In this…

机器学习 · 计算机科学 2021-03-04 Rémi Bernhard , Pierre-Alain Moellic , Jean-Max Dutertre

It is significant to evaluate the security of existing digital image tampering localization algorithms in real-world applications. In this paper, we propose an adversarial attack scheme to reveal the reliability of such tampering…

计算机视觉与模式识别 · 计算机科学 2023-09-20 Yuqi Wang , Gang Cao , Zijie Lou , Haochen Zhu

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

机器学习 · 统计学 2018-01-09 Martin Gubri

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

机器学习 · 计算机科学 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

We investigate security concerns of the emergent instruction tuning paradigm, that models are trained on crowdsourced datasets with task instructions to achieve superior performance. Our studies demonstrate that an attacker can inject…

计算与语言 · 计算机科学 2024-04-04 Jiashu Xu , Mingyu Derek Ma , Fei Wang , Chaowei Xiao , Muhao Chen

Thompson sampling is one of the most popular learning algorithms for online sequential decision-making problems and has rich real-world applications. However, current Thompson sampling algorithms are limited by the assumption that the…

机器学习 · 计算机科学 2024-10-28 Yinglun Xu , Zhiwei Wang , Gagandeep Singh

Minimizing risk with fairness constraints is one of the popular approaches to learning a fair classifier. Recent works showed that this approach yields an unfair classifier if the training set is corrupted. In this work, we study the…

机器学习 · 计算机科学 2022-05-10 Changhun Jo , Jy-yong Sohn , Kangwook Lee

We study the problem of learning from multiple untrusted data sources, a scenario of increasing practical relevance given the recent emergence of crowdsourcing and collaborative learning paradigms. Specifically, we analyze the situation in…

机器学习 · 计算机科学 2020-07-01 Nikola Konstantinov , Elias Frantar , Dan Alistarh , Christoph H. Lampert

A backdoor data poisoning attack is an adversarial attack wherein the attacker injects several watermarked, mislabeled training examples into a training set. The watermark does not impact the test-time performance of the model on typical…

机器学习 · 计算机科学 2021-11-05 Naren Sarayu Manoj , Avrim Blum

The learner's ability to generate a hypothesis that closely approximates the target function is crucial in machine learning. Achieving this requires sufficient data; however, unauthorized access by an eavesdropping learner can lead to…

机器学习 · 统计学 2025-08-05 Jeongho Bang , Wooyeong Song , Kyujin Shin , Yong-Su Kim

We study data poisoning attacks in learning from human preferences. More specifically, we consider the problem of teaching/enforcing a target policy $\pi^\dagger$ by synthesizing preference data. We seek to understand the susceptibility of…

Model inversion attacks involve reconstructing the training data of a target model, which raises serious privacy concerns for machine learning models. However, these attacks, especially learning-based methods, are likely to suffer from low…

密码学与安全 · 计算机科学 2023-06-27 Shuai Zhou , Tianqing Zhu , Dayong Ye , Xin Yu , Wanlei Zhou