中文
相关论文

相关论文: Universal Multi-Party Poisoning Attacks

200 篇论文

Recommendation and collaborative filtering systems are important in modern information and e-commerce applications. As these systems are becoming increasingly popular in the industry, their outputs could affect business decision making,…

机器学习 · 计算机科学 2016-10-07 Bo Li , Yining Wang , Aarti Singh , Yevgeniy Vorobeychik

Secure multiparty computation (MPC) allows data owners to train machine learning models on combined data while keeping the underlying training data private. The MPC threat model either considers an adversary who passively corrupts some…

密码学与安全 · 计算机科学 2025-05-26 Matthew Jagielski , Daniel Escudero , Rahul Rachuri , Peter Scholl

Federated learning (FL) enables collaborative model training while preserving data privacy, but its decentralized nature exposes it to client-side data poisoning attacks (DPAs) and model poisoning attacks (MPAs) that degrade global model…

密码学与安全 · 计算机科学 2025-02-07 Heyi Zhang , Yule Liu , Xinlei He , Jun Wu , Tianshuo Cong , Xinyi Huang

State-of-the-art machine learning models are vulnerable to data poisoning attacks whose purpose is to undermine the integrity of the model. However, the current literature on data poisoning attacks is mainly focused on ad hoc techniques…

机器学习 · 计算机科学 2021-02-12 Pooya Tavallali , Vahid Behzadan , Peyman Tavallali , Mukesh Singhal

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

机器学习 · 计算机科学 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Machine learning models have been widely adopted in several fields. However, most recent studies have shown several vulnerabilities from attacks with a potential to jeopardize the integrity of the model, presenting a new window of research…

In a \emph{data poisoning attack}, an attacker modifies, deletes, and/or inserts some training examples to corrupt the learnt machine learning model. \emph{Bootstrap Aggregating (bagging)} is a well-known ensemble learning method, which…

密码学与安全 · 计算机科学 2020-12-11 Jinyuan Jia , Xiaoyu Cao , Neil Zhenqiang Gong

Adversarial training (AT) is a robust learning algorithm that can defend against adversarial attacks in the inference phase and mitigate the side effects of corrupted data in the training phase. As such, it has become an indispensable…

密码学与安全 · 计算机科学 2023-05-02 Jingfeng Zhang , Bo Song , Bo Han , Lei Liu , Gang Niu , Masashi Sugiyama

We study a security threat to reinforcement learning where an attacker poisons the learning environment to force the agent into executing a target policy chosen by the attacker. As a victim, we consider RL agents whose objective is to find…

机器学习 · 计算机科学 2020-08-20 Amin Rakhsha , Goran Radanovic , Rati Devidze , Xiaojin Zhu , Adish Singla

The increasing access to data poses both opportunities and risks in deep learning, as one can manipulate the behaviors of deep learning models with malicious training samples. Such attacks are known as data poisoning. Recent advances in…

机器学习 · 计算机科学 2023-06-29 Wenxiao Wang , Soheil Feizi

With the increase in machine learning (ML) applications in different domains, incentives for deceiving these models have reached more than ever. As data is the core backbone of ML algorithms, attackers shifted their interest toward…

密码学与安全 · 计算机科学 2023-01-04 Kshitiz Aryal , Maanak Gupta , Mahmoud Abdelsalam

This work introduces a verification framework that provides both sound and complete guarantees for data poisoning attacks during neural network training. We formulate adversarial data manipulation, model training, and test-time evaluation…

机器学习 · 计算机科学 2026-02-20 Philip Sosnin , Jodie Knapp , Fraser Kennedy , Josh Collyer , Calvin Tsay

Backdoor and data-poisoning attacks can flip predictions with tiny training corruptions, yet a sharp theory linking poisoning strength, overparameterization, and regularization is lacking. We analyze ridge least squares with an unpenalized…

机器学习 · 统计学 2026-01-06 Donald Flynn , Diego Granziol

As pairwise ranking becomes broadly employed for elections, sports competitions, recommendations, and so on, attackers have strong motivation and incentives to manipulate the ranking list. They could inject malicious comparisons into the…

机器学习 · 计算机科学 2021-07-06 Ke Ma , Qianqian Xu , Jinshan Zeng , Xiaochun Cao , Qingming Huang

We show that we can easily design a single adversarial perturbation $P$ that changes the class of $n$ images $X_1,X_2,\dots,X_n$ from their original, unperturbed classes $c_1, c_2,\dots,c_n$ to desired (not necessarily all the same) classes…

计算机视觉与模式识别 · 计算机科学 2023-08-09 Stanislav Fort

Research in adversarial machine learning has shown how the performance of machine learning models can be seriously compromised by injecting even a small fraction of poisoning points into the training data. While the effects on model…

机器学习 · 计算机科学 2020-06-29 David Solans , Battista Biggio , Carlos Castillo

Learning reward models from pairwise comparisons is a fundamental component in a number of domains, including autonomous control, conversational agents, and recommendation systems, as part of a broad goal of aligning automated decisions…

机器学习 · 计算机科学 2024-10-10 Junlin Wu , Jiongxiao Wang , Chaowei Xiao , Chenguang Wang , Ning Zhang , Yevgeniy Vorobeychik

Machine learning has become an important component for many systems and applications including computer vision, spam filtering, malware and network intrusion detection, among others. Despite the capabilities of machine learning algorithms…

机器学习 · 统计学 2018-02-14 Andrea Paudice , Luis Muñoz-González , Andras Gyorgy , Emil C. Lupu

Deep Neural Networks have been found vulnerable re-cently. A kind of well-designed inputs, which called adver-sarial examples, can lead the networks to make incorrectpredictions. Depending on the different scenarios, goalsand capabilities,…

机器学习 · 计算机科学 2022-06-14 Junde Wu , Rao Fu

Backdoor attacks involve the injection of a limited quantity of poisoned examples containing triggers into the training dataset. During the inference stage, backdoor attacks can uphold a high level of accuracy for normal examples, yet when…

密码学与安全 · 计算机科学 2024-06-25 Hanfeng Xia , Haibo Hong , Ruili Wang