中文
相关论文

相关论文: Certified Robustness to Data Poisoning in Gradient…

200 篇论文

We develop a machine-learning framework to learn hyperparameter sequences for accelerated first-order methods (e.g., the step size and momentum sequences in accelerated gradient descent) to quickly solve parametric convex optimization…

最优化与控制 · 数学 2025-10-07 Rajiv Sambharya , Jinho Bok , Nikolai Matni , George Pappas

Machine learning is becoming ubiquitous. From finance to medicine, machine learning models are boosting decision-making processes and even outperforming humans in some tasks. This huge progress in terms of prediction quality does not…

Data poisoning aims to compromise a machine learning based software component by contaminating its training set to change its prediction results for test inputs. Existing methods for deciding data-poisoning robustness have either poor…

软件工程 · 计算机科学 2023-07-18 Yannan Li , Jingbo Wang , Chao Wang

Backdoor attacks poison the training data, causing the model to behave normally on clean inputs but predict attacker-chosen labels when trigger patterns are embedded into the input samples. Defending against such attacks is highly…

密码学与安全 · 计算机科学 2026-04-28 Wei Guo , Maura Pintor , Ambra Demontis , Battista Biggio

Data-poisoning backdoor attacks are serious security threats to machine learning models, where an adversary can manipulate the training dataset to inject backdoors into models. In this paper, we focus on in-training backdoor defense, aiming…

密码学与安全 · 计算机科学 2024-10-16 Shaokui Wei , Hongyuan Zha , Baoyuan Wu

With the increase in machine learning (ML) applications in different domains, incentives for deceiving these models have reached more than ever. As data is the core backbone of ML algorithms, attackers shifted their interest toward…

密码学与安全 · 计算机科学 2023-01-04 Kshitiz Aryal , Maanak Gupta , Mahmoud Abdelsalam

This paper investigates the critical issue of data poisoning attacks on AI models, a growing concern in the ever-evolving landscape of artificial intelligence and cybersecurity. As advanced technology systems become increasingly prevalent…

密码学与安全 · 计算机科学 2025-03-13 Halima I. Kure , Pradipta Sarkar , Ahmed B. Ndanusa , Augustine O. Nwajana

The financial industry relies on deep learning models for making important decisions. This adoption brings new danger, as deep black-box models are known to be vulnerable to adversarial attacks. In computer vision, one can shape the output…

机器学习 · 计算机科学 2024-08-27 Alina Ermilova , Elizaveta Kovtun , Dmitry Berestnev , Alexey Zaytsev

The unprecedented availability of training data fueled the rapid development of powerful neural networks in recent years. However, the need for such large amounts of data leads to potential threats such as poisoning attacks: adversarial…

机器学习 · 计算机科学 2024-03-21 Fabio De Gaspari , Dorjan Hitaj , Luigi V. Mancini

Data poisoning is a threat model in which a malicious actor tampers with training data to manipulate outcomes at inference time. A variety of defenses against this threat model have been proposed, but each suffers from at least one of the…

机器学习 · 计算机科学 2022-02-21 Jonas Geiping , Liam Fowl , Gowthami Somepalli , Micah Goldblum , Michael Moeller , Tom Goldstein

Federated Learning (FL) as a distributed learning paradigm that aggregates information from diverse clients to train a shared global model, has demonstrated great success. However, malicious clients can perform poisoning attacks and model…

机器学习 · 计算机科学 2021-06-16 Chulin Xie , Minghao Chen , Pin-Yu Chen , Bo Li

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

机器学习 · 计算机科学 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

This paper investigates poisoning attacks against data-driven control methods. This work is motivated by recent trends showing that, in supervised learning, slightly modifying the data in a malicious manner can drastically deteriorate the…

系统与控制 · 电气工程与系统科学 2021-03-11 Alessio Russo , Alexandre Proutiere

Data poisoning attacks and backdoor attacks aim to corrupt a machine learning classifier via modifying, adding, and/or removing some carefully selected training examples, such that the corrupted classifier makes incorrect predictions as the…

密码学与安全 · 计算机科学 2021-12-03 Jinyuan Jia , Yupei Liu , Xiaoyu Cao , Neil Zhenqiang Gong

Machine learning systems trained on user-provided data are susceptible to data poisoning attacks, whereby malicious users inject false training data with the aim of corrupting the learned model. While recent work has proposed a number of…

机器学习 · 计算机科学 2017-11-27 Jacob Steinhardt , Pang Wei Koh , Percy Liang

Similar to other machine learning frameworks, Offline Reinforcement Learning (RL) is shown to be vulnerable to poisoning attacks, due to its reliance on externally sourced datasets, a vulnerability that is exacerbated by its sequential…

机器学习 · 计算机科学 2025-05-28 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah Erfani , Benjamin I. P. Rubinstein

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

机器学习 · 计算机科学 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

机器学习 · 计算机科学 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Machine learning models are brittle, and small changes in the training data can result in different predictions. We study the problem of proving that a prediction is robust to data poisoning, where an attacker can inject a number of…

编程语言 · 计算机科学 2020-06-25 Samuel Drews , Aws Albarghouthi , Loris D'Antoni