中文
相关论文

相关论文: How to Protect Models against Adversarial Unlearni…

200 篇论文

Deep reinforcement learning models are vulnerable to adversarial attacks that can decrease a victim's cumulative expected reward by manipulating the victim's observations. Despite the efficiency of previous optimization-based methods for…

机器学习 · 计算机科学 2023-02-28 You Qiaoben , Chengyang Ying , Xinning Zhou , Hang Su , Jun Zhu , Bo Zhang

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

机器学习 · 计算机科学 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Rapid advancements of deep learning are accelerating adoption in a wide variety of applications, including safety-critical applications such as self-driving vehicles, drones, robots, and surveillance systems. These advancements include…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Firuz Juraev , Mohammed Abuhamad , Simon S. Woo , George K Thiruvathukal , Tamer Abuhmed

This research provides a comprehensive overview of adversarial attacks on AI and ML models, exploring various attack types, techniques, and their potential harms. We also delve into the business implications, mitigation strategies, and…

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

机器学习 · 计算机科学 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

机器学习 · 计算机科学 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

Adversarial reprogramming allows stealing computational resources by repurposing machine learning models to perform a different task chosen by the attacker. For example, a model trained to recognize images of animals can be reprogrammed to…

计算机科学与博弈论 · 计算机科学 2022-11-08 Yang Zheng , Xiaoyi Feng , Zhaoqiang Xia , Xiaoyue Jiang , Maura Pintor , Ambra Demontis , Battista Biggio , Fabio Roli

Data poisoning is a threat model in which a malicious actor tampers with training data to manipulate outcomes at inference time. A variety of defenses against this threat model have been proposed, but each suffers from at least one of the…

机器学习 · 计算机科学 2022-02-21 Jonas Geiping , Liam Fowl , Gowthami Somepalli , Micah Goldblum , Michael Moeller , Tom Goldstein

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

机器学习 · 计算机科学 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Machine unlearning for security is studied in this context. Several spam email detection methods exist, each of which employs a different algorithm to detect undesired spam emails. But these models are vulnerable to attacks. Many attackers…

机器学习 · 计算机科学 2021-12-28 Nishchal Parne , Kyathi Puppaala , Nithish Bhupathi , Ripon Patgiri

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

机器学习 · 统计学 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

机器学习 · 计算机科学 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

The rapid rise of IoT and Big Data has facilitated copious data driven applications to enhance our quality of life. However, the omnipresent and all-encompassing nature of the data collection can generate privacy concerns. Hence, there is a…

机器学习 · 计算机科学 2021-09-09 Mert Al , Semih Yagli , Sun-Yuan Kung

It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning…

机器学习 · 计算机科学 2022-06-24 Haojing Shen , Sihong Chen , Ran Wang , Xizhao Wang

Many individuals are concerned about the governance of machine learning systems and the prevention of algorithmic harms. The EU's recent General Data Protection Regulation (GDPR) has been seen as a core tool for achieving better governance…

机器学习 · 计算机科学 2018-10-17 Michael Veale , Reuben Binns , Lilian Edwards

Backdoor attacks are dangerous and difficult to prevent in federated learning (FL), where training data is sourced from untrusted clients over long periods of time. These difficulties arise because: (a) defenders in FL do not have access to…

机器学习 · 计算机科学 2023-02-01 Shuaiqi Wang , Jonathan Hayase , Giulia Fanti , Sewoong Oh

We provide a complete characterisation of the phenomenon of adversarial examples - inputs intentionally crafted to fool machine learning models. We aim to cover all the important concerns in this field of study: (1) the conjectures on the…

计算机视觉与模式识别 · 计算机科学 2019-02-19 Alexandru Constantin Serban , Erik Poll , Joost Visser

Machine unlearning, i.e. having a model forget about some of its training data, has become increasingly more important as privacy legislation promotes variants of the right-to-be-forgotten. In the context of deep learning, approaches for…

机器学习 · 计算机科学 2022-02-22 Anvith Thudi , Hengrui Jia , Ilia Shumailov , Nicolas Papernot

Large Language Models (LLMs) have a privacy concern because they memorize training data (including personally identifiable information (PII) like emails and phone numbers) and leak it during inference. A company can train an LLM on its…

密码学与安全 · 计算机科学 2023-07-21 Jaydeep Borkar

The impact of designing for security of AI is critical for humanity in the AI era. With humans increasingly becoming dependent upon AI, there is a need for neural networks that work reliably, inspite of Adversarial attacks. The vision for…

人工智能 · 计算机科学 2019-06-11 Rajagopal. A , Nirmala. V