中文
相关论文

相关论文: Exploring Model Dynamics for Accumulative Poisonin…

200 篇论文

Recent works show that text-to-image generative models are surprisingly vulnerable to a variety of poisoning attacks. Empirical results find that these models can be corrupted by altering associations between individual text prompts and…

密码学与安全 · 计算机科学 2024-09-20 Wenxin Ding , Cathy Y. Li , Shawn Shan , Ben Y. Zhao , Haitao Zheng

Recommender systems have become an integral part of online services to help users locate specific information in a sea of data. However, existing studies show that some recommender systems are vulnerable to poisoning attacks, particularly…

Operating in a dynamic real world environment requires a forward thinking and adversarial aware design for classifiers, beyond fitting the model to the training data. In such scenarios, it is necessary to make classifiers - a) harder to…

机器学习 · 计算机科学 2018-03-28 Tegjyot Singh Sethi , Mehmed Kantardzic , Lingyu Lyua , Jiashun Chen

Backdoors and poisoning attacks are a major threat to the security of machine-learning and vision systems. Often, however, these attacks leave visible artifacts in the images that can be visually detected and weaken the efficacy of the…

密码学与安全 · 计算机科学 2020-03-20 Erwin Quiring , Konrad Rieck

Recent work shows that deep neural networks are vulnerable to adversarial examples. Much work studies adversarial example generation, while very little work focuses on more critical adversarial defense. Existing adversarial detection…

机器学习 · 计算机科学 2021-09-15 Bin Zhu , Zhaoquan Gu , Le Wang , Zhihong Tian

Despite the recent advances in a wide spectrum of applications, machine learning models, especially deep neural networks, have been shown to be vulnerable to adversarial attacks. Attackers add carefully-crafted perturbations to input, where…

机器学习 · 计算机科学 2020-10-08 Ninghao Liu , Mengnan Du , Ruocheng Guo , Huan Liu , Xia Hu

Data poisoning attacks, in which a malicious adversary aims to influence a model by injecting "poisoned" data into the training process, have attracted significant recent attention. In this work, we take a closer look at existing poisoning…

机器学习 · 计算机科学 2024-02-16 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

机器学习 · 计算机科学 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Federated learning is highly susceptible to model poisoning attacks, especially those meticulously crafted for servers. Traditional defense methods mainly focus on updating assessments or robust aggregation against manually crafted myopic…

机器学习 · 计算机科学 2024-12-17 Yujing Wang , Hainan Zhang , Sijia Wen , Wangjie Qiu , Binghui Guo

Measuring uncertainty is a promising technique for detecting adversarial examples, crafted inputs on which the model predicts an incorrect class with high confidence. But many measures of uncertainty exist, including predictive en- tropy…

机器学习 · 统计学 2018-03-26 Lewis Smith , Yarin Gal

Adversarial attacks present a significant threat to modern machine learning systems. Yet, existing detection methods often lack the ability to detect unseen attacks or detect different attack types with a high level of accuracy. In this…

密码学与安全 · 计算机科学 2025-10-06 Chinthana Wimalasuriya , Spyros Tragoudas

With the increase in machine learning (ML) applications in different domains, incentives for deceiving these models have reached more than ever. As data is the core backbone of ML algorithms, attackers shifted their interest toward…

密码学与安全 · 计算机科学 2023-01-04 Kshitiz Aryal , Maanak Gupta , Mahmoud Abdelsalam

Attacks on machine learning models have been, since their conception, a very persistent and evasive issue resembling an endless cat-and-mouse game. One major variant of such attacks is poisoning attacks which can indirectly manipulate an ML…

机器学习 · 计算机科学 2022-04-05 Alaa Anani , Mohamed Ghanem , Lotfy Abdel Khaliq

Machine Learning (ML) techniques can facilitate the automation of malicious software (malware for short) detection, but suffer from evasion attacks. Many studies counter such attacks in heuristic manners, lacking theoretical guarantees and…

密码学与安全 · 计算机科学 2023-04-07 Deqiang Li , Shicheng Cui , Yun Li , Jia Xu , Fu Xiao , Shouhuai Xu

Modern machine learning increasingly requires training on a large collection of data from multiple sources, not all of which can be trusted. A particularly concerning scenario is when a small fraction of poisoned data changes the behavior…

机器学习 · 计算机科学 2021-04-26 Jonathan Hayase , Weihao Kong , Raghav Somani , Sewoong Oh

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

计算与语言 · 计算机科学 2026-04-21 San Kim , Gary Geunbae Lee

The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to…

密码学与安全 · 计算机科学 2021-06-18 Giovanni Apruzzese , Mauro Andreolini , Luca Ferretti , Mirco Marchetti , Michele Colajanni

The proliferation of text-to-image diffusion models has raised significant privacy and security concerns, particularly regarding the generation of copyrighted or harmful images. In response, concept erasure (defense) methods have been…

机器学习 · 计算机科学 2025-10-06 Alex D. Richardson , Kaicheng Zhang , Lucas Beerens , Dongdong Chen

Machine learning models exhibit two seemingly contradictory phenomena: training data memorization, and various forms of forgetting. In memorization, models overfit specific training examples and become susceptible to privacy attacks. In…

Two widely used techniques for training supervised machine learning models on small datasets are Active Learning and Transfer Learning. The former helps to optimally use a limited budget to label new data. The latter uses large pre-trained…

机器学习 · 计算机科学 2021-01-28 Nicolas M. Müller , Konstantin Böttinger