中文
相关论文

相关论文: Robustness of Misinformation Classification System…

200 篇论文

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

信息检索 · 计算机科学 2020-08-06 Nisarg Raval , Manisha Verma

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

The robustness of Vision-Language Models (VLMs) such as CLIP is critical for their deployment in safety-critical applications like autonomous driving, healthcare diagnostics, and security systems, where accurate interpretation of visual and…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Yuhan Liang , Yijun Li , Yumeng Niu , Qianhe Shen , Hangyu Liu

From the perspective of information bottleneck (IB) theory, we propose a novel framework for performing black-box transferable adversarial attacks named IBTA, which leverages advancements in invariant features. Intuitively, diminishing the…

机器学习 · 计算机科学 2024-06-11 Biqing Qi , Junqi Gao , Jianxing Liu , Ligang Wu , Bowen Zhou

We consider a model of robust learning in an adversarial environment. The learner gets uncorrupted training data with access to possible corruptions that may be affected by the adversary during testing. The learner's goal is to build a…

机器学习 · 计算机科学 2022-07-04 Idan Attias , Aryeh Kontorovich , Yishay Mansour

Deep Reinforcement Learning (RL) agents are susceptible to adversarial noise in their observations that can mislead their policies and decrease their performance. However, an adversary may be interested not only in decreasing the reward,…

机器学习 · 计算机科学 2022-12-13 Dennis Gross , Thiago D. Simao , Nils Jansen , Guillermo A. Perez

Recent advances in instruction tuning have led to the development of State-of-the-Art Large Multimodal Models (LMMs). Given the novelty of these models, the impact of visual adversarial attacks on LMMs has not been thoroughly examined. We…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xuanming Cui , Alejandro Aparcedo , Young Kyun Jang , Ser-Nam Lim

Adversarial examples are helpful for analyzing and improving the robustness of text classifiers. Generating high-quality adversarial examples is a challenging task as it requires generating fluent adversarial sentences that are semantically…

计算与语言 · 计算机科学 2022-10-21 Lei Xu , Alfredo Cuesta-Infante , Laure Berti-Equille , Kalyan Veeramachaneni

Recent models have achieved human level performance on the Stanford Question Answering Dataset when using F1 scores to evaluate the reading comprehension task. Yet, teaching machines to comprehend text has not been solved in the general…

计算与语言 · 计算机科学 2024-01-19 Ariel Marcus

Nowadays, we are more and more reliant on Deep Learning (DL) models and thus it is essential to safeguard the security of these systems. This paper explores the security issues in Deep Learning and analyses, through the use of experiments,…

机器学习 · 计算机科学 2022-04-26 Marco Marchetti , Edmond S. L. Ho

Object detection is an important vision task and has emerged as an indispensable component in many vision system, rendering its robustness as an increasingly important performance factor for practical applications. While object detection…

计算机视觉与模式识别 · 计算机科学 2019-07-25 Haichao Zhang , Jianyu Wang

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

计算机视觉与模式识别 · 计算机科学 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

Adversarial attack is commonly regarded as a huge threat to neural networks because of misleading behavior. This paper presents an opposite perspective: adversarial attacks can be harnessed to improve neural models if amended correctly.…

人工智能 · 计算机科学 2023-05-19 Chong Yu , Tao Chen , Zhongxue Gan

A fundamental problem in robust learning is asymmetry: a learner needs to correctly classify every one of exponentially-many perturbations that an adversary might make to a test-time natural example. In contrast, the attacker only needs to…

机器学习 · 计算机科学 2024-02-14 Saba Ahmadi , Avrim Blum , Omar Montasser , Kevin Stangl

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

Deep neural networks are vulnerable to adversarial attacks. The literature is rich with algorithms that can easily craft successful adversarial examples. In contrast, the performance of defense techniques still lags behind. This paper…

机器学习 · 计算机科学 2019-05-29 Yuzhe Yang , Guo Zhang , Dina Katabi , Zhi Xu

The increasing depth of parametric domain knowledge in large language models (LLMs) is fueling their rapid deployment in real-world applications. Understanding model vulnerabilities in high-stakes and knowledge-intensive tasks is essential…

计算与语言 · 计算机科学 2024-12-02 R. Patrick Xian , Alex J. Lee , Satvik Lolla , Vincent Wang , Qiming Cui , Russell Ro , Reza Abbasi-Asl

Current adversarial attack algorithms, where an adversary changes a text to fool a victim model, have been repeatedly shown to be effective against text classifiers. These attacks, however, generally assume that the victim model is…

计算与语言 · 计算机科学 2024-01-17 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

This is Btech thesis report on detection and purification of adverserially attacked images. A deep learning model is trained on certain training examples for various tasks such as classification, regression etc. By training, weights are…

机器学习 · 计算机科学 2022-05-18 Dvij Kalaria

Adversarial example detection plays a vital role in adaptive cyber defense, especially in the face of rapidly evolving attacks. In adaptive cyber defense, the nature and characteristics of attacks continuously change, making it crucial to…

密码学与安全 · 计算机科学 2023-08-31 Atefeh Mahdavi , Neda Keivandarian , Marco Carvalho