中文
相关论文

相关论文: Adversarial Robustness for Unified Multi-Modal Enc…

200 篇论文

Learning multi-modal representations is an essential step towards real-world robotic applications, and various multi-modal fusion models have been developed for this purpose. However, we observe that existing models, whose objectives are…

机器学习 · 计算机科学 2021-06-22 Chenzhuang Du , Tingle Li , Yichen Liu , Zixin Wen , Tianyu Hua , Yue Wang , Hang Zhao

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

机器学习 · 计算机科学 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

In communication systems, there are many tasks, like modulation recognition, which rely on Deep Neural Networks (DNNs) models. However, these models have been shown to be susceptible to adversarial perturbations, namely imperceptible…

信号处理 · 电气工程与系统科学 2021-05-31 Javier Maroto , Gérôme Bovet , Pascal Frossard

Adversarial attacks exploit vulnerabilities in a model's decision boundaries through small, carefully crafted perturbations that lead to significant mispredictions. In 3D vision, the high dimensionality and sparsity of data greatly expand…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Nastaran Darabi , Dinithi Jayasuriya , Devashri Naik , Theja Tulabandhula , Amit Ranjan Trivedi

Multi-modal foundation models like OpenFlamingo, LLaVA, and GPT-4 are increasingly used for various real-world tasks. Prior work has shown that these models are highly vulnerable to adversarial attacks on the vision modality. These attacks…

机器学习 · 计算机科学 2024-06-06 Christian Schlarmann , Naman Deep Singh , Francesco Croce , Matthias Hein

Multimodal recommender systems exploit visual and textual signals to alleviate data sparsity, but this also makes them more vulnerable to evasion-based promotion attacks. Existing defenses are largely limited to single-modal settings and…

机器学习 · 计算机科学 2026-05-08 Guanmeng Xian , Ning Yang , Philip S. Yu

Modern neural networks are expected to simultaneously satisfy a host of desirable properties: accurate fitting to training data, generalization to unseen inputs, parameter and computational efficiency, and robustness to adversarial…

机器学习 · 计算机科学 2025-10-20 Melih Barsbey , Antônio H. Ribeiro , Umut Şimşekli , Tolga Birdal

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

机器学习 · 计算机科学 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

机器学习 · 计算机科学 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

机器学习 · 计算机科学 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

机器学习 · 计算机科学 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

Machine learning and deep learning in particular has been recently used to successfully address many tasks in the domain of code such as finding and fixing bugs, code completion, decompilation, type inference and many others. However, the…

机器学习 · 计算机科学 2020-08-18 Pavol Bielik , Martin Vechev

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

机器学习 · 计算机科学 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Deep neural networks have been shown to perform poorly on adversarial examples. To address this, several techniques have been proposed to increase robustness of a model for image classification tasks. However, in video understanding tasks,…

计算机视觉与模式识别 · 计算机科学 2021-10-28 Divya Choudhary , Palash Goyal , Saurabh Sahu

Multi-modal learning relates information across observation modalities of the same physical phenomenon to leverage complementary information. Most multi-modal machine learning methods require that all the modalities used for training are…

机器学习 · 计算机科学 2021-03-10 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

The modern digital world is increasingly becoming multimodal. Although multimodal learning has recently revolutionized the state-of-the-art performance in multimodal tasks, relatively little is known about the robustness of multimodal…

机器学习 · 计算机科学 2021-12-30 Nishant Vishwamitra , Hongxin Hu , Ziming Zhao , Long Cheng , Feng Luo

Vision Language Models adapt well to downstream tasks but are highly vulnerable to adversarial perturbations that disrupt cross-modal semantic alignment. Existing defenses are largely unidirectional or structural, failing to exploit…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Xiao Liu , Jiaxiang Liu , Boci Peng , Boren Hu , Yusong Wang , Xiwen Chen , Prayag Tiwari , Liming Zhang , Mingkun Xu

Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Fan Yang , Mingxuan Xia , Sangzhou Xia , Chicheng Ma , Hui Hui

Adversarial robustness corresponds to the susceptibility of deep neural networks to imperceptible perturbations made at test time. In the context of image tasks, many algorithms have been proposed to make neural networks robust to…

计算机视觉与模式识别 · 计算机科学 2020-12-03 Pranjal Awasthi , George Yu , Chun-Sung Ferng , Andrew Tomkins , Da-Cheng Juan

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang