English
Related papers

Related papers: AI Safety in Practice: Enhancing Adversarial Robus…

200 papers

Image captioning, an important vision-language task, often requires a tremendous number of finely labeled image-caption pairs for learning the underlying alignment between images and texts. In this paper, we proposed a multimodal data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Changrong Xiao , Sean Xin Xu , Kunpeng Zhang

Vision-Language Models (VLMs) have witnessed a surge in both research and real-world applications. However, as they are becoming increasingly prevalent, ensuring their robustness against adversarial attacks is paramount. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Rishika Bhagwatkar , Shravan Nayak , Reza Bayat , Alexis Roger , Daniel Z Kaplan , Pouya Bashivan , Irina Rish

Multimodal Machine Learning systems, particularly those aligning text and image data like CLIP/BLIP models, have become increasingly prevalent, yet remain susceptible to adversarial attacks. While substantial research has addressed…

Machine Learning · Computer Science 2025-01-31 Minh Vu , Geigh Zollicoffer , Huy Mai , Ben Nebgen , Boian Alexandrov , Manish Bhattarai

Keyless entry systems in cars are adopting neural networks for localizing its operators. Using test-time adversarial defences equip such systems with the ability to defend against adversarial attacks without prior training on adversarial…

Machine Learning · Computer Science 2022-11-14 Abhiram Kolli , Muhammad Jehanzeb Mirza , Horst Possegger , Horst Bischof

Adversarial noise introduces small perturbations in images, misleading deep learning models into misclassification and significantly impacting recognition accuracy. In this study, we analyzed the effects of Fast Gradient Sign Method (FGSM)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Manish Kansana , Keyan Alexander Rahimi , Elias Hossain , Iman Dehzangi , Noorbakhsh Amiri Golilarz

In recent years, it has been found that neural networks can be easily fooled by adversarial examples, which is a potential safety hazard in some safety-critical applications. Many researchers have proposed various method to make neural…

Machine Learning · Computer Science 2018-04-24 Shuangtao Li , Yuanke Chen , Yanlin Peng , Lin Bai

The success of multimodal data fusion in deep learning appears to be attributed to the use of complementary in-formation between multiple input data. Compared to their predictive performance, relatively less attention has been devoted to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Youngjoon Yu , Hong Joo Lee , Byeong Cheon Kim , Jung Uk Kim , Yong Man Ro

Adversarial robustness evaluates the worst-case performance scenario of a machine learning model to ensure its safety and reliability. This study is the first to investigate the robustness of visually grounded dialog models towards textual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Lu Yu , Verena Rieser

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Adversarial attacks have been fairly explored for computer vision and vision-language models. However, the avenue of adversarial attack for the vision language segmentation models (VLSMs) is still under-explored, especially for medical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Anjila Budathoki , Manish Dhakal

The notion of adversarial attacks on image classification models based on convolutional neural networks (CNN) is introduced in this work. To classify images, deep learning models called CNNs are frequently used. However, when the networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jaydip Sen , Abhiraj Sen , Ananda Chatterjee

The rapid advancement of generative image technology has introduced significant security concerns, particularly in the domain of face generation detection. This paper investigates the vulnerabilities of current AI-generated face detection…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sun Haoxuan , Hong Yan , Zhan Jiahui , Chen Haoxing , Lan Jun , Zhu Huijia , Wang Weiqiang , Zhang Liqing , Zhang Jianfu

In this paper, we delve into the susceptibility of federated medical image analysis systems to adversarial attacks. Our analysis uncovers a novel exploitation avenue: using gradient information from prior global model updates, adversaries…

Machine Learning · Computer Science 2023-10-24 Erfan Darzi , Florian Dubost , Nanna. M. Sijtsema , P. M. A van Ooijen

An ever-growing body of work has demonstrated the rich information content available in eye movements for user modelling, e.g. for predicting users' activities, cognitive processes, or even personality traits. We show that state-of-the-art…

Cryptography and Security · Computer Science 2020-06-02 Inken Hagestedt , Michael Backes , Andreas Bulling

Context:With the advancement of artificial intelligence (AI) technology and applications, numerous AI models have been developed, leading to the emergence of open-source model hosting platforms like Hugging Face (HF). Thanks to these…

Software Engineering · Computer Science 2024-08-07 Hao Qin , Mingyang Li , Junjie Wang , Qing Wang

This paper explores the use of adversarial examples in training speech recognition systems to increase robustness of deep neural network acoustic models. During training, the fast gradient sign method is used to generate adversarial…

Computation and Language · Computer Science 2018-06-19 Sining Sun , Ching-Feng Yeh , Mari Ostendorf , Mei-Yuh Hwang , Lei Xie

Multimodal learning involves developing models that can integrate information from various sources like images and texts. In this field, multimodal text generation is a crucial aspect that involves processing data from multiple modalities…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Youze Wang , Wenbo Hu , Richang Hong

Many adversarial attack methods achieve satisfactory attack success rates under the white-box setting, but they usually show poor transferability when attacking other DNN models. Momentum-based attack is one effective method to improve…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Guoqiu Wang , Huanqian Yan , Xingxing Wei

AI models are increasingly deployed in cloud-native environments to support scalable and automated services. However, while platforms such as Kubernetes provide strong infrastructure orchestration, security mechanisms specifically designed…

Cryptography and Security · Computer Science 2026-05-18 Stavros Bouras , Ioannis Korontanis , Antonios Makris , Konstantinos Tserpes

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen