English
Related papers

Related papers: Exact Adversarial Attack to Image Captioning via S…

200 papers

Most works on adversarial examples for deep-learning based image classifiers use noise that, while small, covers the entire image. We explore the case where the noise is allowed to be visible but confined to a small, localized patch of the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Danny Karmon , Daniel Zoran , Yoav Goldberg

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Adversarial examples are perturbed inputs which can cause a serious threat for machine learning models. Finding these perturbations is such a hard task that we can only use the iterative methods to traverse. For computational efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Xiaofeng Mao , Yuefeng Chen , Yuhong Li , Yuan He , Hui Xue

We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mapping a test image to similar training images in this space and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Pranava Madhyastha , Josiah Wang , Lucia Specia

Deep neural networks (DNNs) have achieved great success in various applications due to their strong expressive power. However, recent studies have shown that DNNs are vulnerable to adversarial examples which are manipulated instances…

Machine Learning · Computer Science 2020-07-06 Haonan Qiu , Chaowei Xiao , Lei Yang , Xinchen Yan , Honglak Lee , Bo Li

In this paper, we propose novel generative models for creating adversarial examples, slightly perturbed images resembling natural images but maliciously crafted to fool pre-trained models. We present trainable deep neural networks for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Omid Poursaeed , Isay Katsman , Bicheng Gao , Serge Belongie

Audio captioning aims at generating natural language descriptions for audio clips automatically. Existing audio captioning models have shown promising improvement in recent years. However, these models are mostly trained via maximum…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-30 Xinhao Mei , Xubo Liu , Jianyuan Sun , Mark D. Plumbley , Wenwu Wang

Automated captioning of photos is a mission that incorporates the difficulties of photo analysis and text generation. One essential feature of captioning is the concept of attention: how to determine what to specify and in which sequence.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Daniel Yarnell , Xian Wang

Recent studies have shown that deep convolutional neural networks (DCNN) are vulnerable to adversarial examples and sensitive to perceptual quality as well as the acquisition condition of images. These findings raise a big concern for the…

Machine Learning · Computer Science 2020-04-15 Yeli Feng , Yiyu Cai

As machine learning systems become more widely used, especially for safety critical applications, there is a growing need to ensure that these systems behave as intended, even in the face of adversarial examples. Adversarial examples are…

Computation and Language · Computer Science 2024-08-19 Anahita Samadi , Allison Sullivan

Neural networks are vulnerable to adversarial attacks -- small visually imperceptible crafted noise which when added to the input drastically changes the output. The most effective method of defending against these adversarial attacks is to…

The problem of identifying voice commands has always been a challenge due to the presence of noise and variability in speed, pitch, etc. We will compare the efficacies of several neural network architectures for the speech recognition…

Machine Learning · Statistics 2020-11-25 Sanjay Krishna Gouda , Salil Kanetkar , David Harrison , Manfred K Warmuth

Neural models enjoy widespread use across a variety of tasks and have grown to become crucial components of many industrial systems. Despite their effectiveness and extensive popularity, they are not without their exploitable flaws.…

Sound · Computer Science 2019-02-26 Krishan Rajaratnam , Jugal Kalita

State-of-the-art deep neural networks have proven to be highly powerful in a broad range of tasks, including semantic image segmentation. However, these networks are vulnerable against adversarial attacks, i.e., non-perceptible…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Kira Maag , Asja Fischer

Many recent studies have shown that deep neural models are vulnerable to adversarial samples: images with imperceptible perturbations, for example, can fool image classifiers. In this paper, we present the first type-specific approach to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Omid Mohamad Nezami , Akshay Chaturvedi , Mark Dras , Utpal Garain

Machine learning models are prone to adversarial attacks, where inputs can be manipulated in order to cause misclassifications. While previous research has focused on techniques like Generative Adversarial Networks (GANs), there's limited…

Cryptography and Security · Computer Science 2024-11-08 Langalibalele Lunga , Suhas Sreehari

Today's text-to-image generative models are trained on millions of images sourced from the Internet, each paired with a detailed caption produced by Vision-Language Models (VLMs). This part of the training pipeline is critical for supplying…

Cryptography and Security · Computer Science 2025-06-30 Stanley Wu , Ronik Bhaskar , Anna Yoo Jeong Ha , Shawn Shan , Haitao Zheng , Ben Y. Zhao

Language Models based on recurrent neural networks have dominated recent image caption generation tasks. In this paper, we introduce a Language CNN model which is suitable for statistical language modeling tasks and shows competitive…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Jiuxiang Gu , Gang Wang , Jianfei Cai , Tsuhan Chen

Deep neural networks (DNNs) have achieved excellent performance on several tasks and have been widely applied in both academia and industry. However, DNNs are vulnerable to adversarial machine learning attacks, in which noise is added to…

Machine Learning · Computer Science 2020-01-01 Huy H. Nguyen , Minoru Kuribayashi , Junichi Yamagishi , Isao Echizen

We present an adversarial framework to craft perturbations that mislead classifiers by accounting for the image content and the semantics of the labels. The proposed framework combines a structure loss and a semantic adversarial loss in a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Ali Shahin Shamsabadi , Changjae Oh , Andrea Cavallaro