English
Related papers

Related papers: When Vision Fails: Text Attacks Against ViT and OC…

200 papers

Neural models enjoy widespread use across a variety of tasks and have grown to become crucial components of many industrial systems. Despite their effectiveness and extensive popularity, they are not without their exploitable flaws.…

Sound · Computer Science 2019-02-26 Krishan Rajaratnam , Jugal Kalita

Vision-language models (VLMs) can read text from images, but where does this optical character recognition (OCR) information enter the language processing stream? We investigate the OCR routing mechanism across three architecture families…

Computation and Language · Computer Science 2026-05-18 Jonathan Steinberg , Oren Gal

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Pre-trained vision-language models (VLMs) have showcased remarkable performance in image and natural language understanding, such as image captioning and response generation. As the practical applications of vision-language models become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Peng Xie , Yequan Bie , Jianda Mao , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen

Optical character recognition (OCR) has advanced rapidly with the rise of vision-language models, yet evaluation has remained concentrated on a small cluster of high- and mid-resource scripts. We introduce GlotOCR Bench, a comprehensive…

Computation and Language · Computer Science 2026-04-15 Amir Hossein Kargaran , Nafiseh Nikeghbal , Jana Diesner , François Yvon , Hinrich Schütze

There has been a rise in the use of Machine Learning as a Service (MLaaS) Vision APIs as they offer multiple services including pre-built models and algorithms, which otherwise take a huge amount of resources if built from scratch. As these…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Jaydeep Borkar , Pin-Yu Chen

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Recent advances in text-based image editing have enabled fine-grained manipulation of visual content guided by natural language. However, such methods are susceptible to adversarial attacks. In this work, we propose a novel attack that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Matteo Trippodo , Federico Becattini , Lorenzo Seidenari

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

Research shows that natural language processing models are generally considered to be vulnerable to adversarial attacks; but recent work has drawn attention to the issue of validating these adversarial inputs against certain criteria (e.g.,…

Computation and Language · Computer Science 2021-09-10 Maximilian Mozes , Max Bartolo , Pontus Stenetorp , Bennett Kleinberg , Lewis D. Griffin

Deep neural networks have been demonstrated to be vulnerable to adversarial attacks: subtle perturbations can completely change the classification results. Their vulnerability has led to a surge of research in this direction. However, most…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Quanyu Liao , Xin Wang , Bin Kong , Siwei Lyu , Youbing Yin , Qi Song , Xi Wu

Transformer models have excelled in natural language tasks, prompting the vision community to explore their implementation in computer vision problems. However, these models are still influenced by adversarial examples. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jialin Wu , Kaikai Pan , Yanjiao Chen , Jiangyi Deng , Shengyuan Pang , Wenyuan Xu

Taking into account information across the temporal domain helps to improve environment perception in autonomous driving. However, it has not been studied so far whether temporally fused neural networks are vulnerable to deliberately…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Svetlana Pavlitskaya , Nikolai Polley , Michael Weber , J. Marius Zöllner

Neural networks are being applied in many tasks related to IoT with encouraging results. For example, neural networks can precisely detect human, objects and animal via surveillance camera for security purpose. However, neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Dang Duy Thang , Toshihiro Matsui

Deep neural networks are vulnerable to adversarial attacks, such as backdoor attacks in which a malicious adversary compromises a model during training such that specific behaviour can be triggered at test time by attaching a specific word…

Cryptography and Security · Computer Science 2022-10-21 You Guo , Jun Wang , Trevor Cohn

Adversarial examples have recently proven to be able to fool deep learning methods by adding carefully crafted small perturbation to the input space image. In this paper, we study the possibility of generating adversarial examples for…

Machine Learning · Computer Science 2019-07-22 Sobhan Soleymani , Ali Dabouei , Jeremy Dawson , Nasser M. Nasrabadi

Recent work has demonstrated the vulnerability of modern text classifiers to universal adversarial attacks, which are input-agnostic sequences of words added to text processed by classifiers. Despite being successful, the word sequences…

Computation and Language · Computer Science 2021-04-09 Liwei Song , Xinwei Yu , Hsuan-Tung Peng , Karthik Narasimhan

With the rapid development of Artificial Intelligence (AI), the problem of AI security has gradually emerged. Most existing machine learning algorithms may be attacked by adversarial examples. An adversarial example is a slightly modified…

Cryptography and Security · Computer Science 2018-10-19 Yingdi Wang , Wenjia Niu , Tong Chen , Yingxiao Xiang , Jingjing Liu , Gang Li , Jiqiang Liu

The convolutional neural network (CNN) architecture is increasingly being applied to new domains, such as malware detection, where it is able to learn malicious behavior from raw bytes extracted from executables. These architectures reach…

Machine Learning · Computer Science 2019-04-16 Octavian Suciu , Scott E. Coull , Jeffrey Johns

Given the outstanding progress that convolutional neural networks (CNNs) have made on natural image classification and object recognition problems, it is shown that deep learning methods can achieve very good recognition performance on many…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Yingpeng Deng , Lina J. Karam