English
Related papers

Related papers: Learning the Legibility of Visual Text Perturbatio…

200 papers

Large Vision-Language Models (LVLMs) rely on vision encoders and Large Language Models (LLMs) to exhibit remarkable capabilities on various multi-modal tasks in the joint space of vision and language. However, typographic attacks, which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Hao Cheng , Erjia Xiao , Jindong Gu , Le Yang , Jinhao Duan , Jize Zhang , Jiahang Cao , Kaidi Xu , Renjing Xu

Adversarial attacks have gained traction in order to identify potential vulnerabilities in neural ranking models (NRMs), but current attack methods often introduce grammatical errors, nonsensical expressions, or incoherent text fragments,…

Information Retrieval · Computer Science 2023-05-05 Xuanang Chen , Ben He , Zheng Ye , Le Sun , Yingfei Sun

As machine learning models are increasingly deployed in safety-critical domains, visual explanation techniques have become essential tools for supporting transparency. In this work, we reveal a new class of attacks that compromise model…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Farhin Farhad Riya , Shahinul Hoque , Jinyuan Stella Sun , Olivera Kotevska

The explosive growth of multimodal data has driven the rapid development of multimodal entity linking (MEL) models. However, existing studies have not systematically investigated the impact of visual adversarial attacks on MEL models. We…

Information Retrieval · Computer Science 2025-08-22 Fang Wang , Yongjie Wang , Zonghao Yang , Minghao Hu , Xiaoying Bai

Large Language Models (LLMs) are highly vulnerable to input perturbations, as even a small prompt change may result in a substantially different output. Existing methods to enhance LLM robustness are primarily focused on perturbed data…

Computation and Language · Computer Science 2025-04-04 Aryan Agrawal , Lisa Alazraki , Shahin Honarvar , Marek Rei

While deep learning is remarkably successful on perceptual tasks, it was also shown to be vulnerable to adversarial perturbations of the input. These perturbations denote noise added to the input that was generated specifically to fool the…

Machine Learning · Statistics 2017-08-02 Jan Hendrik Metzen , Mummadi Chaithanya Kumar , Thomas Brox , Volker Fischer

We evaluate machine comprehension models' robustness to noise and adversarial attacks by performing novel perturbations at the character, word, and sentence level. We experiment with different amounts of perturbations to examine model…

Computation and Language · Computer Science 2020-05-04 Winston Wu , Dustin Arendt , Svitlana Volkova

While neural machine translation (NMT) models achieve success in our daily lives, they show vulnerability to adversarial attacks. Despite being harmful, these attacks also offer benefits for interpreting and enhancing NMT models, thus…

Computation and Language · Computer Science 2024-09-10 Yanni Xue , Haojie Hao , Jiakai Wang , Qiang Sheng , Renshuai Tao , Yu Liang , Pu Feng , Xianglong Liu

Deep transformer neural network models have improved the predictive accuracy of intelligent text processing systems in the biomedical domain. They have obtained state-of-the-art performance scores on a wide variety of biomedical and…

Computation and Language · Computer Science 2021-11-17 Milad Moradi , Matthias Samwald

The growth of highly advanced Large Language Models (LLMs) constitutes a huge dual-use problem, making it necessary to create dependable AI-generated text detection systems. Modern detectors are notoriously vulnerable to adversarial…

Cryptography and Security · Computer Science 2025-10-06 Lekkala Sai Teja , Annepaka Yadagiri , Sangam Sai Anish , Siva Gopala Krishna Nuthakki , Partha Pakray

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Text-to-Vis is an emerging task in the natural language processing (NLP) area that aims to automatically generate data visualizations from natural language questions (NLQs). Despite their progress, existing text-to-vis models often heavily…

Computation and Language · Computer Science 2024-04-12 Jinwei Lu , Yuanfeng Song , Haodi Zhang , Chen Zhang , Raymond Chi-Wing Wong

Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU…

Computation and Language · Computer Science 2022-03-01 Xinliang Frederick Zhang

Despite outstanding performance in a variety of NLP tasks, recent studies have revealed that NLP models are vulnerable to adversarial attacks that slightly perturb the input to cause the models to misbehave. Among these attacks, adversarial…

Computation and Language · Computer Science 2024-06-11 Duy C. Hoang , Quang H. Nguyen , Saurav Manchanda , MinLong Peng , Kok-Seng Wong , Khoa D. Doan

Neural Machine Translation (NMT) has achieved significant breakthrough in performance but is known to suffer vulnerability to input perturbations. As real input noise is difficult to predict during training, robustness is a big issue for…

Computation and Language · Computer Science 2021-04-21 Weiwen Xu , Ai Ti Aw , Yang Ding , Kui Wu , Shafiq Joty

Detecting persuasion in argumentative text is a challenging task with important implications for understanding human communication. This work investigates the role of persuasion strategies - such as Attack on reputation, Distraction, and…

Computation and Language · Computer Science 2026-01-16 Tiziano Labruna , Arkadiusz Modzelewski , Giorgio Satta , Giovanni Da San Martino

Recent work has shown that Large Language Models (LLMs) can unintentionally leak sensitive information present in their training data. In this paper, we present Model Perturbations (MoPe), a new method to identify with high confidence if a…

Machine Learning · Computer Science 2023-10-24 Marvin Li , Jason Wang , Jeffrey Wang , Seth Neel

We often use perturbations to regularize neural models. For neural encoder-decoders, previous studies applied the scheduled sampling (Bengio et al., 2015) and adversarial perturbations (Sato et al., 2019) as perturbations but these methods…

Computation and Language · Computer Science 2021-04-06 Sho Takase , Shun Kiyono

We study the problem of learning robust classifiers where the classifier will receive a perturbed input. Unlike robust PAC learning studied in prior work, here the clean data and its label are also adversarially chosen. We formulate this…

Machine Learning · Computer Science 2026-03-02 Sajad Ashkezari

The evaluation of Retrieval-Augmented Generation (RAG) systems typically examines retrieval quality and generation parameters like temperature in isolation, overlooking their interaction. This work presents a systematic investigation of how…

Computation and Language · Computer Science 2026-03-23 Yongxin Zhou , Philippe Mulhem , Didier Schwab