English
Related papers

Related papers: Are VQA Systems RAD? Measuring Robustness to Augme…

200 papers

Visual-Language-Action (VLA) models report impressive success rates on robotic manipulation benchmarks, yet these results may mask fundamental weaknesses in robustness. We perform a systematic vulnerability analysis by introducing…

Certified robustness guarantee gauges a model's robustness to test-time attacks and can assess the model's readiness for deployment in the real world. In this work, we critically examine how the adversarial robustness guarantees from…

Machine Learning · Computer Science 2021-12-02 Jiachen Sun , Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Dan Hendrycks , Jihun Hamm , Z. Morley Mao

Visual Question Answering (VQA) requires AI models to comprehend data in two domains, vision and text. Current state-of-the-art models use learned attention mechanisms to extract relevant information from the input domains to answer a…

Artificial Intelligence · Computer Science 2019-03-27 Ahmed Osman , Wojciech Samek

Counterfactual explanation generation is a powerful method for Explainable Artificial Intelligence. It can help users understand why machine learning models make specific decisions, and how to change those decisions. Evaluating the…

Machine Learning · Computer Science 2024-06-03 Ao Xu , Tieru Wu

Pretrained language models (PLMs) perform poorly under adversarial attacks. To improve the adversarial robustness, adversarial data augmentation (ADA) has been widely adopted to cover more search space of adversarial attacks by adding…

Computation and Language · Computer Science 2021-06-08 Chenglei Si , Zhengyan Zhang , Fanchao Qi , Zhiyuan Liu , Yasheng Wang , Qun Liu , Maosong Sun

As more and more artificial intelligence (AI) technologies move from the laboratory to real-world applications, the open-set and robustness challenges brought by data from the real world have received increasing attention. Data augmentation…

Machine Learning · Computer Science 2022-12-09 Zhendong Liu , Wenyu Jiang , Min guo , Chongjun Wang

Robust Optimization has traditionally taken a pessimistic, or worst-case viewpoint of uncertainty which is motivated by a desire to find sets of optimal policies that maintain feasibility under a variety of operating conditions. In this…

Machine Learning · Statistics 2017-11-22 Matthew Norton , Akiko Takeda , Alexander Mafusalov

Data augmentation (DA) is an essential technique for training state-of-the-art deep learning systems. In this paper, we empirically show data augmentation might introduce noisy augmented examples and consequently hurt the performance on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Chengyue Gong , Dilin Wang , Meng Li , Vikas Chandra , Qiang Liu

The generalization capability of deepfake detectors is critical for real-world use. Data augmentation via synthetic fake face generation effectively enhances generalization, yet current SoTA methods rely on fixed strategies-raising a key…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuxuan Zhou , Tao Yu , Wen Huang , Yuheng Zhang , Tao Dai , Shu-Tao Xia

Deep neural networks have emerged as very successful tools for image restoration and reconstruction tasks. These networks are often trained end-to-end to directly reconstruct an image from a noisy or corrupted measurement of that image. To…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Zalan Fabian , Reinhard Heckel , Mahdi Soltanolkotabi

Graph-based Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs), improving their factual accuracy, adaptability, interpretability, and trustworthiness. A number of…

Information Retrieval · Computer Science 2026-04-28 Yingli Zhou , Yaodong Su , Youran Sun , Shu Wang , Taotao Wang , Runyuan He , Yongwei Zhang , Sicong Liang , Xilin Liu , Yuchi Ma , Yixiang Fang

Deep neural network based question answering (QA) models are neither robust nor explainable in many cases. For example, a multiple-choice QA model, tested without any input of question, is surprisingly "capable" to predict the most of…

Computation and Language · Computer Science 2020-10-13 Sicheng Yu , Yulei Niu , Shuohang Wang , Jing Jiang , Qianru Sun

Visual question answering (VQA) models have been shown to over-rely on linguistic biases in VQA datasets, answering questions "blindly" without considering visual context. Adversarial regularization (AdvReg) aims to address this issue via…

Machine Learning · Computer Science 2019-06-21 Gabriel Grand , Yonatan Belinkov

Machine unlearning poses the challenge of ``how to eliminate the influence of specific data from a pretrained model'' in regard to privacy concerns. While prior research on approximated unlearning has demonstrated accuracy and efficiency in…

Machine Learning · Computer Science 2025-04-21 Khoa Tran , Simon S. Woo

Healthcare data often come from multiple sites in which the correlations between confounding variables can vary widely. If deep learning models exploit these unstable correlations, they might fail catastrophically in unseen sites. Although…

Machine Learning · Computer Science 2023-10-25 Minh Nguyen , Alan Q. Wang , Heejong Kim , Mert R. Sabuncu

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved from a knowledge base. However, its effectiveness is fundamentally constrained by the reliability of both the retriever…

Computation and Language · Computer Science 2025-01-31 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Qingyao Ai

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

The observation that computer vision methods overfit to dataset specifics has inspired diverse attempts to make object recognition models robust to domain shifts. However, similar work on domain-robust visual question answering methods is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Mingda Zhang , Tristan Maidment , Ahmad Diab , Adriana Kovashka , Rebecca Hwa

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations…

With the increase in deep learning, it becomes increasingly difficult to understand the model in which AI systems can identify objects. Thus, an adversary could aim to modify an image by adding unseen elements, which will confuse the AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Jonathon Fox , William J Buchanan , Pavlos Papadopoulos