English
Related papers

Related papers: Are VQA Systems RAD? Measuring Robustness to Augme…

200 papers

We present a causal view on the robustness of neural networks against input manipulations, which applies not only to traditional classification tasks but also to general measurement data. Based on this view, we design a deep causal…

Machine Learning · Computer Science 2021-02-11 Cheng Zhang , Kun Zhang , Yingzhen Li

Advancing defensive mechanisms against adversarial attacks in generative models is a critical research topic in machine learning. Our study focuses on a specific type of generative models - Variational Auto-Encoders (VAEs). Contrary to…

Despite significant success in Visual Question Answering (VQA), VQA models have been shown to be notoriously brittle to linguistic variations in the questions. Due to deficiencies in models and datasets, today's models often rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Vedika Agarwal , Rakshith Shetty , Mario Fritz

As the use of deep neural networks continues to grow, understanding their behaviour has become more crucial than ever. Post-hoc explainability methods are a potential solution, but their reliability is being called into question. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Lenka Tětková , Lars Kai Hansen

Determining the robustness of deep learning models is an established and ongoing challenge within automated decision-making systems. With the advent and success of techniques that enable advanced deep learning (DL), these models are being…

Machine Learning · Computer Science 2024-12-16 Zhijin Lyu , Yutong Jin , Sneha Das

In the realm of visual recognition, data augmentation stands out as a pivotal technique to amplify model robustness. Yet, a considerable number of existing methodologies lean heavily on heuristic foundations, rendering their intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Zhendong Liu , Jie Zhang , Qiangqiang He , Chongjun Wang

Q-learning algorithms are appealing for real-world applications due to their data-efficiency, but they are very prone to overfitting and training instabilities when trained from visual observations. Prior work, namely SVEA, finds that…

Machine Learning · Computer Science 2024-07-17 Abdulaziz Almuzairee , Nicklas Hansen , Henrik I. Christensen

Data augmentation (DA) is a crucial technique for enhancing the sample efficiency of visual reinforcement learning (RL) algorithms. Notably, employing simple observation transformations alone can yield outstanding performance without extra…

Machine Learning · Computer Science 2023-10-30 Guozheng Ma , Linrui Zhang , Haoyu Wang , Lu Li , Zilin Wang , Zhen Wang , Li Shen , Xueqian Wang , Dacheng Tao

Despite significant progress having been made in question answering on tabular data (Table QA), it's unclear whether, and to what extent existing Table QA models are robust to task-specific perturbations, e.g., replacing key question…

Computation and Language · Computer Science 2023-06-27 Yilun Zhao , Chen Zhao , Linyong Nan , Zhenting Qi , Wenlin Zhang , Xiangru Tang , Boyu Mi , Dragomir Radev

Visual question answering (VQA) systems face significant challenges when adapting to real-world data shifts, especially in multi-modal contexts. While robust fine-tuning strategies are essential for maintaining performance across…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chengyue Huang , Brisa Maneechotesuwan , Shivang Chopra , Zsolt Kira

Machine learning models are prone to capturing the spurious correlations between non-causal attributes and classes, with counterfactual data augmentation being a promising direction for breaking these spurious associations. However,…

Machine Learning · Computer Science 2025-07-11 Xiaoling Zhou , Ou Wu , Michael K. Ng

Image Quality Assessment (IQA) models are increasingly relied upon to evaluate image quality in real-world systems -- from compression and enhancement to generation and streaming. Yet their adoption brings a fundamental risk: these models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Igor Meleshin , Anna Chistyakova , Anastasia Antsiferova , Dmitriy Vatolin

Random data augmentations (RDAs) are state of the art regarding practical graph neural networks that are provably universal. There is great diversity regarding terminology, methodology, benchmarks, and evaluation metrics used among existing…

Machine Learning · Computer Science 2022-03-22 Billy Joe Franks , Markus Anders , Marius Kloft , Pascal Schweitzer

Table Question Answering (TQA) aims at composing an answer to a question based on tabular data. While prior research has shown that TQA models lack robustness, understanding the underlying cause and nature of this issue remains…

Computation and Language · Computer Science 2024-04-30 Wei Zhou , Mohsen Mesgar , Heike Adel , Annemarie Friedrich

On the way towards general Visual Question Answering (VQA) systems that are able to answer arbitrary questions, the need arises for evaluation beyond single-metric leaderboards for specific datasets. To this end, we propose a browser-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Dirk Väth , Pascal Tilli , Ngoc Thang Vu

Data augmentation (DA) has gained widespread popularity in deep speaker models due to its ease of implementation and significant effectiveness. It enriches training data by simulating real-life acoustic variations, enabling deep neural…

Sound · Computer Science 2024-02-07 Zhenyu Zhou , Junhui Chen , Namin Wang , Lantian Li , Dong Wang

Recent work has shown that data augmentation has the potential to significantly improve the generalization of deep learning models. Recently, automated augmentation strategies have led to state-of-the-art results in image classification and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Ekin D. Cubuk , Barret Zoph , Jonathon Shlens , Quoc V. Le

While agents trained by Reinforcement Learning (RL) can solve increasingly challenging tasks directly from visual observations, generalizing learned skills to novel environments remains very challenging. Extensive use of data augmentation…

Machine Learning · Computer Science 2021-12-10 Nicklas Hansen , Hao Su , Xiaolong Wang

Robustness against noisy imaging is crucial for practical image anomaly detection systems. This study introduces a Robust Anomaly Detection (RAD) dataset with free views, uneven illuminations, and blurry collections to systematically…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuqi Cheng , Yunkang Cao , Rui Chen , Weiming Shen

The online caching problem aims to minimize cache misses when serving a sequence of requests under a limited cache size. While naive learning-augmented caching algorithms achieve ideal $1$-consistency, they lack robustness guarantees.…

Data Structures and Algorithms · Computer Science 2025-11-17 Peng Chen , Hailiang Zhao , Jiaji Zhang , Xueyan Tang , Yixuan Wang , Shuiguang Deng