English
Related papers

Related papers: Benchmarking Counterfactual Image Generation

200 papers

Natural language counterfactual generation aims to minimally modify a given text such that the modified text will be classified into a different class. The generated counterfactuals provide insight into the reasoning behind a model's…

Computation and Language · Computer Science 2024-10-08 Yongjie Wang , Xiaoqi Qiu , Yu Yue , Xu Guo , Zhiwei Zeng , Yuhong Feng , Zhiqi Shen

Evaluation of AI systems often requires synthetic test cases, particularly for rare or safety-critical conditions that are difficult to observe in operational data. Generative AI offers a promising approach for producing such data through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Damian J. Ruck , Paul Vautravers , Oliver Chalkley , Jake Thomas

The ability of image and video generation models to create photorealistic images has reached unprecedented heights, making it difficult to distinguish between real and fake images in many cases. However, despite this progress, a gap remains…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Ali Borji

Computer vision systems have been deployed in various applications involving biometrics like human faces. These systems can identify social media users, search for missing persons, and verify identity of individuals. While computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Guruprasad V Ramesh , Harrison Rosenberg , Ashish Hooda , Shimaa Ahmed Kassem Fawaz

Due to the significant advancement of Natural Language Processing and Computer Vision-based models, Visual Question Answering (VQA) systems are becoming more intelligent and advanced. However, they are still error-prone when dealing with…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Zeyd Boukhers , Timo Hartmann , Jan Jürjens

Counterfactual explanations provide a potentially significant solution to the Explainable AI (XAI) problem, but good, native counterfactuals have been shown to rarely occur in most datasets. Hence, the most popular methods generate…

Artificial Intelligence · Computer Science 2021-01-25 Barry Smyth , Mark T Keane

Recently, a groundswell of research has identified the use of counterfactual explanations as a potentially significant solution to the Explainable AI (XAI) problem. It is argued that (a) technically, these counterfactual cases can be…

Artificial Intelligence · Computer Science 2020-05-29 Mark T. Keane , Barry Smyth

Counterfactual image generation presents significant challenges, including preserving identity, maintaining perceptual quality, and ensuring faithfulness to an underlying causal model. While existing auto-encoding frameworks admit semantic…

Machine Learning · Computer Science 2025-06-10 Rajat Rasal , Avinash Kori , Fabio De Sousa Ribeiro , Tian Xia , Ben Glocker

While counterfactual data augmentation offers a promising step towards robust generalization in natural language processing, producing a set of counterfactuals that offer valuable inductive bias for models remains a challenge. Most existing…

Computation and Language · Computer Science 2022-10-25 Phillip Howard , Gadi Singer , Vasudev Lal , Yejin Choi , Swabha Swayamdipta

The misuse of AI imagery can have harmful societal effects, prompting the creation of detectors to combat issues like the spread of fake news. Existing methods can effectively detect images generated by seen generators, but it is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Mingjian Zhu , Hanting Chen , Mouxiao Huang , Wei Li , Hailin Hu , Jie Hu , Yunhe Wang

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text prompts or spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

When an image classifier outputs a wrong class label, it can be helpful to see what changes in the image would lead to a correct classification. This is the aim of algorithms generating counterfactual explanations. However, there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Benedikt Höltgen , Lisa Schut , Jan M. Brauner , Yarin Gal

Counterfactuals have been established as a popular explainability technique which leverages a set of minimal edits to alter the prediction of a classifier. When considering conceptual counterfactuals on images, the edits requested should…

Machine Learning · Computer Science 2024-05-06 Angeliki Dimitriou , Nikolaos Chaidos , Maria Lymperaiou , Giorgos Stamou

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Yiran Xu , Badour AlBahar , Jia-Bin Huang

What exactly makes a particular image unsafe? Systematically differentiating between benign and problematic images is a challenging problem, as subtle changes to an image, such as an insulting gesture or symbol, can drastically alter its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Alec Helbling , Shruti Palaskar , Kundan Krishna , Polo Chau , Leon Gatys , Joseph Yitan Cheng

Ascription of an image gives insights into the objects that influence the classification of the whole image or its pixels towards a specific category. These insights help radiologists to visualize deformities in medical imaging. Most of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Shakeeb Murtaza

Synthetic image generation has opened up new opportunities but has also created threats in regard to privacy, authenticity, and security. Detecting fake images is of paramount importance to prevent illegal activities, and previous research…

Computer Vision and Pattern Recognition · Computer Science 2023-02-27 Md Awsafur Rahman , Bishmoy Paul , Najibul Haque Sarker , Zaber Ibn Abdul Hakim , Shaikh Anowarul Fattah

The advent of AI has influenced many aspects of human life, from self-driving cars and intelligent chatbots to text-based image and video generation models capable of creating realistic images and videos based on user prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Abhijay Ghildyal , Yuanhan Chen , Saman Zadtootaghaj , Nabajeet Barman , Alan C. Bovik

In this paper, we demonstrate the feasibility of alterfactual explanations for black box image classifiers. Traditional explanation mechanisms from the field of Counterfactual Thinking are a widely-used paradigm for Explainable Artificial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Silvan Mertes , Tobias Huber , Christina Karle , Katharina Weitz , Ruben Schlagowski , Cristina Conati , Elisabeth André

Recent work on counterfactual visual explanations has contributed to making artificial intelligence models more explainable by providing visual perturbation to flip the prediction. However, these approaches neglect the causal relationships…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yiran Qiao , Disheng Liu , Yiren Lu , Yu Yin , Mengnan Du , Jing Ma