English
Related papers

Related papers: Benchmarking Counterfactual Image Generation

200 papers

Counterfactual generation lies at the core of various machine learning tasks, including image translation and controllable text generation. This generation process usually requires the identification of the disentangled latent…

Machine Learning · Computer Science 2024-02-26 Hanqi Yan , Lingjing Kong , Lin Gui , Yuejie Chi , Eric Xing , Yulan He , Kun Zhang

Counterfactual text generation aims to minimally change a text, such that it is classified differently. Judging advancements in method development for counterfactual text generation is hindered by a non-uniform usage of data sets and…

Computation and Language · Computer Science 2024-08-14 Van Bach Nguyen , Jörg Schlötterer , Christin Seifert

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

Recent black-box counterfactual generation frameworks fail to take into account the semantic content of the proposed edits, while relying heavily on training to guide the generation process. We propose a novel, plug-and-play black-box…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Nikolaos Spanos , Maria Lymperaiou , Giorgos Filandrianos , Konstantinos Thomas , Athanasios Voulodimos , Giorgos Stamou

In recent years, visual forgery has reached a level of sophistication that humans cannot identify fraud, which poses a significant threat to information security. A wide range of malicious applications have emerged, such as fake news,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Minh Tam Pham , Thanh Trung Huynh , Van Vinh Tong , Thanh Tam Nguyen , Thanh Thi Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

Machine Learning · Computer Science 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

The proliferation of generative models, such as Generative Adversarial Networks (GANs), Diffusion Models, and Variational Autoencoders (VAEs), has enabled the synthesis of high-quality multimedia data. However, these advancements have also…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Arpan Mahara , Naphtali Rishe

We study how to generate captions that are not only accurate in describing an image but also discriminative across different images. The problem is both fundamental and interesting, as most machine-generated captions, despite phenomenal…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Dianqi Li , Qiuyuan Huang , Xiaodong He , Lei Zhang , Ming-Ting Sun

The rapid advancements in generative AI technologies, such as Stable Diffusion, DALL-E, and Midjourney, have significantly transformed the creation of synthetic visual content. While these models enable innovation across industries, they…

Variational autoencoders (VAEs) and other generative methods have garnered growing interest not just for their generative properties but also for the ability to dis-entangle a low-dimensional latent variable space. However, few existing…

Machine Learning · Computer Science 2023-02-14 Sunay Bhat , Jeffrey Jiang , Omead Pooladzandi , Gregory Pottie

With the rapid proliferation of image generative models, the authenticity of digital images has become a significant concern. While existing studies have proposed various methods for detecting AI-generated content, current benchmarks are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Huixuan Zhang , Xiaojun Wan

While modern visual generation models excel at creating aesthetically pleasing natural images, they struggle with producing or editing structured visuals like charts, diagrams, and mathematical figures, which demand composition planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Le Zhuo , Songhao Han , Yuandong Pu , Boxiang Qiu , Sayak Paul , Yue Liao , Yihao Liu , Jie Shao , Xi Chen , Si Liu , Hongsheng Li

We present a general causal generative modelling framework for accurate estimation of high fidelity image counterfactuals with deep structural causal models. Estimation of interventional and counterfactual queries for high-dimensional…

Machine Learning · Computer Science 2023-07-19 Fabio De Sousa Ribeiro , Tian Xia , Miguel Monteiro , Nick Pawlowski , Ben Glocker

The extraordinary ability of generative models enabled the generation of images with such high quality that human beings cannot distinguish Artificial Intelligence (AI) generated images from real-life photographs. The development of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yan Hong , Jianfu Zhang

Visual counterfactual explanations identify modifications to an image that would change the prediction of a classifier. We propose a set of techniques based on generative models (VAE) and a classifier ensemble directly trained in the latent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Claire Theobald , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro , Amedeo Napoli

Generative AI models can produce high-quality images based on text prompts. The generated images often appear indistinguishable from images generated by conventional optical photography devices or created by human artists (i.e., real…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Yuying Li , Zeyan Liu , Junyi Zhao , Liangqin Ren , Fengjun Li , Jiebo Luo , Bo Luo

In the domain of Visual Question Answering (VQA), studies have shown improvement in users' mental model of the VQA system when they are exposed to examples of how these systems answer certain Image-Question (IQ) pairs. In this work, we show…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Kamran Alipour , Arijit Ray , Xiao Lin , Michael Cogswell , Jurgen P. Schulze , Yi Yao , Giedrius T. Burachas

The extraordinary ability of generative models to generate photographic images has intensified concerns about the spread of disinformation, thereby leading to the demand for detectors capable of distinguishing between AI-generated fake…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Mingjian Zhu , Hanting Chen , Qiangyu Yan , Xudong Huang , Guanyu Lin , Wei Li , Zhijun Tu , Hailin Hu , Jie Hu , Yunhe Wang

The rapid advancements in AI technologies have revolutionized the production of graphical content across various sectors, including entertainment, advertising, and e-commerce. These developments have spurred the need for robust evaluation…

Human-Computer Interaction · Computer Science 2024-09-04 Memoona Aziz , Umair Rehman , Syed Ali Safi , Amir Zaib Abbasi

With advances in generative artificial intelligence (AI), it is now possible to produce realistic-looking automated reports for preliminary reads of radiology images. This can expedite clinical workflows, improve accuracy and reduce overall…

Artificial Intelligence · Computer Science 2025-06-03 Razi Mahmood , Diego Machado Reyes , Ge Wang , Mannudeep Kalra , Pingkun Yan