English
Related papers

Related papers: D'ARTAGNAN: Counterfactual Video Generation

200 papers

Learning to represent and generate videos from unlabeled data is a very challenging problem. To generate realistic videos, it is important not only to ensure that the appearance of each frame is real, but also to ensure the plausibility of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Katsunori Ohnishi , Shohei Yamamoto , Yoshitaka Ushiku , Tatsuya Harada

This paper proposes a novel approach based on conditional Generative Adversarial Networks (cGAN) for breast mass segmentation in mammography. We hypothesized that the cGAN structure is well-suited to accurately outline the mass area,…

Counterfactual image generation is a powerful tool for augmenting training data, de-biasing datasets, and modeling disease. Current approaches rely on external classifiers or regressors to increase the effectiveness of subject-level…

In this paper, we propose a generative model, Temporal Generative Adversarial Nets (TGAN), which can learn a semantic representation of unlabeled videos, and is capable of generating videos. Unlike existing Generative Adversarial Nets…

Machine Learning · Computer Science 2017-08-21 Masaki Saito , Eiichi Matsumoto , Shunta Saito

Video generation is important, especially in medicine, as much data is given in this form. However, video generation of high-resolution data is a very demanding task for generative models, due to the large need for memory. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2023-11-08 Łukasz Struski , Tomasz Urbańczyk , Krzysztof Bucki , Bartłomiej Cupiał , Aneta Kaczyńska , Przemysław Spurek , Jacek Tabor

Generative adversarial network (GAN) still exists some problems in dealing with speech enhancement (SE) task. Some GAN-based systems adopt the same structure from Pixel-to-Pixel directly without special optimization. The importance of the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-09 Huixiang Huang , Renjie Wu , Jingbiao Huang , Jucai Lin , Jun Yin

This study presents a novel framework for counterfactual user behavior forecasting that combines structural causal models with transformer-based generative artificial intelligence. To model fictitious situations, the method creates causal…

Machine Learning · Computer Science 2025-11-12 Dharmateja Priyadarshi Uddandarao , Ravi Kiran Vadlamani

Cardiovascular diseases (CVDs) remain the leading cause of mortality globally, and echocardiography is critical for diagnosis of both common and congenital cardiac conditions. However, echocardiographic data for certain pathologies are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Kabir Hamzah Muhammad , Marawan Elbatel , Yi Qin , Xiaomeng Li

Deep learning models have demonstrated high-quality performance in areas such as image classification and speech processing. However, creating a deep learning model using electronic health record (EHR) data, requires addressing particular…

Machine Learning · Computer Science 2020-03-06 Amirsina Torfi , Edward A. Fox

We present a VAE architecture for encoding and generating high dimensional sequential data, such as video or audio. Our deep generative model learns a latent representation of the data which is split into a static and dynamic part, allowing…

Machine Learning · Computer Science 2018-06-13 Yingzhen Li , Stephan Mandt

Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations. Motivated by the symmetric prior that the lesions on one side of breasts rarely appear in the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Chu-ran Wang , Jing Li , Fandong Zhang , Xinwei Sun , Hao Dong , Yizhou Yu , Yizhou Wang

We propose an interactive methodology for generating counterfactual explanations for univariate time series data in classification tasks by leveraging 2D projections and decision boundary maps to tackle interpretability challenges. Our…

Machine Learning · Computer Science 2024-08-21 Udo Schlegel , Julius Rauscher , Daniel A. Keim

Knowledge of what spatial elements of medical images deep learning methods use as evidence is important for model interpretability, trustiness, and validation. There is a lack of such techniques for models in regression tasks. We propose a…

Image and Video Processing · Electrical Eng. & Systems 2020-07-27 Ricardo Bigolin Lanfredi , Joyce D. Schroeder , Clement Vachet , Tolga Tasdizen

Synthetic data generation becomes prevalent as a solution to privacy leakage and data shortage. Generative models are designed to generate a realistic synthetic dataset, which can precisely express the data distribution for the real…

Machine Learning · Computer Science 2021-04-22 Bingyang Wen , Luis Oliveros Colon , K. P. Subbalakshmi , R. Chandramouli

The sharing of medical imaging datasets between institutions, and even inside the same institution, is limited by various regulations/legal barriers. Although these limitations are necessities for protecting patient privacy and setting…

Image and Video Processing · Electrical Eng. & Systems 2020-03-03 Engin Dikici , Luciano M. Prevedello , Matthew Bigelow , Richard D. White , Barbaros Selnur Erdal

Flow-matching video generators produce temporally coherent, high-fidelity outputs yet routinely violate elementary physics because their reconstruction objectives penalize per-frame deviations without distinguishing physically consistent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Abolfazl Meyarian , Amin Karimi Monsefi , Rajiv Ramnath , Ser-Nam Lim

In recent years, convolutional neural networks have demonstrated promising performance in a variety of medical image segmentation tasks. However, when a trained segmentation model is deployed into the real clinical world, the model may not…

Image and Video Processing · Electrical Eng. & Systems 2020-12-24 Shuo Wang , Giacomo Tarroni , Chen Qin , Yuanhan Mo , Chengliang Dai , Chen Chen , Ben Glocker , Yike Guo , Daniel Rueckert , Wenjia Bai

Cardiac imaging known as echocardiography is a non-invasive tool utilized to produce data including images and videos, which cardiologists use to diagnose cardiac abnormalities in general and myocardial infarction (MI) in particular.…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Oumaima Hamila , Sheela Ramanna , Christopher J. Henry , Serkan Kiranyaz , Ridha Hamila , Rashid Mazhar , Tahir Hamid

Deep neural networks can generate images that are astonishingly realistic, so much so that it is often hard for humans to distinguish them from actual photos. These achievements have been largely made possible by Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Joel Frank , Thorsten Eisenhofer , Lea Schönherr , Asja Fischer , Dorothea Kolossa , Thorsten Holz

Healthcare artificial intelligence systems often degrade in performance when deployed across institutions, with documented performance drops and perpetuation of discriminatory patterns embedded in data. This brittleness comes, in part, from…

Machine Learning · Computer Science 2026-03-30 Munib Mesinovic , Max Buhlan , Tingting Zhu