English
Related papers

Related papers: Using Deep Image Priors to Generate Counterfactual…

200 papers

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

In this work, we propose an introspection technique for deep neural networks that relies on a generative model to instigate salient editing of the input image for model interpretation. Such modification provides the fundamental…

Machine Learning · Computer Science 2019-07-09 Shusen Liu , Bhavya Kailkhura , Donald Loveland , Yong Han

Trained generative models have shown remarkable performance as priors for inverse problems in imaging -- for example, Generative Adversarial Network priors permit recovery of test images from 5-10x fewer measurements than sparsity priors.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Muhammad Asim , Mara Daniels , Oscar Leong , Ali Ahmed , Paul Hand

Self-supervised image denoising methods have garnered significant research attention in recent years, for this kind of method reduces the requirement of large training datasets. Compared to supervised methods, self-supervised methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Hanze Liu , Jiahong Fu , Qi Xie , Deyu Meng

Recent advances in deep learning-based medical image registration have shown that training deep neural networks~(DNNs) does not necessarily require medical images. Previous work showed that DNNs trained on randomly generated images with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Junyu Chen , Shuwen Wei , Yihao Liu , Aaron Carass , Yong Du

A broad class of problems at the core of computational imaging, sensing, and low-level computer vision reduces to the inverse problem of extracting latent images that follow a prior distribution, from measurements taken under a known…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Steven Diamond , Vincent Sitzmann , Felix Heide , Gordon Wetzstein

Counterfactual explanations have shown promising results as a post-hoc framework to make image classifiers more explainable. In this paper, we propose DiME, a method allowing the generation of counterfactual images using the recent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Guillaume Jeanneret , Loïc Simon , Frédéric Jurie

In this work, we consider the task of generating highly-realistic images of a given face with a redirected gaze. We treat this problem as a specific instance of conditional image generation and suggest a new deep architecture that can…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Yaroslav Ganin , Daniil Kononenko , Diana Sungatullina , Victor Lempitsky

Existing image restoration methods mostly leverage the posterior distribution of natural images. However, they often assume known degradation and also require supervised training, which restricts their adaptation to complex real…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ben Fei , Zhaoyang Lyu , Liang Pan , Junzhe Zhang , Weidong Yang , Tianyue Luo , Bo Zhang , Bo Dai

In the recent years, there has been a significant improvement in the quality of samples produced by (deep) generative models such as variational auto-encoders and generative adversarial networks. However, the representation capabilities of…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Shady Abu Hussein , Tom Tirer , Raja Giryes

Deep learning algorithms have demonstrated state-of-the-art performance in various tasks of image restoration. This was made possible through the ability of CNNs to learn from large exemplar sets. However, the latter becomes an issue for…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Oleksii Sidorov , Jon Yngve Hardeberg

Neural implicit modeling permits to achieve impressive 3D reconstruction results on small objects, while it exhibits significant limitations in large indoor scenes. In this work, we propose a novel neural implicit modeling method that…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Federico Lincetto , Gianluca Agresti , Mattia Rossi , Pietro Zanuttigh

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser

Advanced machine learning methods, and more prominently neural networks, have become standard to solve inverse problems over the last years. However, the theoretical recovery guarantees of such methods are still scarce and difficult to…

Machine Learning · Computer Science 2024-03-11 Nathan Buskulic , Jalal Fadili , Yvain Quéau

Explainability of deep convolutional neural networks (DCNNs) is an important research topic that tries to uncover the reasons behind a DCNN model's decisions and improve their understanding and reliability in high-risk environments. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Syed Ali Tariq , Tehseen Zia , Mubeen Ghafoor

This paper addresses mesh restoration problems, i.e., denoising and completion, by learning self-similarity in an unsupervised manner. For this purpose, the proposed method, which we refer to as Deep Mesh Prior, uses a graph convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Shota Hattori , Tatsuya Yatagawa , Yutaka Ohtake , Hiromasa Suzuki

Images with different resolutions are ubiquitous in public person re-identification (ReID) datasets and real-world scenes, it is thus crucial for a person ReID model to handle the image resolution variations for improving its generalization…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Zijie Zhuang , Haizhou Ai , Long Chen , Chong Shang

Realistic image restoration is a crucial task in computer vision, and diffusion-based models for image restoration have garnered significant attention due to their ability to produce realistic results. Restoration can be seen as a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Yuhong Zhang , Hengsheng Zhang , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Counterfactual explanations have been successfully applied to create human interpretable explanations for various black-box models. They are handy for tasks in the image domain, where the quality of the explanations benefits from recent…

Machine Learning · Computer Science 2025-03-27 Trung Duc Ha , Sidney Bender