English
Related papers

Related papers: Counterfactual Depth from a Single RGB Image

200 papers

The ever-increasing use of synthetically generated content in different sectors of our everyday life, one for all media information, poses a strong need for deepfake detection tools in order to avoid the proliferation of altered messages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Andrea Ciamarra , Roberto Caldelli , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

We present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. This is an extremely challenging problem that requires modeling complex light transport, and disentangling…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhengqin Li , Jia Shi , Sai Bi , Rui Zhu , Kalyan Sunkavalli , Miloš Hašan , Zexiang Xu , Ravi Ramamoorthi , Manmohan Chandraker

This paper presents a neural network to estimate a detailed depth map of the foreground human in a single RGB image. The result captures geometry details such as cloth wrinkles, which are important in visualization applications. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Sicong Tang , Feitong Tan , Kelvin Cheng , Zhaoyang Li , Siyu Zhu , Ping Tan

Image of a scene captured through a piece of transparent and reflective material, such as glass, is often spoiled by a superimposed layer of reflection image. While separating the reflection from a familiar object in an image is mentally…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Zhixiang Chi , Xiaolin Wu , Xiao Shu , Jinjin Gu

We present a novel method for predicting accurate depths from monocular images with high efficiency. This optimal efficiency is achieved by exploiting wavelet decomposition, which is integrated in a fully differentiable encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Michaël Ramamonjisoa , Michael Firman , Jamie Watson , Vincent Lepetit , Daniyar Turmukhambetov

Spatial visual perception is a fundamental requirement in physical-world applications like autonomous driving and robotic manipulation, driven by the need to interact with 3D environments. Capturing pixel-aligned metric depth using RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Bin Tan , Changjiang Sun , Xiage Qin , Hanat Adai , Zelin Fu , Tianxiang Zhou , Han Zhang , Yinghao Xu , Xing Zhu , Yujun Shen , Nan Xue

A single color image can contain many cues informative towards different aspects of local geometric structure. We approach the problem of monocular depth estimation by using a neural network to produce a mid-level representation that…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Ayan Chakrabarti , Jingyu Shao , Gregory Shakhnarovich

We present an approach to infer the 3D shape, texture, and camera pose for an object from a single RGB image, using only category-level image collections with foreground masks as supervision. We represent the shape as an image-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Shubham Tulsiani , Nilesh Kulkarni , Abhinav Gupta

DeepFake technology has advanced significantly in recent years, enabling the creation of highly realistic synthetic face images. Existing DeepFake detection methods often struggle with pose variations, occlusions, and artifacts that are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Sami Belguesmia , Mohand Saïd Allili , Assia Hamadene

For augmented reality (AR), it is important that virtual assets appear to `sit among' real world objects. The virtual element should variously occlude and be occluded by real matter, based on a plausible depth ordering. This occlusion…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Jamie Watson , Mohamed Sayed , Zawar Qureshi , Gabriel J. Brostow , Sara Vicente , Oisin Mac Aodha , Michael Firman

Counterfactuals are a popular framework for interpreting machine learning predictions. These what if explanations are notoriously challenging to create for computer vision models: standard gradient-based methods are prone to produce…

Machine Learning · Computer Science 2025-04-23 Jeremy Goldwasser , Giles Hooker

To understand the black-box characteristics of deep networks, counterfactual explanation that deduces not only the important features of an input space but also how those features should be modified to classify input as a target class has…

Machine Learning · Computer Science 2022-08-15 Hong-Gyu Jung , Sin-Han Kang , Hee-Dong Kim , Dong-Ok Won , Seong-Whan Lee

Advances in deep learning techniques have allowed recent work to reconstruct the shape of a single object given only one RBG image as input. Building on common encoder-decoder architectures for this task, we propose three extensions: (1)…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Stefan Popov , Pablo Bauszat , Vittorio Ferrari

Predicting depth is an essential component in understanding the 3D geometry of a scene. While for stereo images local correspondence suffices for estimation, finding depth relations from a single image is less straightforward, requiring…

Computer Vision and Pattern Recognition · Computer Science 2014-06-10 David Eigen , Christian Puhrsch , Rob Fergus

Learning causal relationships in high-dimensional data (images, videos) is a hard task, as they are often defined on low dimensional manifolds and must be extracted from complex signals dominated by appearance, lighting, textures and also…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Steeven Janny , Fabien Baradel , Natalia Neverova , Madiha Nadri , Greg Mori , Christian Wolf

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

The 3D localisation of an object and the estimation of its properties, such as shape and dimensions, are challenging under varying degrees of transparency and lighting conditions. In this paper, we propose a method for jointly localising…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Alessio Xompero , Ricardo Sanchez-Matilla , Apostolos Modas , Pascal Frossard , Andrea Cavallaro

We introduce a method that can learn to predict scene-level implicit functions for 3D reconstruction from posed RGBD data. At test time, our system maps a previously unseen RGB image to a 3D reconstruction of a scene via implicit functions.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Nilesh Kulkarni , Linyi Jin , Justin Johnson , David F. Fouhey

Real-time estimation of actual object depth is an essential module for various autonomous system tasks such as 3D reconstruction, scene understanding and condition assessment. During the last decade of machine learning, extensive deployment…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Christoph Angermann , Matthias Schwab , Markus Haltmeier , Christian Laubichler , Steinbjörn Jónsson

Depth cameras are a prominent perception system for robotics, especially when operating in natural unstructured environments. Industrial applications, however, typically involve reflective objects under harsh lighting conditions, a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Yuri Feldman , Yoel Shapiro , Dotan Di Castro