English
Related papers

Related papers: Decomposing multispectral face images into diffuse…

200 papers

In this paper we are extracting surface reflectance and natural environmental illumination from a reflectance map, i.e. from a single 2D image of a sphere of one material under one illumination. This is a notoriously difficult problem, yet…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Stamatios Georgoulis , Konstantinos Rematas , Tobias Ritschel , Mario Fritz , Luc Van Gool , Tinne Tuytelaars

In this paper, we introduce FitMe, a facial reflectance model and a differentiable rendering optimization pipeline, that can be used to acquire high-fidelity renderable human avatars from single or multiple images. The model consists of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Alexandros Lattas , Stylianos Moschoglou , Stylianos Ploumpis , Baris Gecer , Jiankang Deng , Stefanos Zafeiriou

Recovering the radiometric properties of a scene (i.e., the reflectance, illumination, and geometry) is a long-sought ability of computer vision that can provide invaluable information for a wide range of applications. Deciphering the…

Computer Vision and Pattern Recognition · Computer Science 2016-04-06 Stephen Lombardi , Ko Nishino

Eliminating reflections caused by incident light interacting with reflective medium remains an ill-posed problem in the image restoration area. The primary challenge arises from the overlapping of reflection and transmission components in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Pengbo Guo , Chengxu Liu , Guoshuai Zhao , Xingsong Hou , Jialie Shen , Xueming Qian

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

We demonstrate an image dequantizing diffusion model that enables novel edits on natural images. We propose operating on quantized images because they offer easy abstraction for patch-based edits and palette transfer. In particular, we show…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Vaibhav Vavilala , Faaris Shaik , David Forsyth

In this work, we show that exploiting additional variables in a mixed finite element formulation of deformation leads to an efficient physics-based character skinning algorithm. Taking as input, a user-defined rig, we show how to…

Diffusion models have recently motivated great success in many generation tasks like object removal. Nevertheless, existing image decomposition methods struggle to disentangle semi-transparent or transparent layer occlusions due to mask…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zitong Wang , Hang Zhao , Qianyu Zhou , Xuequan Lu , Xiangtai Li , Yiren Song

In this paper we demonstrate that the framework of nonlinear spectral decompositions based on total variation (TV) regularization is very well suited for image fusion as well as more general image manipulation tasks. The well-localized and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Martin Benning , Michael Möller , Raz Z. Nossek , Martin Burger , Daniel Cremers , Guy Gilboa , Carola-Bibiane Schönlieb

Decomposing a scene into its shape, reflectance and illumination is a fundamental problem in computer vision and graphics. Neural approaches such as NeRF have achieved remarkable success in view synthesis, but do not explicitly perform…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Mark Boss , Varun Jampani , Raphael Braun , Ce Liu , Jonathan T. Barron , Hendrik P. A. Lensch

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

In optical imaging, light propagation is affected by the inhomogeneities of the medium. Sample-induced aberrations and multiple scattering can strongly degrade the image resolution and contrast. Based on a dynamic correction of the incident…

Diffusion Probabilistic Models (DPMs) have recently been employed for image deblurring, formulated as an image-conditioned generation process that maps Gaussian noise to the high-quality image, conditioned on the blurry input.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Mengwei Ren , Mauricio Delbracio , Hossein Talebi , Guido Gerig , Peyman Milanfar

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Image of a scene captured through a piece of transparent and reflective material, such as glass, is often spoiled by a superimposed layer of reflection image. While separating the reflection from a familiar object in an image is mentally…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Zhixiang Chi , Xiaolin Wu , Xiao Shu , Jinjin Gu

In this paper, we address the problem of reflection removal and deblurring from a single image captured by a plenoptic camera. We develop a two-stage approach to recover the scene depth and high resolution textures of the reflected and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Paramanand Chandramouli , Mehdi Noroozi , Paolo Favaro

We present a progressive image decomposition method based on a novel non-linear filter named Sub-window Variance filter. Our method is specifically designed for image detail enhancement purpose; this application requires extraction of image…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Kin-Ming Wong

In the process of performing image super-resolution processing, the processing of complex localized information can have a significant impact on the quality of the image generated. Fractal features can capture the rich details of both micro…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Lianping Yang , Peng Jiao , Jinshan Pan , Hegui Zhu , Su Guo

In this paper, we propose a framework for disentangling the appearance and geometry representations in the face recognition task. To provide supervision for this aim, we generate geometrically identical faces by incorporating spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Ali Dabouei , Fariborz Taherkhani , Sobhan Soleymani , Jeremy Dawson , Nasser M. Nasrabadi