English
Related papers

Related papers: Multiview Textured Mesh Recovery by Differentiable…

200 papers

We present a super-resolution method capable of creating a high-resolution texture map for a virtual 3D object from a set of lower-resolution images of that object. Our architecture unifies the concepts of (i) multi-view super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Audrey Richard , Ian Cherabier , Martin R. Oswald , Vagia Tsiminaki , Marc Pollefeys , Konrad Schindler

Recently, learning frameworks have shown the capability of inferring the accurate shape, pose, and texture of an object from a single RGB image. However, current methods are trained on image collections of a single category in order to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Alessandro Simoni , Stefano Pini , Roberto Vezzani , Rita Cucchiara

Reconstructing the shape and appearance of real-world objects using measured 2D images has been a long-standing problem in computer vision. In this paper, we introduce a new analysis-by-synthesis technique capable of producing high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Fujun Luan , Shuang Zhao , Kavita Bala , Zhao Dong

Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Decai Chen , Haofei Lu , Ingo Feldmann , Oliver Schreer , Peter Eisert

In recent years, neural implicit representations gained popularity in 3D reconstruction due to their expressiveness and flexibility. However, the implicit nature of neural implicit representations results in slow inference time and requires…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Songyou Peng , Chiyu "Max" Jiang , Yiyi Liao , Michael Niemeyer , Marc Pollefeys , Andreas Geiger

Rendering bridges the gap between 2D vision and 3D scenes by simulating the physical process of image formation. By inverting such renderer, one can think of a learning approach to infer 3D information from 2D images. However, standard…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Shichen Liu , Tianye Li , Weikai Chen , Hao Li

We present a method for differentiable rendering of 3D surfaces that supports both explicit and implicit representations, provides derivatives at occlusion boundaries, and is fast and simple to implement. The method first samples the…

Graphics · Computer Science 2021-08-12 Forrester Cole , Kyle Genova , Avneesh Sud , Daniel Vlasic , Zhoutong Zhang

Reconstructing high-fidelity hand models with intricate textures plays a crucial role in enhancing human-object interaction and advancing real-world applications. Despite the state-of-the-art methods excelling in texture generation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Qijun Gan , Wentong Li , Jinwei Ren , Jianke Zhu

We have recently seen tremendous progress in the neural advances for photo-real human modeling and rendering. However, it's still challenging to integrate them into an existing mesh-based pipeline for downstream applications. In this paper,…

Deep learning-based multi-view stereo has emerged as a powerful paradigm for reconstructing the complete geometrically-detailed objects from multi-views. Most of the existing approaches only estimate the pixel-wise depth value by minimizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Yisu Zhang , Jianke Zhu , Lixiang Lin

This paper aims to recover the intrinsic reflectance layer and shading layer given a single image. Though this intrinsic image decomposition problem has been studied for decades, it remains a significant challenge in cases of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Xiaodong Wang , Zijun He , Xin Yuan

Deep learning based 3D shape generation methods generally utilize latent features extracted from color images to encode the semantics of objects and guide the shape generation process. These color image semantics only implicitly encode 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Rakesh Shrestha , Zhiwen Fan , Qingkun Su , Zuozhuo Dai , Siyu Zhu , Ping Tan

Reconstructing transparent objects from a set of multi-view images is a challenging task due to the complicated nature and indeterminate behavior of light propagation. Typical methods are primarily tailored to specific scenarios, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Changpu Li , Shuang Wu , Songlin Tang , Guangming Lu , Jun Yu , Wenjie Pei

Despite the promising results of multi-view reconstruction, the recent neural rendering-based methods, such as implicit surface rendering (IDR) and volume rendering (NeuS), not only incur a heavy computational burden on training but also…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yisu Zhang , Jianke Zhu , Lixiang Lin

Recent advances in implicit neural representations and differentiable rendering make it possible to simultaneously recover the geometry and materials of an object from multi-view RGB images captured under unknown static illumination.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yuanqing Zhang , Jiaming Sun , Xingyi He , Huan Fu , Rongfei Jia , Xiaowei Zhou

3D object detection from monocular images is an ill-posed problem due to the projective entanglement of depth and scale. To overcome this ambiguity, we present a novel self-supervised method for textured 3D shape reconstruction and pose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Deniz Beker , Hiroharu Kato , Mihai Adrian Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon

Differentiable rendering is a technique that aims to invert the rendering process to enable optimizing rendering parameters from a set of images. In this article, we present a differentiable volume rendering solution called DiffTetVR for…

Graphics · Computer Science 2026-01-05 Christoph Neuhauser

We present a neural rendering-based method called NeRO for reconstructing the geometry and the BRDF of reflective objects from multiview images captured in an unknown environment. Multiview reconstruction of reflective objects is extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yuan Liu , Peng Wang , Cheng Lin , Xiaoxiao Long , Jiepeng Wang , Lingjie Liu , Taku Komura , Wenping Wang

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Recent advances in neural rendering have shown great potential for reconstructing scenes from multiview images. However, accurately representing objects with glossy surfaces remains a challenge for existing methods. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ruofan Liang , Huiting Chen , Chunlin Li , Fan Chen , Selvakumar Panneer , Nandita Vijaykumar