English
Related papers

Related papers: Coordinates Are NOT Lonely -- Codebook Prior Helps…

200 papers

The recent progress in implicit 3D representation, i.e., Neural Radiance Fields (NeRFs), has made accurate and photorealistic 3D reconstruction possible in a differentiable manner. This new representation can effectively convey the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yoonwoo Jeong , Seungjoo Shin , Junha Lee , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

NeRFs have achieved incredible success in novel view synthesis. However, the accuracy of the implicit geometry is unsatisfactory because the passive static environmental illumination has low spatial frequency and cannot provide enough…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jianyu Tao , Changping Hu , Edward Yang , Jing Xu , Rui Chen

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Existing neural field representations for 3D object reconstruction either (1) utilize object-level representations, but suffer from low-quality details due to conditioning on a global latent code, or (2) are able to perfectly reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Christopher Wewer , Eddy Ilg , Bernt Schiele , Jan Eric Lenssen

Self-supervised monocular depth estimation aims to infer depth information without relying on labeled data. However, the lack of labeled information poses a significant challenge to the model's representation, limiting its ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Guodong Sun , Junjie Liu , Mingxuan Liu , Moyun Liu , Yang Zhang

Image inpainting aims to fill the missing hole of the input. It is hard to solve this task efficiently when facing high-resolution images due to two reasons: (1) Large reception field needs to be handled for high-resolution image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Weihuang Liu , Xiaodong Cun , Chi-Man Pun , Menghan Xia , Yong Zhang , Jue Wang

Existing 3D surface representation approaches are unable to accurately classify pixels and their orientation lying on the boundary of an object. Thus resulting in coarse representations which usually require post-processing steps to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Mateusz Michalkiewicz , Jhony K. Pontes , Dominic Jack , Mahsa Baktashmotlagh , Anders Eriksson

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction. While demonstrating promising results, most implicit approaches are limited to comparably simple geometry of single objects and do not…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , Andreas Geiger

This paper addresses the challenge of novel view synthesis for a human performer from a very sparse set of camera views. Some recent works have shown that learning implicit neural representations of 3D scenes achieves remarkable view…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sida Peng , Yuanqing Zhang , Yinghao Xu , Qianqian Wang , Qing Shuai , Hujun Bao , Xiaowei Zhou

Implicit Neural Representations (INRs) are widely used for modeling continuous 2D images, enabling high-fidelity reconstruction, super-resolution, and compression. Architectures such as SIREN, WIRE, and FINER demonstrate their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Weronika Jakubowska , Mikołaj Zieliński , Rafał Tobiasz , Krzysztof Byrski , Maciej Zięba , Dominik Belter , Przemysław Spurek

Accurate 3D scene representation and panoptic understanding are essential for applications such as virtual reality, robotics, and autonomous driving. However, challenges persist with existing methods, including precise 2D-to-3D mapping,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Shenghao Li

Implicit neural representations have demonstrated significant promise for 3D scene reconstruction. Recent works have extended their applications to autonomous implicit reconstruction through the Next Best View (NBV) based method. However,…

Robotics · Computer Science 2024-04-17 Jing Zeng , Yanxu Li , Jiahao Sun , Qi Ye , Yunlong Ran , Jiming Chen

Shape implicit neural representations (INRs) have recently shown to be effective in shape analysis and reconstruction tasks. Existing INRs require point coordinates to learn the implicit level sets of the shape. When a normal vector is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Yizhak Ben-Shabat , Chamin Hewa Koneputugodage , Stephen Gould

Multi-view implicit scene reconstruction methods have become increasingly popular due to their ability to represent complex scene details. Recent efforts have been devoted to improving the representation of input information and to reducing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Edward J. Smith , Michal Drozdzal , Derek Nowrouzezahrai , David Meger , Adriana Romero-Soriano

We propose a novel neural architecture for representing 3D surfaces, which harnesses two complementary shape representations: (i) an explicit representation via an atlas, i.e., embeddings of 2D domains into 3D; (ii) an implicit-function…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Matthew Fisher , Noam Aigerman , Vladimir G. Kim

We propose SketchINR, to advance the representation of vector sketches with implicit neural models. A variable length vector sketch is compressed into a latent space of fixed dimension that implicitly encodes the underlying shape as a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hmrishav Bandyopadhyay , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Tao Xiang , Timothy Hospedales , Yi-Zhe Song

Implicit Neural Representations (INRs) have emerged in the last few years as a powerful tool to encode continuously a variety of different signals like images, videos, audio and 3D shapes. When applied to 3D shapes, INRs allow to overcome…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Luca De Luigi , Adriano Cardace , Riccardo Spezialetti , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Recent advances in deep learning have led to a data-centric intelligence i.e. artificially intelligent models unlocking the potential to ingest a large amount of data and be really good at performing digital tasks such as text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Muhammad Zubair Irshad

Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision. Existing deep learning approaches for 6D pose estimation typically rely on the assumption of availability of 3D object models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Fu Li , Hao Yu , Ivan Shugurov , Benjamin Busam , Shaowu Yang , Slobodan Ilic