English
Related papers

Related papers: Render4Completion: Synthesizing Multi-View Depth M…

200 papers

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Luoxi Zhang , Pragyan Shrestha , Yu Zhou , Chun Xie , Itaru Kitahara

How will you repair a physical object with large missings? You may first recover its global yet coarse shape and stepwise increase its local details. We are motivated to imitate the above physical repair procedure to address the point cloud…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Fei Hu , Honghua Chen , Xuequan Lu , Zhe Zhu , Jun Wang , Weiming Wang , Fu Lee Wang , Mingqiang Wei

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

Depth estimation features are helpful for 3D recognition. Commodity-grade depth cameras are able to capture depth and color image in real-time. However, glossy, transparent or distant surface cannot be scanned properly by the sensor. As a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Yu-Kai Huang , Tsung-Han Wu , Yueh-Cheng Liu , Winston H. Hsu

In this paper, we explore the problem of 3D point cloud representation-based view synthesis from a set of sparse source views. To tackle this challenging problem, we propose a new deep learning-based view synthesis paradigm that learns a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Meng You , Mantang Guo , Xianqiang Lyu , Hui Liu , Junhui Hou

Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve…

Machine Learning · Computer Science 2020-07-21 Sameera Ramasinghe , Salman Khan , Nick Barnes , Stephen Gould

Point cloud completion referring to completing 3D shapes from partial 3D point clouds is a fundamental problem for 3D point cloud analysis tasks. Benefiting from the development of deep neural networks, researches on point cloud completion…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Jun Wang , Ying Cui , Dongyan Guo , Junxia Li , Qingshan Liu , Chunhua Shen

Depth completion is a crucial task in autonomous driving, aiming to convert a sparse depth map into a dense depth prediction. Due to its potentially rich semantic information, RGB image is commonly fused to enhance the completion effect.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Moyun Liu , Bing Chen , Youping Chen , Jingming Xie , Lei Yao , Yang Zhang , Joey Tianyi Zhou

While current multi-frame restoration methods combine information from multiple input images using 2D alignment techniques, recent advances in novel view synthesis are paving the way for a new paradigm relying on volumetric scene…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Thomas Tanay , Aleš Leonardis , Matteo Maggioni

This paper focuses on the recently popular task of point cloud completion guided by multimodal information. Although existing methods have achieved excellent performance by fusing auxiliary images, there are still some deficiencies,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Wei Song , Jun Zhou , Mingjie Wang , Hongchen Tan , Nannan Li , Xiuping Liu

Point completion refers to complete the missing geometries of objects from partial point clouds. Existing works usually estimate the missing shape by decoding a latent feature encoded from the input points. However, real-world objects are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yinyu Nie , Yiqun Lin , Xiaoguang Han , Shihui Guo , Jian Chang , Shuguang Cui , Jian Jun Zhang

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Large-scale point cloud generated from 3D sensors is more accurate than its image-based counterpart. However, it is seldom used in visual pose estimation due to the difficulty in obtaining 2D-3D image to point cloud correspondences. In this…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Mengdan Feng , Sixing Hu , Marcelo Ang , Gim Hee Lee

This paper proposes a new end-to-end neural rendering architecture to transfer appearance and reenact human actors. Our method leverages a carefully designed graph convolutional network (GCN) to model the human body manifold structure,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Thiago L. Gomes , Thiago M. Coutinho , Rafael Azevedo , Renato Martins , Erickson R. Nascimento

Cardiovascular magnetic resonance imaging is emerging as a crucial tool to examine cardiac morphology and function. Essential to this endeavour are anatomical 3D surface and volumetric meshes derived from CMR images, which facilitate…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Nicolás Gaggion , Benjamin A. Matheson , Yan Xia , Rodrigo Bonazzola , Nishant Ravikumar , Zeike A. Taylor , Diego H. Milone , Alejandro F. Frangi , Enzo Ferrante

Semantic Scene Completion aims at reconstructing a complete 3D scene with precise voxel-wise semantics from a single-view depth or RGBD image. It is a crucial but challenging problem for indoor scene understanding. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Yingjie Cai , Xuesong Chen , Chao Zhang , Kwan-Yee Lin , Xiaogang Wang , Hongsheng Li

Cine magnetic resonance imaging (MRI) is the current gold standard for the assessment of cardiac anatomy and function. However, it typically only acquires a set of two-dimensional (2D) slices of the underlying three-dimensional (3D) anatomy…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Marcel Beetz , Abhirup Banerjee , Julius Ossenberg-Engels , Vicente Grau

We present a novel framework for mesh reconstruction from unstructured point clouds by taking advantage of the learned visibility of the 3D points in the virtual views and traditional graph-cut based mesh generation. Specifically, we first…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Shuang Song , Zhaopeng Cui , Rongjun Qin