English
Related papers

Related papers: Multi-View Inpainting for RGB-D Sequence

200 papers

Despite the emergence of successful NeRF inpainting methods built upon explicit RGB and depth 2D inpainting supervisions, these methods are inherently constrained by the capabilities of their underlying 2D inpainters. This is due to two key…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Honghua Chen , Chen Change Loy , Xingang Pan

Recently deep neutral networks have achieved promising performance for filling large missing regions in image inpainting tasks. They usually adopted the standard convolutional architecture over the corrupted image, leading to meaningless…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Yuqing Ma , Xianglong Liu , Shihao Bai , Lei Wang , Aishan Liu , Dacheng Tao , Edwin Hancock

In this study, we present a method for synthesizing novel views from a single 360-degree RGB-D image based on the neural radiance field (NeRF) . Prior studies relied on the neighborhood interpolation capability of multi-layer perceptrons to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Takayuki Hara , Tatsuya Harada

Image inpainting is the task of plausibly restoring missing pixels within a hole region that is to be removed from a target image. Most existing technologies exploit patch similarities within the image, or leverage large-scale training data…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yuqian Zhou , Connelly Barnes , Eli Shechtman , Sohrab Amirghodsi

Recent advances in deep learning have shown exciting promise in filling large holes in natural images with semantically plausible and context aware details, impacting fundamental image manipulation tasks such as object removal. While these…

Computer Vision and Pattern Recognition · Computer Science 2017-04-14 Chao Yang , Xin Lu , Zhe Lin , Eli Shechtman , Oliver Wang , Hao Li

We present a novel approach to reconstruct RGB-D indoor scene with plane primitives. Our approach takes as input a RGB-D sequence and a dense coarse mesh reconstructed by some 3D reconstruction method on the sequence, and generate a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Chao Wang , Xiaohu Guo

In recent years, the field of image inpainting has developed rapidly, learning based approaches show impressive results in the task of filling missing parts in an image. But most deep methods are strongly tied to the resolution of the…

Image and Video Processing · Electrical Eng. & Systems 2021-04-29 Andrey Moskalenko , Mikhail Erofeev , Dmitriy Vatolin

This work presents a novel dense RGB-D SLAM approach for dynamic planar environments that enables simultaneous multi-object tracking, camera localisation and background reconstruction. Previous dynamic SLAM methods either rely on semantic…

Robotics · Computer Science 2022-10-19 Ran Long , Christian Rauch , Tianwei Zhang , Vladimir Ivan , Tin Lun Lam , Sethu Vijayakumar

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

The goal of our work is to complete the depth channel of an RGB-D image. Commodity-grade depth cameras often fail to sense depth for shiny, bright, transparent, and distant surfaces. To address this problem, we train a deep network that…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Yinda Zhang , Thomas Funkhouser

We propose an approach for reconstructing free-moving object from a monocular RGB video. Most existing methods either assume scene prior, hand pose prior, object category pose prior, or rely on local optimization with multiple sequence…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Haixin Shi , Yinlin Hu , Daniel Koguciuk , Juan-Ting Lin , Mathieu Salzmann , David Ferstl

Image inpainting is a widely used technique in computer vision for reconstructing missing or damaged pixels in images. Recent advancements with Generative Adversarial Networks (GANs) have demonstrated superior performance over traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Nafiz Al Asad , Md. Appel Mahmud Pranto , Shbiruzzaman Shiam , Musaddeq Mahmud Akand , Mohammad Abu Yousuf , Khondokar Fida Hasan , Mohammad Ali Moni

The emergence of Neural Radiance Fields (NeRF) for novel view synthesis has increased interest in 3D scene editing. An essential task in editing is removing objects from a scene while ensuring visual reasonability and multiview consistency.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Youtan Yin , Zhoujie Fu , Fan Yang , Guosheng Lin

Video inpainting aims to fill spatio-temporal holes with plausible content in a video. Despite tremendous progress of deep neural networks for image inpainting, it is challenging to extend these methods to the video domain due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Dahun Kim , Sanghyun Woo , Joon-Young Lee , In So Kweon

Image inpainting is the task of filling in missing or masked region of an image with semantically meaningful contents. Recent methods have shown significant improvement in dealing with large-scale missing regions. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Wanglong Lu , Xianta Jiang , Xiaogang Jin , Yong-Liang Yang , Minglun Gong , Tao Wang , Kaijie Shi , Hanli Zhao

One major goal of vision is to infer physical models of objects, surfaces, and their layout from sensors. In this paper, we aim to interpret indoor scenes from one RGBD image. Our representation encodes the layout of orthogonal walls and…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Chuhang Zou , Ruiqi Guo , Zhizhong Li , Derek Hoiem

Reference-guided image inpainting restores image pixels by leveraging the content from another single reference image. The primary challenge is how to precisely place the pixels from the reference image into the hole region. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yunhan Zhao , Connelly Barnes , Yuqian Zhou , Eli Shechtman , Sohrab Amirghodsi , Charless Fowlkes

We propose a system that learns to detect objects and infer their 3D poses in RGB-D images. Many existing systems can identify objects and infer 3D poses, but they heavily rely on human labels and 3D annotations. The challenge here is to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Mihir Prabhudesai , Shamit Lal , Hsiao-Yu Fish Tung , Adam W. Harley , Shubhankar Potdar , Katerina Fragkiadaki

Recent advancements in multi-view 3D reconstruction and novel-view synthesis, particularly through Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have greatly enhanced the fidelity and efficiency of 3D content creation.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jun Zhou , Dinghao Li , Nannan Li , Mingjie Wang

We propose a novel object-augmented RGB-D SLAM system that is capable of constructing a consistent object map and performing relocalisation based on centroids of objects in the map. The approach aims to overcome the view dependence of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Yuhang Ming , Xingrui Yang , Andrew Calway