English
Related papers

Related papers: IMFine: 3D Inpainting via Geometry-guided Multi-vi…

200 papers

Estimating 3D poses and shapes in the form of meshes from monocular RGB images is challenging. Obviously, it is more difficult than estimating 3D poses only in the form of skeletons or heatmaps. When interacting persons are involved, the 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Junuk Cha , Muhammad Saqlain , GeonU Kim , Mingyu Shin , Seungryul Baek

Image outpainting is a very intriguing problem as the outside of a given image can be continuously filled by considering as the context of the image. This task has two main challenges. The first is to maintain the spatial consistency in…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kyunghun Kim , Yeohun Yun , Keon-Woo Kang , Kyeongbo Kong , Siyeong Lee , Suk-Ju Kang

3D visual perception tasks based on multi-camera images are essential for autonomous driving systems. Latest work in this field performs 3D object detection by leveraging multi-view images as an input and iteratively enhancing object…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jongwoo Park , Apoorv Singh , Varun Bankiti

We propose NeRFiller, an approach that completes missing portions of a 3D capture via generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a captured 3D scene or object are missing due to mesh…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Ethan Weber , Aleksander Hołyński , Varun Jampani , Saurabh Saxena , Noah Snavely , Abhishek Kar , Angjoo Kanazawa

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

The rapid development of 3D acquisition technology has made it possible to obtain point clouds of real-world terrains. However, due to limitations in sensor acquisition technology or specific requirements, point clouds often contain defects…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yizhou Xie , Xiangning Xie , Yuran Wang , Yanci Zhang , Zejun Lv

Image inpainting is an old problem in computer vision that restores occluded regions and completes damaged images. In the case of facial image inpainting, most of the methods generate only one result for each masked image, even though there…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Dongsik Yoon , Jeong-gi Kwak , Yuanming Li , David Han , Hanseok Ko

In this work, we address a challenge in video inpainting: reconstructing occluded regions in dynamic, real-world scenarios. Motivated by the need for continuous human motion monitoring in healthcare settings, where facial features are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zheyan Zhang , Diego Klabjan , Renee CB Manworren

In computer vision, recovering spatial information by filling in masked regions, e.g., inpainting, has been widely investigated for its usability and wide applicability to other various applications: image inpainting, image extrapolation,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Changho Jo , Woobin Im , Sung-Eui Yoon

Image outpainting gains increasing attention since it can generate the complete scene from a partial view, providing a valuable solution to construct {360\textdegree} panoramic images. As image outpainting suffers from the intrinsic issue…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Kang Liao , Xiangyu Xu , Chunyu Lin , Wenqi Ren , Yunchao Wei , Yao Zhao

Recently, removing objects from videos and filling in the erased regions using deep video inpainting (VI) algorithms has attracted considerable attention. Usually, a video sequence and object segmentation masks for all frames are required…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Sangjin Lee , Suhwan Cho , Sangyoun Lee

Reconstructing general dynamic scenes is important for many computer vision and graphics applications. Recent works represent the dynamic scene with neural radiance fields for photorealistic view synthesis, while their surface geometry is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Decai Chen , Haofei Lu , Ingo Feldmann , Oliver Schreer , Peter Eisert

Patch-based methods and deep networks have been employed to tackle image inpainting problem, with their own strengths and weaknesses. Patch-based methods are capable of restoring a missing region with high-quality texture through searching…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rui Xu , Minghao Guo , Jiaqi Wang , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

The ultimate goal of many image-based modeling systems is to render photo-realistic novel views of a scene without visible artifacts. Existing evaluation metrics and benchmarks focus mainly on the geometric accuracy of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2016-01-27 Michael Waechter , Mate Beljan , Simon Fuhrmann , Nils Moehrle , Johannes Kopf , Michael Goesele

Text-to-texture synthesis has become a new frontier in 3D content creation thanks to the recent advances in text-to-image models. Existing methods primarily adopt a combination of pretrained depth-aware diffusion and inpainting models, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Jiaxiang Tang , Ruijie Lu , Xiaokang Chen , Xiang Wen , Gang Zeng , Ziwei Liu

We introduce a novel approach that takes a single semantic mask as input to synthesize multi-view consistent color images of natural scenes, trained with a collection of single images from the Internet. Prior works on 3D-aware image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Tianrun Chen , Linzhan Mou , Haotong Lin , Kaicheng Yu , Yiyi Liao , Xiaowei Zhou

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury

Learning a dense 3D model with fine-scale details from a single facial image is highly challenging and ill-posed. To address this problem, many approaches fit smooth geometries through facial prior while learning details as additional…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Xingyu Ren , Alexandros Lattas , Baris Gecer , Jiankang Deng , Chao Ma , Xiaokang Yang , Stefanos Zafeiriou

We present Image2GS, a novel approach that addresses the challenging problem of reconstructing photorealistic 3D scenes from a single image by focusing specifically on the image-to-3D lifting component of the reconstruction process. By…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Tianshi Cao , Marie-Julie Rakotosaona , Ben Poole , Federico Tombari , Michael Niemeyer

Texturing is a crucial step in the 3D asset production workflow, which enhances the visual appeal and diversity of 3D assets. Despite recent advancements in Text-to-Texture (T2T) generation, existing methods often yield subpar results,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Wei Cheng , Juncheng Mu , Xianfang Zeng , Xin Chen , Anqi Pang , Chi Zhang , Zhibin Wang , Bin Fu , Gang Yu , Ziwei Liu , Liang Pan