中文
相关论文

相关论文: True Self-Supervised Novel View Synthesis is Trans…

200 篇论文

3D pose transfer is a challenging generation task that aims to transfer the pose of a source geometry onto a target geometry with the target identity preserved. Many prior methods require keypoint annotations to find correspondence between…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Jiaze Sun , Zhixiang Chen , Tae-Kyun Kim

In this study, we propose two novel input processing paradigms for novel view synthesis (NVS) methods based on layered scene representations that significantly improve their runtime without compromising quality. Our approach identifies and…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Jonas Kohler , Nicolas Griffiths Sanchez , Luca Cavalli , Catherine Herold , Albert Pumarola , Alberto Garcia Garcia , Ali Thabet

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

计算机视觉与模式识别 · 计算机科学 2023-03-16 Shuja Khalid , Frank Rudzicz

Content creation, central to applications such as virtual reality, can be a tedious and time-consuming. Recent image synthesis methods simplify this task by offering tools to generate new views from as little as a single input image, or by…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Tewodros Habtegebrial , Varun Jampani , Orazio Gallo , Didier Stricker

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

Novel view synthesis (NVS) enables to generate new images of a scene or convert a set of 2D images into a comprehensive 3D model. In the context of Space Domain Awareness, since space is becoming increasingly congested, NVS can accurately…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Nidhi Mathihalli , Audrey Wei , Giovanni Lavezzi , Peng Mun Siew , Victor Rodriguez-Fernandez , Hodei Urrutxua , Richard Linares

Novel View Synthesis (NVS) is the task of generating new images of a scene from viewpoints that were not part of the original input. Diffusion-based NVS can generate high-quality, temporally consistent images, however, remains…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yuchen Xia , Souvik Kundu , Mosharaf Chowdhury , Nishil Talati

Novel View Synthesis (NVS) and 3D generation have recently achieved prominent improvements. However, these works mainly focus on confined categories or synthetic 3D assets, which are discouraged from generalizing to challenging in-the-wild…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Chenjie Cao , Chaohui Yu , Fan Wang , Xiangyang Xue , Yanwei Fu

In this paper, we present an approach for monocular open-set novel view synthesis (NVS) that leverages object skeletons to guide the underlying diffusion model. Building upon a baseline that utilizes a pre-trained 2D image generator, our…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Aron Fóthi , Bence Fazekas , Natabara Máté Gyöngyössy , Kristian Fenech

Novel view synthesis from a single image has recently attracted a lot of attention, and it has been primarily advanced by 3D deep learning and rendering techniques. However, most work is still limited by synthesizing new views within…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Xuanchi Ren , Xiaolong Wang

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

Learning model-free object pose estimation for unseen instances remains a fundamental challenge in 3D vision. Existing methods typically fall into two disjoint paradigms: category-level approaches predict absolute poses in a canonical space…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Weihang Li , Lorenzo Garattoni , Fabien Despinoy , Nassir Navab , Benjamin Busam

We propose a novel pose-guided appearance transfer network for transferring a given reference appearance to a target pose in unprecedented image resolution (1024 * 1024), given respectively an image of the reference and target person. No 3D…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Ji Liu , Heshan Liu , Mang-Tik Chiu , Yu-Wing Tai , Chi-Keung Tang

We introduce a scalable framework for novel view synthesis from RGB-D images with largely incomplete scene coverage. While generative neural approaches have demonstrated spectacular results on 2D images, they have not yet achieved similar…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Zuoyue Li , Tianxing Fan , Zhenqiang Li , Zhaopeng Cui , Yoichi Sato , Marc Pollefeys , Martin R. Oswald

The main challenges of 3D pose transfer are: 1) Lack of paired training data with different characters performing the same pose; 2) Disentangling pose and shape information from the target mesh; 3) Difficulty in applying to meshes with…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Jinnan Chen , Chen Li , Gim Hee Lee

Neural radiance fields (NeRF) are a groundbreaking computer vision technology that enables the generation of high-quality, immersive visual content from multiple viewpoints. This capability has significant advantages for applications such…

多媒体 · 计算机科学 2024-09-30 Pedro Martin , Antonio Rodrigues , Joao Ascenso , Maria Paula Queluz

Existing deep learning based visual servoing approaches regress the relative camera pose between a pair of images. Therefore, they require a huge amount of training data and sometimes fine-tuning for adaptation to a novel scene.…

机器人学 · 计算机科学 2020-03-10 Y V S Harish , Harit Pandya , Ayush Gaud , Shreya Terupally , Sai Shankar , K. Madhava Krishna

Despite recent advances in Novel View Synthesis (NVS), generating high-fidelity views from single or sparse observations remains a significant challenge. Existing splatting-based approaches often produce distorted geometry due to splatting…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Xiang Zhang , Yang Zhang , Lukas Mehl , Markus Gross , Christopher Schroers

The development of generalizable Novel View Synthesis (NVS) models is critically limited by the scarcity of large-scale training data featuring diverse and precise camera trajectories. While real-world captures are photorealistic, they are…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Chenhan Jiang , Yu Chen , Qingwen Zhang , Jifei Song , Songcen Xu , Dit-Yan Yeung , Jiankang Deng

Pose transfer refers to the probabilistic image generation of a person with a previously unseen novel pose from another image of that person having a different pose. Due to potential academic and commercial applications, this problem is…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Prasun Roy , Saumik Bhattacharya , Subhankar Ghosh , Umapada Pal