English
Related papers

Related papers: Novel View Synthesis of Humans using Differentiabl…

200 papers

We present a new approach, termed GPS-Gaussian, for synthesizing novel views of a character in a real-time manner. The proposed method enables 2K-resolution rendering under a sparse-view camera setting. Unlike the original Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Shunyuan Zheng , Boyao Zhou , Ruizhi Shao , Boning Liu , Shengping Zhang , Liqiang Nie , Yebin Liu

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Hyeongwoo Kim , Florian Bernard , Marc Habermann , Wenping Wang , Christian Theobalt

In this paper, we aim to address the challenge of novel view rendering of human performers who wear clothes with complex texture patterns using a sparse set of camera views. Although some recent works have achieved remarkable rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Tiansong Zhou , Jing Huang , Tao Yu , Ruizhi Shao , Kun Li

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang

Dynamic novel view synthesis aims to capture the temporal evolution of visual content within videos. Existing methods struggle to distinguishing between motion and structure, particularly in scenarios where camera poses are either unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Chaoyang Wang , Peiye Zhuang , Aliaksandr Siarohin , Junli Cao , Guocheng Qian , Hsin-Ying Lee , Sergey Tulyakov

Rendering photo-realistic novel-view images of complex scenes has been a long-standing challenge in computer graphics. In recent years, great research progress has been made on enhancing rendering quality and accelerating rendering speed in…

Graphics · Computer Science 2024-02-21 Tiansong Zhou , Yebin Liu , Xuangeng Chu , Chengkun Cao , Changyin Zhou , Fei Yu , Yu Li

We address the computational problem of novel human pose synthesis. Given an image of a person and a desired pose, we produce a depiction of that person in that pose, retaining the appearance of both the person and background. We present a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Guha Balakrishnan , Amy Zhao , Adrian V. Dalca , Fredo Durand , John Guttag

We propose Human Pose Models that represent RGB and depth images of human poses independent of clothing textures, backgrounds, lighting conditions, body shapes and camera viewpoints. Learning such universal models requires training images…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jian Liu , Naveed Akhtar , Ajmal Mian

We present a generalizable novel view synthesis method which enables modifying the visual appearance of an observed scene so rendered views match a target weather or lighting condition without any scene specific training or access to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Josef Bengtson , David Nilsson , Che-Tsung Lin , Marcel Büsching , Fredrik Kahl

View synthesis aims to generate novel views from one or more given source views. Although existing methods have achieved promising performance, they usually require paired views of different poses to learn a pixel transformation. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Bingzheng Liu , Jianjun Lei , Bo Peng , Chuanbo Yu , Wanqing Li , Nam Ling

Novel view synthesis of remote sensing scenes is of great significance for scene visualization, human-computer interaction, and various downstream applications. Despite the recent advances in computer graphics and photogrammetry technology,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yongchang Wu , Zhengxia Zou , Zhenwei Shi

Novel view synthesis from a single image has recently achieved remarkable results, although the requirement of some form of 3D, pose, or multi-view supervision at training time limits the deployment in real scenarios. This work aims at…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Pierluigi Zama Ramirez , Diego Martin Arroyo , Alessio Tonioni , Federico Tombari

We propose PoseGaussian, a pose-guided Gaussian Splatting framework for high-fidelity human novel view synthesis. Human body pose serves a dual purpose in our design: as a structural prior, it is fused with a color encoder to refine depth…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Ju Shen , Chen Chen , Tam V. Nguyen , Vijayan K. Asari

In recent years, novel view synthesis from a single image has seen significant progress thanks to the rapid advancements in 3D scene representation and image inpainting techniques. While the current approaches are able to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Avinash Paliwal , Brandon Nguyen , Andrii Tsarov , Nima Khademi Kalantari

In this paper, we propose PixelHuman, a novel human rendering model that generates animatable human scenes from a few images of a person with unseen identity, views, and poses. Previous work have demonstrated reasonable performance in novel…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Gyumin Shim , Jaeseong Lee , Junha Hyung , Jaegul Choo

Taking an image of an object is at its core a lossy process. The rich information about the three-dimensional structure of the world is flattened to an image plane and decisions such as viewpoint and camera parameters are final and not…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Konstantinos Rematas , Chuong Nguyen , Tobias Ritschel , Mario Fritz , Tinne Tuytelaars

Rendering novel view images is highly desirable for many applications. Despite recent progress, it remains challenging to render high-fidelity and view-consistent novel views of large-scale scenes from in-the-wild images with inevitable…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Peng Dai , Yinda Zhang , Xin Yu , Xiaoyang Lyu , Xiaojuan Qi

Novel view synthesis is a challenging problem in computer vision and robotics. Different from the existing works, which need the reference images or 3D models of the scene to generate images under novel views, we propose a novel paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Xiang Guo , Bo Li , Yuchao Dai , Tongxin Zhang , Hui Deng

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Novel view synthesis (NVS) seeks to render photorealistic, 3D-consistent images of a scene from unseen camera poses given only a sparse set of posed views. Existing deterministic networks render observed regions quickly but blur unobserved…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Thanh-Tung Le , Tuan Pham , Tung Nguyen , Deying Kong , Xiaohui Xie , Stephan Mandt