English
Related papers

Related papers: SynSin: End-to-end View Synthesis from a Single Im…

200 papers

Novel view synthesis from a single image has recently attracted a lot of attention, and it has been primarily advanced by 3D deep learning and rendering techniques. However, most work is still limited by synthesizing new views within…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Xuanchi Ren , Xiaolong Wang

Differentiable rendering is a very successful technique that applies to a Single-View 3D Reconstruction. Current renderers use losses based on pixels between a rendered image of some 3D reconstructed object and ground-truth images from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nikola Zubić , Pietro Liò

We study the problem of synthesizing a long-term dynamic video from only a single image. This is challenging since it requires consistent visual content movements given large camera motions. Existing methods either hallucinate inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Liao Shen , Xingyi Li , Huiqiang Sun , Juewen Peng , Ke Xian , Zhiguo Cao , Guosheng Lin

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Synthesizing photo-realistic images from a point cloud is challenging because of the sparsity of point cloud representation. Recent Neural Radiance Fields and extensions are proposed to synthesize realistic images from 2D input. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tao Hu , Xiaogang Xu , Shu Liu , Jiaya Jia

Learning-based methods for 3D scene reconstruction and object completion require large datasets containing partial scans paired with complete ground-truth geometry. However, acquiring such datasets using real-world scanning systems is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jelle Vermandere , Maarten Bassier , Maarten Vergauwen

We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images from only a single training sample. We leverage the knowledge of image semantics from a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Pei Wang , Yijun Li , Krishna Kumar Singh , Jingwan Lu , Nuno Vasconcelos

We address the task of view synthesis, generating novel views of a scene given a set of images as input. In many recent works such as NeRF (Mildenhall et al., 2020), the scene geometry is parameterized using neural implicit representations…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yiming Zuo , Jia Deng

Generating novel views of an object from a single image is a challenging task. It requires an understanding of the underlying 3D structure of the object from an image and rendering high-quality, spatially consistent new views. While recent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jeong-gi Kwak , Erqun Dong , Yuhe Jin , Hanseok Ko , Shweta Mahajan , Kwang Moo Yi

We tackle a 3D scene stylization problem - generating stylized images of a scene from arbitrary novel views given a set of images of the same scene and a reference image of the desired style as inputs. Direct solution of combining novel…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Hsin-Ping Huang , Hung-Yu Tseng , Saurabh Saini , Maneesh Singh , Ming-Hsuan Yang

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

We address the problem of novel view synthesis: given an input image, synthesizing new images of the same object or scene observed from arbitrary viewpoints. We approach this as a learning task but, critically, instead of learning to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Tinghui Zhou , Shubham Tulsiani , Weilun Sun , Jitendra Malik , Alexei A. Efros

Zero-shot novel view synthesis (NVS) from a single image is an essential problem in 3D object understanding. While recent approaches that leverage pre-trained generative models can synthesize high-quality novel views from in-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jianglong Ye , Peng Wang , Kejie Li , Yichun Shi , Heng Wang

Manipulating the illumination of a 3D scene within a single image represents a fundamental challenge in computer vision and graphics. This problem has traditionally been addressed using inverse rendering techniques, which involve explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Shrisha Bharadwaj , Haiwen Feng , Giorgio Becherini , Victoria Fernandez Abrevaya , Michael J. Black

We present a novel method for synthesizing both temporally and geometrically consistent street-view panoramic video from a single satellite image and camera trajectory. Existing cross-view synthesis approaches focus on images, while video…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zuoyue Li , Zhenqiang Li , Zhaopeng Cui , Rongjun Qin , Marc Pollefeys , Martin R. Oswald

Recent conditional image synthesis approaches provide high-quality synthesized images. However, it is still challenging to accurately adjust image contents such as the positions and orientations of objects, and synthesized images often have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Jaebong Jeong , Janghun Jo , Jingdong Wang , Sunghyun Cho , Jaesik Park

Object viewpoint estimation from 2D images is an essential task in computer vision. However, two issues hinder its progress: scarcity of training data with viewpoint annotations, and a lack of powerful features. Inspired by the growing…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Hao Su , Charles R. Qi , Yangyan Li , Leonidas Guibas

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury

3D model generation from single 2D RGB images is a challenging and actively researched computer vision task. Various techniques using conventional network architectures have been proposed for the same. However, the body of research work is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Abdul Mueed Hafiz , Rouf Ul Alam Bhat , Shabir Ahmad Parah , M. Hassaballah

With deep learning becoming a more prominent approach for automatic classification of three-dimensional point cloud data, a key bottleneck is the amount of high quality training data, especially when compared to that available for…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 David Griffiths , Jan Boehm