English
Related papers

Related papers: A self-supervised cyclic neural-analytic approach …

200 papers

Is a geometric model required to synthesize novel views from a single image? Being bound to local convolutions, CNNs need explicit 3D biases to model geometric transformations. In contrast, we demonstrate that a transformer-based model can…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Robin Rombach , Patrick Esser , Björn Ommer

Researches in novel viewpoint synthesis majorly focus on interpolation from multi-view input images. In this paper, we focus on a more challenging and ill-posed problem that is to synthesize novel viewpoints from one single input image. To…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Xiaodong Cun , Feng Xu , Chi-Man Pun , Hao Gao

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

While Unmanned Aerial Vehicles (UAVs) have gained significant traction across various fields, path planning in 3D environments remains a critical challenge, particularly under size, weight, and power (SWAP) constraints. Traditional modular…

Robotics · Computer Science 2026-03-05 Yufei Jiang , Yuanzhu Zhan , Harsh Vardhan Gupta , Chinmay Borde , Junyi Geng

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

Realistic view extrapolation is critical for closed-loop simulation in autonomous driving, yet it remains a significant challenge for current Novel View Synthesis (NVS) methods, which often produce distorted and inconsistent images beyond…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Kaiyuan Tan , Yingying Shen , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye

Reconstructing photo-realistic large-scale scenes from images, for example at city scale, is a long-standing problem in computer graphics. Neural rendering is an emerging technique that enables photo-realistic image synthesis from…

Graphics · Computer Science 2025-07-22 Yaru Liu , Derek Nowrouzezahri , Morgan Mcguire

We present CG-NeRF, a cascade and generalizable neural radiance fields method for view synthesis. Recent generalizing view synthesis methods can render high-quality novel views using a set of nearby input views. However, the rendering speed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Phong Nguyen-Ha , Lam Huynh , Esa Rahtu , Jiri Matas , Janne Heikkila

To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e.g., motion capture, sport analysis) and robustness to single-view ambiguities. Existing solutions typically suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xuan Gong , Liangchen Song , Meng Zheng , Benjamin Planche , Terrence Chen , Junsong Yuan , David Doermann , Ziyan Wu

Automatic reconstruction of 3D models from images using multi-view Structure-from-Motion methods has been one of the most fruitful outcomes of computer vision. These advances combined with the growing popularity of Micro Aerial Vehicles as…

Robotics · Computer Science 2016-11-15 Shreyansh Daftry , Christof Hoppe , Horst Bischof

View-dependent effects such as reflections pose a substantial challenge for image-based and neural rendering algorithms. Above all, curved reflectors are particularly hard, as they lead to highly non-linear reflection flows as the camera…

Graphics · Computer Science 2023-01-04 Georgios Kopanas , Thomas Leimkühler , Gilles Rainer , Clément Jambon , George Drettakis

Recent implicit neural representations have shown great results for novel view synthesis. However, existing methods require expensive per-scene optimization from many views hence limiting their application to real-world unbounded urban…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Muhammad Zubair Irshad , Sergey Zakharov , Katherine Liu , Vitor Guizilini , Thomas Kollar , Adrien Gaidon , Zsolt Kira , Rares Ambrus

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Asynchronously operating event cameras find many applications due to their high dynamic range, vanishingly low motion blur, low latency and low data bandwidth. The field saw remarkable progress during the last few years, and existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Viktor Rudnev , Mohamed Elgharib , Christian Theobalt , Vladislav Golyanik

Witnessed the development of deep learning, increasing number of studies try to build computer aided diagnosis systems for 3D volumetric medical data. However, as the annotations of 3D medical data are difficult to acquire, the number of…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Xinrui Zhuang , Yuexiang Li , Yifan Hu , Kai Ma , Yujiu Yang , Yefeng Zheng

A central challenge in data visualization is to understand which data samples are required to generate an image of a data set in which the relevant information is encoded. In this work, we make a first step towards answering the question of…

Graphics · Computer Science 2021-03-12 Sebastian Weiss , Mustafa Işık , Justus Thies , Rüdiger Westermann

This work introduces VISY-REVE: a novel pipeline to validate image processing algorithms for Vision-Based Navigation. Traditional validation methods such as synthetic rendering or robotic testbed acquisition suffer from difficult setup and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Marius Neuhalfen , Jonathan Grzymisch , Manuel Sanchez-Gestido

Synthesizing photo-realistic visual observations from an ego vehicle's driving trajectory is a critical step towards scalable training of self-driving models. Reconstruction-based methods create 3D scenes from driving logs and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiageng Mao , Boyi Li , Boris Ivanovic , Yuxiao Chen , Yan Wang , Yurong You , Chaowei Xiao , Danfei Xu , Marco Pavone , Yue Wang

Novel view synthesis (NVS) seeks to render photorealistic, 3D-consistent images of a scene from unseen camera poses given only a sparse set of posed views. Existing deterministic networks render observed regions quickly but blur unobserved…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Thanh-Tung Le , Tuan Pham , Tung Nguyen , Deying Kong , Xiaohui Xie , Stephan Mandt

We propose a novel method to reconstruct volumetric flows from sparse views via a global transport formulation. Instead of obtaining the space-time function of the observations, we reconstruct its motion based on a single initial state. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Aleksandra Franz , Barbara Solenthaler , Nils Thuerey