English
Related papers

Related papers: K-Planes: Explicit Radiance Fields in Space, Time,…

200 papers

Simultaneously localizing camera poses and constructing Gaussian radiance fields in dynamic scenes establish a crucial bridge between 2D images and the 4D real world. Instead of removing dynamic objects as distractors and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yanyan Li , Youxu Fang , Zunjie Zhu , Kunyi Li , Yong Ding , Federico Tombari

We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea is to model the dynamic radiance field as a dynamic system…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Yifan Zhan , Zhuoxiao Li , Muyao Niu , Zhihang Zhong , Shohei Nobuhara , Ko Nishino , Yinqiang Zheng

We present a new method for generating realistic and view-consistent images with fine geometry from 2D image collections. Our method proposes a hybrid explicit-implicit representation called \textbf{OrthoPlanes}, which encodes fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Honglin He , Zhuoqian Yang , Shikai Li , Bo Dai , Wayne Wu

We introduce HouseCrafter, a novel approach that can lift a floorplan into a complete large 3D indoor scene (e.g., a house). Our key insight is to adapt a 2D diffusion model, which is trained on web-scale images, to generate consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Hieu T. Nguyen , Yiwen Chen , Vikram Voleti , Varun Jampani , Huaizu Jiang

We propose a novel, multi-layered planning approach for computing paths that satisfy both kinodynamic and spatiotemporal constraints. Our three-part framework first establishes potential sequences to meet spatial constraints, using them to…

Robotics · Computer Science 2025-05-23 Jeel Chatrola , Abhiroop Ajith , Kevin Leahy , Constantinos Chamzas

Modeling wave properties of light is an important milestone for advancing physically-based rendering. In this paper, we propose complex-valued holographic radiance fields, a method that optimizes scenes without relying on intensity-based…

Graphics · Computer Science 2026-03-27 Yicheng Zhan , Dong-Ha Shin , Seung-Hwan Baek , Kaan Akşit

While 2D generative adversarial networks have enabled high-resolution image synthesis, they largely lack an understanding of the 3D world and the image formation process. Thus, they do not provide precise control over camera viewpoint or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Katja Schwarz , Yiyi Liao , Michael Niemeyer , Andreas Geiger

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

In high-dimensional magnetic resonance imaging applications, time-consuming, sequential acquisition of data samples in the spatial frequency domain ($k$-space) can often be accelerated by accounting for dependencies along imaging dimensions…

Image and Video Processing · Electrical Eng. & Systems 2017-10-24 Evan Levine , Brian Hargreaves

Presenting real-time rendering of 3D surfaces using radiance textures for fast synthesis of complex incidence-variable effects and environment interactions. This includes iridescence, parallax occlusion and interior mapping, (specular,…

Graphics · Computer Science 2023-01-05 Jakub Maksymilian Fober

Addressing the intricate challenge of modeling and re-rendering dynamic scenes, most recent approaches have sought to simplify these complexities using plane-based explicit representations, overcoming the slow training time issues…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Ange Lou , Benjamin Planche , Zhongpai Gao , Yamin Li , Tianyu Luan , Hao Ding , Terrence Chen , Jack Noble , Ziyan Wu

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

Radiance Fields have become a powerful tool for modeling 3D scenes from multiple images. However, they remain difficult to segment into semantically meaningful regions. Some methods work well using 2D semantic masks, but they generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Corentin Dumery , Aoxiang Fan , Ren Li , Nicolas Talabot , Pascal Fua

Beyond novel view synthesis, Neural Radiance Fields are useful for applications that interact with the real world. In this paper, we use them as an implicit map of a given scene and propose a camera relocalization algorithm tailored for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Arthur Moreau , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Modeling Neural Radiance Fields for fast-moving deformable objects from visual data alone is a challenging problem. A major issue arises due to the high deformation and low acquisition rates. To address this problem, we propose to use event…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Qi Ma , Danda Pani Paudel , Ajad Chhatkuli , Luc Van Gool

Extracting planes from a 3D scene is useful for downstream tasks in robotics and augmented reality. In this paper we tackle the problem of estimating the planar surfaces in a scene from posed images. Our first finding is that a surprisingly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Jamie Watson , Filippo Aleotti , Mohamed Sayed , Zawar Qureshi , Oisin Mac Aodha , Gabriel Brostow , Michael Firman , Sara Vicente

We estimate the radiance field of large-scale dynamic areas from multiple vehicle captures under varying environmental conditions. Previous works in this domain are either restricted to static environments, do not scale to more than a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Tobias Fischer , Lorenzo Porzi , Samuel Rota Bulò , Marc Pollefeys , Peter Kontschieder

A high-quality 3D reconstruction of a scene from a collection of 2D images can be achieved through offline/online mapping methods. In this paper, we explore active mapping from the perspective of implicit representations, which have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Huangying Zhan , Jiyang Zheng , Yi Xu , Ian Reid , Hamid Rezatofighi

It has been shown that learning radiance fields with depth rendering and depth supervision can effectively promote the quality and convergence of view synthesis. However, this paradigm requires input RGB-D sequences to be synchronized,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yuxin Huang , Andong Yang , Zirui Wu , Yuantao Chen , Runyi Yang , Zhenxin Zhu , Chao Hou , Hao Zhao , Guyue Zhou

Radiance field methods have achieved photorealistic novel view synthesis and geometry reconstruction. But they are mostly applied in per-scene optimization or small-baseline settings. While several recent works investigate feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Anpei Chen , Haofei Xu , Stefano Esposito , Siyu Tang , Andreas Geiger