English
Related papers

Related papers: MoBluRF: Motion Deblurring Neural Radiance Fields …

200 papers

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Nagabhushan Somraj

We present an algorithm for generating novel views at arbitrary viewpoints and any input time step given a monocular video of a dynamic scene. Our work builds upon recent advances in neural implicit representation and uses continuous and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chen Gao , Ayush Saraf , Johannes Kopf , Jia-Bin Huang

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

We present MovingParts, a NeRF-based method for dynamic scene reconstruction and part discovery. We consider motion as an important cue for identifying parts, that all particles on the same part share the common motion pattern. From the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Kaizhi Yang , Xiaoshuai Zhang , Zhiao Huang , Xuejin Chen , Zexiang Xu , Hao Su

State-of-the-art video deblurring methods cannot handle blurry videos recorded in dynamic scenes, since they are built under a strong assumption that the captured scenes are static. Contrary to the existing methods, we propose a video…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Tae Hyun Kim , Seungjun Nah , Kyoung Mu Lee

Slow shutter speed and long exposure time of frame-based cameras often cause visual blur and loss of inter-frame information, degenerating the overall quality of captured videos. To this end, we present a unified framework of event-based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Xiang Zhang , Lei Yu

Training a Neural Radiance Field (NeRF) without pre-computed camera poses is challenging. Recent advances in this direction demonstrate the possibility of jointly optimising a NeRF and camera poses in forward-facing scenes. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Wenjing Bian , Zirui Wang , Kejie Li , Jia-Wang Bian , Victor Adrian Prisacariu

One of the key components for video deblurring is how to exploit neighboring frames. Recent state-of-the-art methods either used aligned adjacent frames to the center frame or propagated the information on past frames to the current frame…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Dongwon Park , Dong Un Kang , Se Young Chun

Recent neural view synthesis methods have achieved impressive quality and realism, surpassing classical pipelines which rely on multi-view reconstruction. State-of-the-Art methods, such as NeRF, are designed to learn a single scene with a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Julian Chibane , Aayush Bansal , Verica Lazova , Gerard Pons-Moll

Neural Radiance Fields (NeRFs) have shown great potential in modeling 3D scenes. Dynamic NeRFs extend this model by capturing time-varying elements, typically using deformation fields. The existing dynamic NeRFs employ a similar Eulerian…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Ancheng Lin , Yusheng Xiang , Jun Li , Mukesh Prasad

We introduce a new task, novel view synthesis for LiDAR sensors. While traditional model-based LiDAR simulators with style-transfer neural networks can be applied to render novel views, they fall short of producing accurate and realistic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tang Tao , Longfei Gao , Guangrun Wang , Yixing Lao , Peng Chen , Hengshuang Zhao , Dayang Hao , Xiaodan Liang , Mathieu Salzmann , Kaicheng Yu

Removing spatially variant motion blur from a blurry image is a challenging problem as blur sources are complicated and difficult to model accurately. Recent progress in deep neural networks suggests that kernel free single image deblurring…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Shuang Zhang , Ada Zhen , Robert L. Stevenson

Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Letian Zhang , Ming Li , Chen Chen , Jie Xu

Neural radiance fields (NeRF) encode a scene into a neural representation that enables photo-realistic rendering of novel views. However, a successful reconstruction from RGB images requires a large number of input views taken under static…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Barbara Roessle , Jonathan T. Barron , Ben Mildenhall , Pratul P. Srinivasan , Matthias Nießner

We introduce HOSNeRF, a novel 360{\deg} free-viewpoint rendering method that reconstructs neural radiance fields for dynamic human-object-scene from a single monocular in-the-wild video. Our method enables pausing the video at any frame and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Jia-Wei Liu , Yan-Pei Cao , Tianyuan Yang , Eric Zhongcong Xu , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

Neural radiance field (NeRF), in particular its extension by instant neural graphics primitives, is a novel rendering method for view synthesis that uses real-world images to build photo-realistic immersive virtual scenes. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Ke Li , Tim Rolff , Susanne Schmidt , Reinhard Bacher , Simone Frintrop , Wim Leemans , Frank Steinicke

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field (GSNeRF), which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Zi-Ting Chou , Sheng-Yu Huang , I-Jieh Liu , Yu-Chiang Frank Wang

Neural radiance fields (NeRFs) have enabled high fidelity 3D reconstruction from multiple 2D input views. However, a well-known drawback of NeRFs is the less-than-ideal performance under a small number of views, due to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Mikaela Angelina Uy , Ricardo Martin-Brualla , Leonidas Guibas , Ke Li

3D understanding and rendering of moving humans from monocular videos is a challenging task. Despite recent progress, the task remains difficult in real-world scenarios, where obstacles may block the camera view and cause partial occlusions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Tiange Xiang , Adam Sun , Jiajun Wu , Ehsan Adeli , Li Fei-Fei

Rendering moving human bodies at free viewpoints only from a monocular video is quite a challenging problem. The information is too sparse to model complicated human body structures and motions from both view and pose dimensions. Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Taoran Yi , Jiemin Fang , Xinggang Wang , Wenyu Liu