English
Related papers

Related papers: EvDNeRF: Reconstructing Event Data with Dynamic Ne…

200 papers

Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Liangchen Song , Anpei Chen , Zhong Li , Zhang Chen , Lele Chen , Junsong Yuan , Yi Xu , Andreas Geiger

We present the first method capable of photorealistically reconstructing deformable scenes using photos/videos captured casually from mobile phones. Our approach augments neural radiance fields (NeRF) by optimizing an additional continuous…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Steven M. Seitz , Ricardo Martin-Brualla

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Neural Radiance Fields (NeRF) have demonstrated superior novel view synthesis performance but are slow at rendering. To speed up the volume rendering process, many acceleration methods have been proposed at the cost of large memory…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Sicheng Li , Hao Li , Yue Wang , Yiyi Liao , Lu Yu

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

Electroencephalography (EEG) data present unique modeling challenges because recordings vary in length, exhibit very low signal to noise ratios, differ significantly across participants, drift over time within sessions, and are rarely…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Shahar Ain Kedem , Itamar Zimerman , Eliya Nachmani

Event cameras are novel sensors that report brightness changes in the form of a stream of asynchronous "events" instead of intensity frames. They offer significant advantages with respect to conventional cameras: high temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Henri Rebecq , René Ranftl , Vladlen Koltun , Davide Scaramuzza

Recent advances in Neural Radiance Fields (NeRFs) have made it possible to reconstruct and reanimate dynamic portrait scenes with control over head-pose, facial expressions and viewing direction. However, training such models assumes…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 ShahRukh Athar , Zhixin Shu , Zexiang Xu , Fujun Luan , Sai Bi , Kalyan Sunkavalli , Dimitris Samaras

Video data is often repetitive; for example, the contents of adjacent frames are usually strongly correlated. Such redundancy occurs at multiple levels of complexity, from low-level pixel values to textures and high-level semantics. We…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Matthew Dutson , Yin Li , Mohit Gupta

Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes. Compared to traditional frame-based cameras, event cameras produce sparse yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Chuanzhi Xu , Haoxian Zhou , Langyi Chen , Haodong Chen , Zeke Zexi Hu , Zhicheng Lu , Ying Zhou , Vera Chung , Qiang Qu , Weidong Cai

Event cameras asynchronously capture brightness changes with microsecond latency, offering exceptional temporal precision but suffering from severe noise and signal inconsistencies. Unlike conventional signals, events carry state…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Jinze Chen , Wei Zhai , Yang Cao , Bin Li , Zheng-Jun Zha

Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chaoyang Wang , Ben Eckart , Simon Lucey , Orazio Gallo

Event cameras sense intensity changes and have many advantages over conventional cameras. To take advantage of event cameras, some methods have been proposed to reconstruct intensity images from event streams. However, the outputs are still…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Lin Wang , Tae-Kyun Kim , Kuk-Jin Yoon

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

Event-stream representation is the first step for many computer vision tasks using event cameras. It converts the asynchronous event-streams into a formatted structure so that conventional machine learning models can be applied easily.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Qiang Qu , Xiaoming Chen , Yuk Ying Chung , Yiran Shen

Underwater imaging is a critical task performed by marine robots for a wide range of applications including aquaculture, marine infrastructure inspection, and environmental monitoring. However, water column effects, such as attenuation and…

Neural Radiance Fields (NeRFs) learn to represent a 3D scene from just a set of registered images. Increasing sizes of a scene demands more complex functions, typically represented by neural networks, to capture all details. Training and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Tim Elsner , Victor Czech , Julia Berger , Zain Selman , Isaak Lim , Leif Kobbelt

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang