English
Related papers

Related papers: Envisioning a Next Generation Extended Reality Con…

200 papers

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

The advancement of text-driven 3D content editing has been blessed by the progress from 2D generative diffusion models. However, a major obstacle hindering the widespread adoption of 3D content editing is its time-intensive processing. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Liangchen Song , Liangliang Cao , Jiatao Gu , Yifan Jiang , Junsong Yuan , Hao Tang

This paper aims to tackle the challenge of efficiently producing interactive free-viewpoint videos. Some recent works equip neural radiance fields with image encoders, enabling them to generalize across scenes. When processing dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Haotong Lin , Sida Peng , Zhen Xu , Yunzhi Yan , Qing Shuai , Hujun Bao , Xiaowei Zhou

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, however, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

Recent work on Neural Radiance Fields (NeRF) has demonstrated significant advances in high-quality view synthesis. A major limitation of NeRF is its low rendering efficiency due to the need for multiple network forwardings to render a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yushuang Wu , Xiao Li , Jinglu Wang , Xiaoguang Han , Shuguang Cui , Yan Lu

While the presentation of photo-realistic appearance plays a major role in immersion in an augmented virtuality environment, displaying the photo-realistic appearance of real objects remains a challenging problem. Recent developments in…

Human-Computer Interaction · Computer Science 2022-10-25 Yuichi Hiroi , Yuta Itoh , Jun Rekimoto

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

Neural rendering is a new image and video generation method based on deep learning. It combines the deep learning model with the physical knowledge of computer graphics, to obtain a controllable and realistic scene model, and realize the…

Graphics · Computer Science 2024-02-02 Xinkai Yan , Jieting Xu , Yuchi Huo , Hujun Bao

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Neural volume rendering techniques, such as NeRF, have revolutionized 3D-aware image synthesis by enabling the generation of images of a single scene or object from various camera poses. However, the high computational cost of NeRF presents…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Peng Zheng , Linzhi Huang , Yizhou Yu , Yi Chang , Yilin Wang , Rui Ma

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Large industrial facilities such as particle accelerators and nuclear power plants are critical infrastructures for scientific research and industrial processes. These facilities are complex systems that not only require regular maintenance…

Graphics · Computer Science 2024-10-28 Ke Li , Susanne Schmidt , Tim Rolff , Reinhard Bacher , Wim Leemans , Frank Steinicke

Neural rendering has garnered substantial attention owing to its capacity for creating realistic 3D scenes. However, its applicability to extensive scenes remains challenging, with limitations in effectiveness. In this work, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Zhihao Jia , Bing Wang , Changhao Chen

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

The metaverse is expected to provide immersive entertainment, education, and business applications. However, virtual reality (VR) transmission over wireless networks is data- and computation-intensive, making it critical to introduce novel…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Yiyu Guo , Zhijin Qin , Xiaoming Tao , Geoffrey Ye Li

Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of high quality novel view synthesis of complex scenes. While NeRFs have been applied to graphics, vision, and robotics, problems with slow rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tristan Aumentado-Armstrong , Ashkan Mirzaei , Marcus A. Brubaker , Jonathan Kelly , Alex Levinshtein , Konstantinos G. Derpanis , Igor Gilitschenski

Event cameras offer many advantages over standard cameras due to their distinctive principle of operation: low power, low latency, high temporal resolution and high dynamic range. Nonetheless, the success of many downstream visual…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Weng Fei Low , Gim Hee Lee