English
Related papers

Related papers: StyleDyRF: Zero-shot 4D Style Transfer for Dynamic…

200 papers

Current 3D scene stylization methods transfer textures and colors as styles using arbitrary style references, lacking meaningful semantic correspondences. We introduce Reference-Based Non-Photorealistic Radiance Fields (Ref-NPR) to address…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuechen Zhang , Zexin He , Jinbo Xing , Xufeng Yao , Jiaya Jia

Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiemin Fang , Lingxi Xie , Xinggang Wang , Xiaopeng Zhang , Wenyu Liu , Qi Tian

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Neural radiance fields (NeRFs) have emerged as a prominent pre-training paradigm for vision-centric autonomous driving, which enhances 3D geometry and appearance understanding in a fully self-supervised manner. To apply NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hyeonjun Jeong , Juyeb Shin , Dongsuk Kum

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

We present the first method capable of photorealistically reconstructing deformable scenes using photos/videos captured casually from mobile phones. Our approach augments neural radiance fields (NeRF) by optimizing an additional continuous…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Steven M. Seitz , Ricardo Martin-Brualla

Representation learning aims to discover individual salient features of a domain in a compact and descriptive form that strongly identifies the unique characteristics of a given sample respective to its domain. Existing works in visual…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Dan Ruta , Gemma Canet Tarres , Alexander Black , Andrew Gilbert , John Collomosse

Event cameras are neuromorphic vision sensors that asynchronously capture changes in logarithmic brightness changes, offering significant advantages such as low latency, low power consumption, low bandwidth, and high dynamic range. While…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Yuanjian Wang , Yufei Deng , Rong Xiao , Jiahao Fan , Chenwei Tang , Deng Xiong , Jiancheng Lv

Photorealistic style transfer aims to transfer the artistic style of an image onto an input image or video while keeping photorealism. In this paper, we think it's the summary statistics matching scheme in existing algorithms that leads to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Xiaowen Qiu , Ruize Xu , Boan He , Yingtao Zhang , Wenqiang Zhang , Weifeng Ge

In this paper, we present a Neural Preset technique to address the limitations of existing color style transfer methods, including visual artifacts, vast memory requirement, and slow style switching speed. Our method is based on two core…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhanghan Ke , Yuhao Liu , Lei Zhu , Nanxuan Zhao , Rynson W. H. Lau

Radiance of real-world scenes typically spans a much wider dynamic range than what standard cameras can capture. While conventional HDR methods merge alternating-exposure frames, these approaches are inherently constrained to 2D pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Shin Dong-Yeon , Kim Jun-Seong , Kwon Byung-Ki , Tae-Hyun Oh

We propose a Few-shot Dynamic Neural Radiance Field (FDNeRF), the first NeRF-based method capable of reconstruction and expression editing of 3D faces based on a small number of dynamic images. Unlike existing dynamic NeRFs that require…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

We apply style transfer on mesh reconstructions of indoor scenes. This enables VR applications like experiencing 3D environments painted in the style of a favorite artist. Style transfer typically operates on 2D images, making stylization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Lukas Höllein , Justin Johnson , Matthias Nießner

Recent advancements in dynamic neural radiance field methods have yielded remarkable outcomes. However, these approaches rely on the assumption of sharp input images. When faced with motion blur, existing dynamic NeRF methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Huiqiang Sun , Xingyi Li , Liao Shen , Xinyi Ye , Ke Xian , Zhiguo Cao

We present Neural Feature Fusion Fields (N3F), a method that improves dense 2D image feature extractors when the latter are applied to the analysis of multiple images reconstructible as a 3D scene. Given an image feature extractor, for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Vadim Tschernezki , Iro Laina , Diane Larlus , Andrea Vedaldi

Dynamic scenes rendering is an intriguing yet challenging problem. Although current methods based on NeRF have achieved satisfactory performance, they still can not reach real-time levels. Recently, 3D Gaussian Splatting (3DGS) has garnered…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Jiahao Lu , Jiacheng Deng , Ruijie Zhu , Yanzhe Liang , Wenfei Yang , Tianzhu Zhang , Xu Zhou

Neural Radiance Fields (NeRFs) have emerged as powerful tools for capturing detailed 3D scenes through continuous volumetric representations. Recent NeRFs utilize feature grids to improve rendering quality and speed; however, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Tuan Pham , Stephan Mandt

Dynamic Neural Radiance Field (NeRF) is a powerful algorithm capable of rendering photo-realistic novel view images from a monocular RGB video of a dynamic scene. Although it warps moving points across frames from the observation spaces to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zhiwen Yan , Chen Li , Gim Hee Lee