中文
相关论文

相关论文: C-NERF: Representing Scene Changes as Directional …

200 篇论文

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original…

图形学 · 计算机科学 2021-09-07 Wonbong Jang , Lourdes Agapito

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruction capabilities with dense view images. However, its performance significantly deteriorates under sparse view settings. We observe that learning the 3D consistency of…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Shoukang Hu , Kaichen Zhou , Kaiyu Li , Longhui Yu , Lanqing Hong , Tianyang Hu , Zhenguo Li , Gim Hee Lee , Ziwei Liu

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Advances in image diffusion models have recently led to notable improvements in the generation of high-quality images. In combination with Neural Radiance Fields (NeRFs), they enabled new opportunities in 3D generation. However, most…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Jan-Niklas Dihlmann , Andreas Engelhardt , Hendrik Lensch

The ability to reason about changes in the environment is crucial for robots operating over extended periods of time. Agents are expected to capture changes during operation so that actions can be followed to ensure a smooth progression of…

机器人学 · 计算机科学 2022-08-02 Jiahui Fu , Yilun Du , Kurran Singh , Joshua B. Tenenbaum , John J. Leonard

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

Though neural radiance fields (NeRF) have demonstrated impressive view synthesis results on objects and small bounded regions of space, they struggle on "unbounded" scenes, where the camera may point in any direction and content may exist…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Jonathan T. Barron , Ben Mildenhall , Dor Verbin , Pratul P. Srinivasan , Peter Hedman

Recently neural scene representations have provided very impressive results for representing 3D scenes visually, however, their study and progress have mainly been limited to visualization of virtual models in computer graphics or scene…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Yassine Ahmine , Arnab Dey , Andrew I. Comport

Finding and localizing the conceptual changes in two scenes in terms of the presence or removal of objects in two images belonging to the same scene at different times in special care applications is of great significance. This is mainly…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Ali Atghaei , Ehsan Rahnama , Kiavash Azimi , Hassan Shahbazi

When a camera travels across a 3D world, only a fraction of pixel value changes; an event-based camera observes the change as sparse events. How can we utilize sparse events for efficient recovery of the camera pose? We show that we can…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Mana Masuda , Yusuke Sekikawa , Hideo Saito

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

Neural Radiance Field (NeRF) has exhibited outstanding three-dimensional (3D) reconstruction quality via the novel view synthesis from multi-view images and paired calibrated camera parameters. However, previous NeRF-based systems have been…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Dogyoon Lee , Minhyeok Lee , Chajin Shin , Sangyoun Lee

Neural radiance fields (NeRFs) generally require many images with accurate poses for accurate novel view synthesis, which does not reflect realistic setups where views can be sparse and poses can be noisy. Previous solutions for learning…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Jinjie Mai , Wenxuan Zhu , Sara Rojas , Jesus Zarzar , Abdullah Hamdi , Guocheng Qian , Bing Li , Silvio Giancola , Bernard Ghanem

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Can machines recording an audio-visual scene produce realistic, matching audio-visual experiences at novel positions and novel view directions? We answer it by studying a new task -- real-world audio-visual scene synthesis -- and a…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Susan Liang , Chao Huang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

计算机视觉与模式识别 · 计算机科学 2021-04-30 Michael Niemeyer , Andreas Geiger

Neural Radiance Fields (NeRF) have achieved huge success in effectively capturing and representing 3D objects and scenes. However, to establish a ubiquitous presence in everyday media formats, such as images and videos, we need to fulfill…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Gyeongjin Kang , Younggeun Lee , Seungjun Oh , Eunbyung Park

Reasoning the 3D structure of a non-rigid dynamic scene from a single moving camera is an under-constrained problem. Inspired by the remarkable progress of neural radiance fields (NeRFs) in photo-realistic novel view synthesis of static…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Sameera Ramasinghe , Violetta Shevchenko , Gil Avraham , Anton Van Den Hengel

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

Scene change detection is an image processing problem related to partitioning pixels of a digital image into foreground and background regions. Mostly, visual knowledge-based computer intelligent systems, like traffic monitoring, video…

计算机视觉与模式识别 · 计算机科学 2022-12-21 Daniel F. S. Santos , Rafael G. Pires , Danilo Colombo , João P. Papa