中文
相关论文

相关论文: Learning Multi-Object Dynamics with Compositional …

200 篇论文

Understanding the dynamics of generic 3D scenes is fundamentally challenging in computer vision, essential in enhancing applications related to scene reconstruction, motion tracking, and avatar creation. In this work, we address the task as…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yan Zhang , Sergey Prokudin , Marko Mihajlovic , Qianli Ma , Siyu Tang

The emergence of Neural Radiance Fields (NeRF) has greatly impacted 3D scene modeling and novel-view synthesis. As a kind of visual media for 3D scene representation, compression with high rate-distortion performance is an eternal target.…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Sicheng Li , Hao Li , Yiyi Liao , Lu Yu

There has been rapid progress recently on 3D human rendering, including novel view synthesis and pose animation, based on the advances of neural radiance fields (NeRF). However, most existing methods focus on person-specific training and…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Xiangjun Gao , Jiaolong Yang , Jongyoo Kim , Sida Peng , Zicheng Liu , Xin Tong

Neural Radiance Fields (NeRF) have emerged as a powerful paradigm for 3D scene representation, offering high-fidelity renderings and reconstructions from a set of sparse and unstructured sensor data. In the context of autonomous robotics,…

机器人学 · 计算机科学 2024-12-09 Yuhang Ming , Xingrui Yang , Weihan Wang , Zheng Chen , Jinglun Feng , Yifan Xing , Guofeng Zhang

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

We present NeRFVS, a novel neural radiance fields (NeRF) based method to enable free navigation in a room. NeRF achieves impressive performance in rendering images for novel views similar to the input views while suffering for novel views…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Chen Yang , Peihao Li , Zanwei Zhou , Shanxin Yuan , Bingbing Liu , Xiaokang Yang , Weichao Qiu , Wei Shen

We present CLIP-NeRF, a multi-modal 3D object manipulation method for neural radiance fields (NeRF). By leveraging the joint language-image embedding space of the recent Contrastive Language-Image Pre-Training (CLIP) model, we propose a…

计算机视觉与模式识别 · 计算机科学 2022-03-03 Can Wang , Menglei Chai , Mingming He , Dongdong Chen , Jing Liao

Neural Radiance Fields (NeRFs) have emerged as powerful tools for capturing detailed 3D scenes through continuous volumetric representations. Recent NeRFs utilize feature grids to improve rendering quality and speed; however, these…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Tuan Pham , Stephan Mandt

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Representing and synthesizing novel views in real-world dynamic scenes from casual monocular videos is a long-standing problem. Existing solutions typically approach dynamic scenes by applying geometry techniques or utilizing temporal…

计算机视觉与模式识别 · 计算机科学 2023-01-12 Boyu Zhang , Wenbo Xu , Zheng Zhu , Guan Huang

Fully unsupervised 3D representation learning has gained attention owing to its advantages in data collection. A successful approach involves a viewpoint-aware approach that learns an image distribution based on generative models (e.g.,…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Takuhiro Kaneko

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

The quality of three-dimensional reconstruction is a key factor affecting the effectiveness of its application in areas such as virtual reality (VR) and augmented reality (AR) technologies. Neural Radiance Fields (NeRF) can generate…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Qianqiu Tan , Tao Liu , Yinling Xie , Shuwan Yu , Baohua Zhang

We propose a method that trains a neural radiance field (NeRF) to encode not only the appearance of the scene but also semantic correlations between scene points, regions, or entities -- aiming to capture their mutual co-variation patterns.…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Xiaomeng Xu , Yanchao Yang , Kaichun Mo , Boxiao Pan , Li Yi , Leonidas Guibas

Despite advancements in Neural Implicit models for 3D surface reconstruction, handling dynamic environments with interactions between arbitrary rigid, non-rigid, or deformable entities remains challenging. The generic reconstruction methods…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Sandika Biswas , Qianyi Wu , Biplab Banerjee , Hamid Rezatofighi

We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object and its use as a guide for the reconstruction of the…

计算机视觉与模式识别 · 计算机科学 2021-06-24 Konstantinos Rematas , Ricardo Martin-Brualla , Vittorio Ferrari

Neural Radiance Fields (NeRF) give rise to learning-based 3D reconstruction methods widely used in industrial applications. Although prevalent methods achieve considerable improvements in small-scale scenes, accomplishing reconstruction in…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Bingnan Ni , Huanyu Wang , Dongfeng Bai , Minghe Weng , Dexin Qi , Weichao Qiu , Bingbing Liu

Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However,…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Shanlin Sun , Bingbing Zhuang , Ziyu Jiang , Buyu Liu , Xiaohui Xie , Manmohan Chandraker

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

Neural rendering has garnered substantial attention owing to its capacity for creating realistic 3D scenes. However, its applicability to extensive scenes remains challenging, with limitations in effectiveness. In this work, we propose the…

计算机视觉与模式识别 · 计算机科学 2023-08-31 Zhihao Jia , Bing Wang , Changhao Chen