English
Related papers

Related papers: Canonical Fields: Self-Supervised Learning of Pose…

200 papers

Multi-view 3D human pose estimation is naturally superior to single view one, benefiting from more comprehensive information provided by images of multiple views. The information includes camera poses, 2D/3D human poses, and 3D geometry.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Xiaoben Li , Mancheng Meng , Ziyan Wu , Terrence Chen , Fan Yang , Dinggang Shen

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Axel Levy , Mark Matthews , Matan Sela , Gordon Wetzstein , Dmitry Lagun

Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Miriam Jäger , Patrick Hübner , Dennis Haitz , Boris Jutzi

We present a method to learn compositional multi-object dynamics models from image observations based on implicit object encoders, Neural Radiance Fields (NeRFs), and graph neural networks. NeRFs have become a popular choice for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Danny Driess , Zhiao Huang , Yunzhu Li , Russ Tedrake , Marc Toussaint

No significant work has been done to directly merge two partially overlapping scenes using NeRF representations. Given pre-trained NeRF models of a 3D scene with partial overlapping, this paper aligns them with a rigid transform, by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Han Jiang , Ruoxuan Li , Haosen Sun , Yu-Wing Tai , Chi-Keung Tang

Novel view synthesis has recently made significant progress with the advent of Neural Radiance Fields (NeRF). DietNeRF is an extension of NeRF that aims to achieve this task from only a few images by introducing a new loss function for…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Daiju Kanaoka , Motoharu Sonogashira , Hakaru Tamukoh , Yasutomo Kawanishi

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle

We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangled manner, and are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xiu Li , Xiao Li , Yan Lu

Point cloud processing poses two fundamental challenges: establishing consistent point ordering and effectively learning fine-grained geometric features. Current architectures rely on complex operations that limit expressivity while…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Benjy Friedmann , Michael Werman

Category-level articulated object pose estimation aims to estimate a hierarchy of articulation-aware object poses of an unseen articulated object from a known category. To reduce the heavy annotations needed for supervised learning methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Xueyi Liu , Ji Zhang , Ruizhen Hu , Haibin Huang , He Wang , Li Yi

The development of Neural Radiance Fields (NeRFs) has provided a potent representation for encapsulating the geometric and appearance characteristics of 3D scenes. Enhancing the capabilities of NeRFs in open-vocabulary 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guibiao Liao , Kaichen Zhou , Zhenyu Bao , Kanglin Liu , Qing Li

Obtaining a better knowledge of the current state and behavior of objects orbiting Earth has proven to be essential for a range of applications such as active debris removal, in-orbit maintenance, or anomaly detection. 3D models represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Clément Forray , Pauline Delporte , Nicolas Delaygue , Florence Genin , Dawa Derksen

We introduce anchored radial observations (ARO), a novel shape encoding for learning implicit field representation of 3D shapes that is category-agnostic and generalizable amid significant shape variations. The main idea behind our work is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yizhi Wang , Zeyu Huang , Ariel Shamir , Hui Huang , Hao Zhang , Ruizhen Hu

3D shape analysis has been widely explored in the era of deep learning. Numerous models have been developed for various 3D data representation formats, e.g., MeshCNN for meshes, PointNet for point clouds and VoxNet for voxels. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xiaoyang Huang , Jiancheng Yang , Yanjun Wang , Ziyu Chen , Linguo Li , Teng Li , Bingbing Ni , Wenjun Zhang

This paper introduces a novel paradigm for the generalizable neural radiance field (NeRF). Previous generic NeRF methods combine multiview stereo techniques with image-based neural rendering for generalization, yielding impressive results,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jiaxu Wang , Ziyi Zhang , Renjing Xu

We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Marco Orsingher , Paolo Zani , Paolo Medici , Massimo Bertozzi

We cast multiview reconstruction from unknown pose as a generative modeling problem. From a collection of unannotated 2D images of a scene, our approach simultaneously learns both a network to predict camera pose from 2D image input, as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xin Yuan , Rana Hanocka , Michael Maire

Neural Radiance Field (NeRF) models are implicit neural scene representation methods that offer unprecedented capabilities in novel view synthesis. Semantically-aware NeRFs not only capture the shape and radiance of a scene, but also encode…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuzhe Zhu , Lile Cai , Kangkang Lu , Fayao Liu , Xulei Yang

Neural Radiance Fields (NeRF) show impressive performance in photo-realistic free-view rendering of scenes. Recent improvements on the NeRF such as TensoRF and ZipNeRF employ explicit models for faster optimization and rendering, as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Nagabhushan Somraj , Sai Harsha Mupparaju , Adithyan Karanayil , Rajiv Soundararajan

The 3D-aware image synthesis focuses on conserving spatial consistency besides generating high-resolution images with fine details. Recently, Neural Radiance Field (NeRF) has been introduced for synthesizing novel views with low…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiwook Kim , Minhyeok Lee