English
Related papers

Related papers: ObjectSDF++: Improved Object-Compositional Neural …

200 papers

Scene and object reconstruction is an important problem in robotics, in particular in planning collision-free trajectories or in object manipulation. This paper compares two strategies for the reconstruction of nonvisible parts of the…

Robotics · Computer Science 2025-01-28 Rafał Staszak , Piotr Michałek , Jakub Chudziński , Marek Kopicki , Dominik Belter

Object-centric surface reconstruction from multi-view images is crucial in creating editable digital assets for AR/VR. Due to the lack of geometric constraints, existing methods, e.g., NeuS necessitate annotating the object masks to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Haotian Bai , Yize Chen , Lin Wang

Implicit surface representations such as the signed distance function (SDF) have emerged as a promising approach for image-based surface reconstruction. However, existing optimization methods assume solid surfaces and are therefore unable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Tianhao Wu , Hanxue Liang , Fangcheng Zhong , Gernot Riegler , Shimon Vainer , Jiankang Deng , Cengiz Oztireli

SDF-based differential rendering frameworks have achieved state-of-the-art multiview 3D shape reconstruction. In this work, we re-examine this family of approaches by minimally reformulating its core appearance model in a way that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Briac Toussaint , Diego Thomas , Jean-Sébastien Franco

In recent years, neural implicit surface reconstruction methods have become popular for multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these approaches tend to produce smoother and more complete…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zehao Yu , Songyou Peng , Michael Niemeyer , Torsten Sattler , Andreas Geiger

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

Neural implicit surface representations have recently emerged as popular alternative to explicit 3D object encodings, such as polygonal meshes, tabulated points, or voxels. While significant work has improved the geometric fidelity of these…

Graphics · Computer Science 2023-06-27 Yanran Guan , Andrei Chubarau , Ruby Rao , Derek Nowrouzezahrai

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Reconstructing objects with realistic materials from multi-view images is problematic, since it is highly ill-posed. Although the neural reconstruction approaches have exhibited impressive reconstruction ability, they are designed for…

Graphics · Computer Science 2024-05-07 Jia Li , Lu Wang , Lei Zhang , Beibei Wang

Neural implicit representation of geometric shapes has witnessed considerable advancements in recent years. However, common distance field based implicit representations, specifically signed distance field (SDF) for watertight shapes or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yujie Lu , Long Wan , Nayu Ding , Yulong Wang , Shuhan Shen , Shen Cai , Lin Gao

We propose SDFDiff, a novel approach for image-based shape optimization using differentiable rendering of 3D shapes represented by signed distance functions (SDFs). Compared to other representations, SDFs have the advantage that they can…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yue Jiang , Dantong Ji , Zhizhong Han , Matthias Zwicker

Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Rahul Venkatesh , Tejan Karmali , Sarthak Sharma , Aurobrata Ghosh , R. Venkatesh Babu , László A. Jeni , Maneesh Singh

Differentiable rendering is an essential operation in modern vision, allowing inverse graphics approaches to 3D understanding to be utilized in modern machine learning frameworks. Explicit shape representations (voxels, point clouds, or…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Tristan Aumentado-Armstrong , Stavros Tsogkas , Sven Dickinson , Allan Jepson

Accurate 3D shape representation is essential in engineering applications such as design, optimization, and simulation. In practice, engineering workflows require structured, part-based representations, as objects are inherently designed as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Nicolas Talabot , Olivier Clerc , Arda Cinar Demirtas , Alexis Goujon , Hieu Le , Doruk Oner , Pascal Fua

Dense 3D object reconstruction from a single image has recently witnessed remarkable advances, but supervising neural networks with ground-truth 3D shapes is impractical due to the laborious process of creating paired image-shape datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Chen-Hsuan Lin , Chaoyang Wang , Simon Lucey

A variety of Neural Radiance Fields (NeRF) methods have recently achieved remarkable success in high render speed. However, current accelerating methods are specialized and incompatible with various implicit methods, preventing real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyu Gao , Ziyi Yang , Yunlu Zhao , Yuxiang Sun , Xiaogang Jin , Changqing Zou

This paper proposes a deep-learning-based method for recovering a signed distance function (SDF) of a given hypersurface represented by an implicit level set function. Using the flexibility of constructing a neural network, we use an…

Numerical Analysis · Mathematics 2023-05-16 Yesom Park , Chang hoon Song , Jooyoung Hahn , Myungjoo Kang

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Tanmay Gupta , Daeyun Shin , Naren Sivagnanadasan , Derek Hoiem

We present a novel method, called NeTO, for capturing 3D geometry of solid transparent objects from 2D images via volume rendering. Reconstructing transparent objects is a very challenging task, which is ill-suited for general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Zongcheng Li , Xiaoxiao Long , Yusen Wang , Tuo Cao , Wenping Wang , Fei Luo , Chunxia Xiao

Traditional 3D shape reconstruction techniques from multi-view images, such as structure from motion and multi-view stereo, face challenges in reconstructing transparent objects. Recent advances in neural radiance fields and its variants…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Haoran Zhang , Junkai Deng , Xuhui Chen , Fei Hou , Wencheng Wang , Hong Qin , Chen Qian , Ying He