English
Related papers

Related papers: SAM3D-Phys: Towards Multi-Object Interactive Simul…

200 papers

We present a method for the accurate 3D reconstruction of partly-symmetric objects. We build on the strengths of recent advances in neural reconstruction and rendering such as Neural Radiance Fields (NeRF). A major shortcoming of such…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Eldar Insafutdinov , Dylan Campbell , João F. Henriques , Andrea Vedaldi

Real objects that inhabit the physical world follow physical laws and thus behave plausibly during interaction with other physical objects. However, current methods that perform 3D reconstructions of real-world scenes from multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuqiu Liu , Jialin Song , Marissa Ramirez de Chanlatte , Rochishnu Chowdhury , Rushil Paresh Desai , Wuyang Chen , Daniel Martin , Michael W. Mahoney

We propose an approach for 3D reconstruction and segmentation of a single object placed on a flat surface from an input video. Our approach is to perform dense depth map estimation for multiple views using a proposed objective function that…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Tanmay Gupta , Daeyun Shin , Naren Sivagnanadasan , Derek Hoiem

In this work, we use multi-view aerial images to reconstruct the geometry, lighting, and material of facades using neural signed distance fields (SDFs). Without the requirement of complex equipment, our method only takes simple RGB images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zixuan Xie , Rengan Xie , Rong Li , Kai Huang , Pengju Qiao , Jingsen Zhu , Xu Yin , Qi Ye , Wei Hua , Yuchi Huo , Hujun Bao

Numerous techniques have been proposed for reconstructing 3D models for opaque objects in past decades. However, none of them can be directly applied to transparent objects. This paper presents a fully automatic approach for reconstructing…

Graphics · Computer Science 2018-05-15 Bojian Wu , Yang Zhou , Yiming Qian , Minglun Gong , Hui Huang

SAM3D has garnered widespread attention for its strong 3D object reconstruction capabilities. However, a key limitation remains: SAM3D cannot reconstruct specific objects referred to by textual descriptions, a capability that is essential…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yun Zhou , Yaoting Wang , Guangquan Jie , Jinyu Liu , Henghui Ding

While current general-purpose 3D human models (e.g., SMPL-X) efficiently represent accurate human shape and pose, they lacks the ability to physically interact with the environment due to the kinematic nature. As a result, kinematic-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Li Siyao , Yao Feng , Omid Taheri , Chen Change Loy , Michael J. Black

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Luoxi Zhang , Pragyan Shrestha , Yu Zhou , Chun Xie , Itaru Kitahara

City-scale 3D surface reconstruction from multiview images for downstream 3D simulation, poses highly challenging problems due to the scale and complexity of urban scenes. Existing city-scale 3D reconstruction methods based on NeRF,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Sayan Paul , Sourav Ghosh , Siddharth Katageri , Soumyadip Maity , Sanjana Sinha , Brojeshwar Bhowmick

Estimating simulation-ready scenes from real-world observations is crucial for downstream planning and policy learning tasks. Regretfully, existing methods struggle in cluttered environments, often exhibiting prohibitive computational cost,…

Robotics · Computer Science 2026-05-14 Wei-Cheng Huang , Jiaheng Han , Xiaohan Ye , Zherong Pan , Kris Hauser

This paper studies the problem of 3D volumetric reconstruction from two views of a scene with an unknown camera. While seemingly easy for humans, this problem poses many challenges for computers since it requires simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Shengyi Qian , Linyi Jin , David F. Fouhey

Monocular 3D scene reconstruction has recently seen significant progress. Powered by the modern neural architectures and large-scale data, recent methods achieve high performance in depth estimation from a single image. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Junaid Ahmed Ansari , Ran Ding , Fabio Pizzati , Ivan Laptev

Reconstructing physically stable 3D scenes from a single RGB image enables casual images to be converted into simulation-ready digital assets for applications such as immersive interaction and content creation. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiaoxuan Ma , Jiashun Wang , Nicolas Ugrinovic , Yehonathan Litman , Kris Kitani

We introduce an active 3D reconstruction method which integrates visual perception, robot-object interaction, and 3D scanning to recover both the exterior and interior, i.e., unexposed, geometries of a target 3D object. Unlike other works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zihao Yan , Fubao Su , Mingyang Wang , Ruizhen Hu , Hao Zhang , Hui Huang

Reconstructing real-world objects and estimating their movable joint structures are pivotal technologies within the field of robotics. Previous research has predominantly focused on supervised approaches, relying on extensively annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haowen Wang , Zhen Zhao , Zhao Jin , Zhengping Che , Liang Qiao , Yakun Huang , Zhipeng Fan , Xiuquan Qiao , Jian Tang

We propose a method for 3D object reconstruction and 6D-pose estimation from 2D images that uses knowledge about object shape as the primary key. In the proposed pipeline, recognition and labeling of objects in 2D images deliver 2D segment…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Marcell Wolnitza , Osman Kaya , Tomas Kulvicius , Florentin Wörgötter , Babette Dellen

In this paper, we propose a method to segment and recover a static, clean background and multiple 360$^\circ$ objects from observations of scenes at different timestamps. Recent works have used neural radiance fields to model 3D scenes and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-27 Tianhan Xu , Takuya Ikeda , Koichi Nishiwaki

We present a technique for a complete 3D reconstruction of small objects moving in front of a textured background. It is a particular variation of multibody structure from motion, which specializes to two objects only. The scene is captured…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Petr Hruby , Tomas Pajdla

Reconstructing the underlying 3D surface of an object from a single image is a challenging problem that has received extensive attention from the computer vision community. Many learning-based approaches tackle this problem by learning a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Nicolai Häni , Jun-Jee Chao , Volkan Isler

Efficient and accurate 3D object shape reconstruction contributes significantly to the success of a robot's physical interaction with its environment. Acquiring accurate shape information about unknown objects is challenging, especially in…

Robotics · Computer Science 2023-08-02 Yiting Chen , Ahmet Ercan Tekden , Marc Peter Deisenroth , Yasemin Bekiroglu