English
Related papers

Related papers: FF3R: Feedforward Feature 3D Reconstruction from U…

200 papers

We present Spatial Region 3D (SR-3D) aware vision-language model that connects single-view 2D images and multi-view 3D data through a shared visual token space. SR-3D supports flexible region prompting, allowing users to annotate regions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 An-Chieh Cheng , Yang Fu , Yukang Chen , Zhijian Liu , Xiaolong Li , Subhashree Radhakrishnan , Song Han , Yao Lu , Jan Kautz , Pavlo Molchanov , Hongxu Yin , Xiaolong Wang , Sifei Liu

In this study, we address the challenge of 3D scene structure recovery from monocular depth estimation. While traditional depth estimation methods leverage labeled datasets to directly predict absolute depth, recent advancements advocate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Chi Zhang , Wei Yin , Gang Yu , Zhibin Wang , Tao Chen , Bin Fu , Joey Tianyi Zhou , Chunhua Shen

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Existing multi-modal 3D detection models usually involve customized designs depending on the sensor combinations or setups. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Xuanyao Chen , Tianyuan Zhang , Yue Wang , Yilun Wang , Hang Zhao

In this paper, we present a novel, scalable approach for constructing open set, instance-level 3D scene representations, advancing open world understanding of 3D environments. Existing methods require pre-constructed 3D scenes and face…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Rafay Mohiuddin , Sai Manoj Prakhya , Fiona Collins , Ziyuan Liu , André Borrmann

Although Multimodal Large Language Models have achieved remarkable progress, they still struggle with complex 3D spatial reasoning due to the reliance on 2D visual priors. Existing approaches typically mitigate this limitation either…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jiahua Chen , Qihong Tang , Weinong Wang , Qi Fan

3D structure modeling is essential across scales, enabling applications from fluid simulation and 3D reconstruction to protein folding and molecular docking. Yet, despite shared 3D spatial patterns, current approaches remain fragmented,…

Machine Learning · Computer Science 2025-10-10 Shuqi Lu , Haowei Lin , Lin Yao , Zhifeng Gao , Xiaohong Ji , Yitao Liang , Weinan E , Linfeng Zhang , Guolin Ke

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Modern Recurrent Neural Networks have become a competitive architecture for 3D reconstruction due to their linear-time complexity. However, their performance degrades significantly when applied beyond the training context length, revealing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Xingyu Chen , Yue Chen , Yuliang Xiu , Andreas Geiger , Anpei Chen

We present LTM3D, a Latent Token space Modeling framework for conditional 3D shape generation that integrates the strengths of diffusion and auto-regressive (AR) models. While diffusion-based methods effectively model continuous latent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xin Kang , Zihan Zheng , Lei Chu , Yue Gao , Jiahao Li , Hao Pan , Xuejin Chen , Yan Lu

Feed-forward 3D reconstruction has advanced rapidly, but current models remain unreliable in UAV photogrammetric acquisition. We argue that this failure is caused not only by appearance-domain shift, but also by UAV-specific camera-geometry…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Xiang Yang , Yongli Wang , HaiFeng Li , Yunsheng Zhang

3D visual grounding (3DVG) aims to localize objects in a 3D scene based on natural language queries. In this work, we explore zero-shot 3DVG from multi-view images alone, without requiring any geometric supervision or object priors. We…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Nikita Drozdov , Andrey Lemeshko , Nikita Gavrilov , Anton Konushin , Danila Rukhovich , Maksim Kolodiazhnyi

Multimodal 3D grounding has garnered considerable interest in Vision-Language Models (VLMs) \cite{yin2025spatial} for advancing spatial reasoning in complex environments. However, these models suffer from a severe "2D semantic bias" that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yutong Zhong

Sparse-view 3D reconstruction is essential for applications in which dense image acquisition is impractical, such as robotics, augmented/virtual reality (AR/VR), and autonomous systems. In these settings, minimal image overlap prevents…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tanveer Younis , Zhanglin Cheng

End-to-end perception and trajectory prediction from raw sensor data is one of the key capabilities for autonomous driving. Modular pipelines restrict information flow and can amplify upstream errors. Recent query-based, fully…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Matej Halinkovic , Nina Masarykova , Alexey Vinel , Marek Galinski

We introduce UniCon3R, a unified feed-forward framework for online human-scene 4D reconstruction from monocular video. Current feed-forward human-scene reconstruction methods suffer from artifacts, where bodies float above the ground or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tanuj Sur , Shashank Tripathi , Nikos Athanasiou , Ha Linh Nguyen , Kai Xu , Michael J. Black , Angela Yao

Feed-forward 3D reconstruction methods aim to predict the 3D structure of a scene directly from input images, providing a faster alternative to per-scene optimization approaches. Significant progress has been made in single-view and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Sam Bahrami , Dylan Campbell

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

Temporal sentence grounding aims to localize a target segment in an untrimmed video semantically according to a given sentence query. Most previous works focus on learning frame-level features of each whole frame in the entire video, and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Daizong Liu , Xiang Fang , Wei Hu , Pan Zhou

Neural Surface Reconstruction has become a standard methodology for indoor 3D reconstruction, with Signed Distance Functions (SDFs) proving particularly effective for representing scene geometry. A variety of applications require a detailed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Remi Chierchia , Léo Lebrat , David Ahmedt-Aristizabal , Olivier Salvado , Clinton Fookes , Rodrigo Santa Cruz