English
Related papers

Related papers: Bridging Geometric and Semantic Foundation Models …

200 papers

Depth perception is a crucial component of monoc-ular 3D detection tasks that typically involve ill-posed problems. In light of the success of sample mining techniques in 2D object detection, we propose a simple yet effective mining…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Weixin Mao , Jinrong Yang , Zheng Ge , Lin Song , Hongyu Zhou , Tiezheng Mao , Zeming Li , Osamu Yoshie

As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yinmin Zhang , Xinzhu Ma , Shuai Yi , Jun Hou , Zhihui Wang , Wanli Ouyang , Dan Xu

Monocular Depth Estimation (MDE) is a fundamental problem in computer vision with numerous applications. Recently, LIDAR-supervised methods have achieved remarkable per-pixel depth accuracy in outdoor scenes. However, significant errors are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lior Talker , Aviad Cohen , Erez Yosef , Alexandra Dana , Michael Dinerstein

We present FoundationSLAM, a learning-based monocular dense SLAM system that addresses the absence of geometric consistency in previous flow-based approaches for accurate and robust tracking and mapping. Our core idea is to bridge flow…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Yuchen Wu , Jiahe Li , Fabio Tosi , Matteo Poggi , Jin Zheng , Xiao Bai

Multimodal retrieval systems struggle to resolve image-text queries against text-only corpora: the best vision-language encoder achieves only 27.6 nDCG@10 on MM-BRIGHT, underperforming strong text-only retrievers. We argue the bottleneck is…

Most recent approaches to monocular 3D human pose estimation rely on Deep Learning. They typically involve regressing from an image to either 3D joint coordinates directly or 2D joint locations from which 3D coordinates are inferred. Both…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Bugra Tekin , Pablo Márquez-Neila , Mathieu Salzmann , Pascal Fua

Depth information is the foundation of perception, essential for autonomous driving, robotics, and other source-constrained applications. Promptly obtaining accurate and efficient depth information allows for a rapid response in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Xin Zhang , Rabab Abdelfattah , Yuqi Song , Samuel A. Dauchert , Xiaofeng wang

Monocular depth estimation is a crucial task to measure distance relative to a camera, which is important for applications, such as robot navigation and self-driving. Traditional frame-based methods suffer from performance drops due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Tianbo Pan , Zidong Cao , Lin Wang

Monocular geometric scene understanding combines panoptic segmentation and self-supervised depth estimation, focusing on real-time application in autonomous vehicles. We introduce MGNiceNet, a unified approach that uses a linked kernel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Markus Schön , Michael Buchholz , Klaus Dietmayer

Estimating a scene's depth to achieve collision avoidance against moving pedestrians is a crucial and fundamental problem in the robotic field. This paper proposes a novel, low complexity network architecture for fast and accurate human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shan An , Fangru Zhou , Mei Yang , Haogang Zhu , Changhong Fu , Konstantinos A. Tsintotas

Monocular depth estimation is scale-ambiguous, and thus requires scale supervision to produce metric predictions. Even so, the resulting models will be geometry-specific, with learned scales that cannot be directly transferred across…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Vitor Guizilini , Igor Vasiljevic , Dian Chen , Rares Ambrus , Adrien Gaidon

Recent progress in spatial reasoning with Multimodal Large Language Models (MLLMs) increasingly leverages geometric priors from 3D encoders. However, most existing integration strategies remain passive: geometry is exposed as a global…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Haoyuan Li , Qihang Cao , Tao Tang , Kun Xiang , Zihan Guo , Jianhua Han , JiaWang Bian , Hang Xu , Xiaodan Liang

Depth estimation from monocular endoscopic images presents significant challenges due to the complexity of endoscopic surgery, such as irregular shapes of human soft tissues, as well as variations in lighting conditions. Existing methods…

Image and Video Processing · Electrical Eng. & Systems 2025-02-07 Dawei Lu , Deqiang Xiao , Danni Ai , Jingfan Fan , Tianyu Fu , Yucong Lin , Hong Song , Xujiong Ye , Lei Zhang , Jian Yang

Monocular depth estimation involves predicting depth from a single RGB image and plays a crucial role in applications such as autonomous driving, robotic navigation, 3D reconstruction, etc. Recent advancements in learning-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Jingming Xia , Guanqun Cao , Guang Ma , Yiben Luo , Qinzhao Li , John Oyekan

The recent success of specialized Large Language Models (LLMs) in domains such as mathematical reasoning and coding has led to growing interest in methods for merging these expert LLMs into a unified Mixture-of-Experts (MoE) model, with the…

Computation and Language · Computer Science 2025-02-18 Yuhang Zhou , Giannis Karamanolakis , Victor Soto , Anna Rumshisky , Mayank Kulkarni , Furong Huang , Wei Ai , Jianhua Lu

The capabilities of monocular depth estimation (MDE) models are limited by the availability of sufficient and diverse datasets. In the case of MDE models for autonomous driving, this issue is exacerbated by the linearity of the captured…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Casimir Feldmann , Niall Siegenheim , Nikolas Hars , Lovro Rabuzin , Mert Ertugrul , Luca Wolfart , Marc Pollefeys , Zuria Bauer , Martin R. Oswald

Monocular 3D visual grounding is a novel task that aims to locate 3D objects in RGB images using text descriptions with explicit geometry information. Despite the inclusion of geometry details in the text, we observe that the text…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yuzhen Li , Min Liu , Yuan Bian , Xueping Wang , Zhaoyang Li , Gen Li , Yaonan Wang

It is difficult to collect data on a large scale in a monocular depth estimation because the task requires the simultaneous acquisition of RGB images and depths. Data augmentation is thus important to this task. However, there has been…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Yasunori Ishii , Takayoshi Yamashita

The rapid growth of 3D digital content necessitates expandable recognition systems for open-world scenarios. However, existing 3D class-incremental learning methods struggle under extreme data scarcity due to geometric misalignment and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Tuo Xiang , Xuemiao Xu , Bangzhen Liu , Jinyi Li , Yong Li , Shengfeng He

This work presents a generalizable framework to transfer relative depth to metric depth. Current monocular depth estimation methods are mainly divided into metric depth estimation (MMDE) and relative depth estimation (MRDE). MMDEs estimate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Beilei Cui , Yiming Huang , Long Bai , Hongliang Ren