English
Related papers

Related papers: MAG-VLAQ: Multi-modal Aerial-Ground Query Aggregat…

200 papers

Progress in 3D vision-language learning has been hindered by the scarcity of large-scale 3D datasets. We introduce UniVLG, a unified architecture for 2D and 3D vision-language understanding that bridges the gap between existing 2D-centric…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ayush Jain , Alexander Swerdlow , Yuzhou Wang , Sergio Arnaud , Ada Martin , Alexander Sax , Franziska Meier , Katerina Fragkiadaki

Although fusing multiple sensor modalities can enhance object detection performance, existing fusion approaches often overlook subtle variations in environmental conditions and sensor inputs. As a result, they struggle to adaptively weight…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Aditya Taparia , Noel Ngu , Mario Leiva , Joshua Shay Kricheli , John Corcoran , Nathaniel D. Bastian , Gerardo Simari , Paulo Shakarian , Ransalu Senanayake

Absolute Visual Localization (AVL) enables an Unmanned Aerial Vehicle (UAV) to determine its position in GNSS-denied environments by establishing geometric relationships between UAV images and geo-tagged reference maps. While many previous…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yibin Ye , Xichao Teng , Shuo Chen , Leqi Liu , Kun Wang , Xiaokai Song , Zhang Li

Visual place recognition (VPR) remains challenging due to significant viewpoint changes and appearance variations. Mainstream works tackle these challenges by developing various feature aggregation methods to transform deep features into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Teng Wang , Lingquan Meng , Lei Cheng , Changyin Sun

Unmanned Aerial Vehicle (UAV) Cross-View Geo-Localization (CVGL) presents significant challenges due to the view discrepancy between oblique UAV images and overhead satellite images. Existing methods heavily rely on the supervision of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Haoyuan Li , Chang Xu , Wen Yang , Li Mi , Huai Yu , Haijian Zhang

Place recognition is one of the most crucial modules for autonomous vehicles to identify places that were previously visited in GPS-invalid environments. Sensor fusion is considered an effective method to overcome the weaknesses of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zijie Zhou , Jingyi Xu , Guangming Xiong , Junyi Ma

LiDAR place recognition is a critical capability for autonomous navigation and cross-modal localization in large-scale outdoor environments. Existing approaches predominantly depend on pre-built 3D dense maps or aerial imagery, which impose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Shuhao Kang , Martin Y. Liao , Yan Xia , Olaf Wysocki , Boris Jutzi , Daniel Cremers

Vision-language models (VLMs) enable text-guided object detection but degrade severely under cross-view scenarios where ground and aerial viewpoints differ in altitude, scale, and spatial layout. These geometric changes introduce systematic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhipeng Liu , Chunbo Luo

Cross-modal place recognition methods are flexible GPS-alternatives under varying environment conditions and sensor setups. However, this task is non-trivial since extracting consistent and robust global descriptors from different…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yun-Jin Li , Mariia Gladkova , Yan Xia , Rui Wang , Daniel Cremers

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

Robust 3D occupancy prediction is essential for autonomous driving, particularly under adverse weather conditions where traditional vision-only systems struggle. While the fusion of surround-view 4D radar and cameras offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Long Yang , Lianqing Zheng , Wenjin Ai , Minghao Liu , Sen Li , Qunshu Lin , Shengyu Yan , Jie Bai , Zhixiong Ma , Tao Huang , Xichan Zhu

Unmanned aerial vehicle (UAV) object detection plays a vital role in applications such as environmental monitoring and urban security. To improve robustness, recent studies have explored multimodal detection by fusing visible (RGB) and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Liu Zongzhen , Luo Hui , Wang Zhixing , Wei Yuxing , Zuo Haorui , Zhang Jianlin

Ground to aerial matching is a crucial and challenging task in outdoor robotics, particularly when GPS is absent or unreliable. Structures like buildings or large dense forests create interference, requiring GNSS replacements for global…

Robotics · Computer Science 2024-10-10 Christopher Klammer , Michael Kaess

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Cross-View Geo-Localization (CVGL) between UAV imagery and satellite images plays a crucial role in target localization and UAV self-positioning. However, most existing methods rely on the idealized assumption of scale consistency between…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yibin Ye , Shuo Chen , Kun Wang , Xiaokai Song , Jisheng Dang , Qifeng Yu , Xichao Teng , Zhang Li

Achieving monocular camera localization within pre-built LiDAR maps can bypass the simultaneous mapping process of visual SLAM systems, potentially reducing the computational overhead of autonomous localization. To this end, one of the key…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Gongxin Yao , Xinyang Li , Luowei Fu , Yu Pan

This paper addresses the challenge of perceiving complete object shapes through visual perception. While prior studies have demonstrated encouraging outcomes in segmenting the visible parts of objects within a scene, amodal segmentation, in…

Robotics · Computer Science 2024-08-07 Jinyu Zhang , Yongchong Gu , Jianxiong Gao , Haitao Lin , Qiang Sun , Xinwei Sun , Xiangyang Xue , Yanwei Fu

A hierarchical cross-modal fusion model is proposed for vision-language question answering (VLQA) in industrial robotics, targeting the challenges of semantic ambiguity, complex environmental layouts, and domain-specific terminology common…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ping Li , Bartlomiej Brzozka

Recent learning-based approaches have achieved impressive results in the field of single-shot camera localization. However, how best to fuse multiple modalities (e.g., image and depth) and to deal with degraded or missing input are less…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Kaichen Zhou , Changhao Chen , Bing Wang , Muhamad Risqi U. Saputra , Niki Trigoni , Andrew Markham