中文
相关论文

相关论文: SpatialFly: Geometry-Guided Representation Alignme…

200 篇论文

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

机器人学 · 计算机科学 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Vision-language models (VLMs) have demonstrated strong performance in 2D scene understanding and generation, but extending this unification to the physical world remains an open challenge. Existing 3D and 4D approaches typically embed scene…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Hanyu Zhou , Gim Hee Lee

3D visual grounding (3DVG) is a critical task in scene understanding that aims to identify objects in 3D scenes based on text descriptions. However, existing methods rely on separately pre-trained vision and text encoders, resulting in a…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Yinuo Zheng , Lipeng Gu , Honghua Chen , Liangliang Nan , Mingqiang Wei

Regression-based LiDAR relocalization has recently emerged as a promising solution for high-precision positioning in GNSS-denied environments. However, these methods are primarily tailored to autonomous driving, exhibiting significantly…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Hengyu Mu , Jianshi Wu , Yuxin Guo , XianLian Lin , Qingyong Hu , Sheng Ao , Chenglu Wen , Cheng Wang

Multimodal large language models (MLLMs) have exhibited remarkable performance in various visual tasks, yet still struggle with spatial reasoning. Recent efforts mitigate this by injecting geometric features from 3D foundation models, but…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Zhaochen Liu , Limeng Qiao , Guanglu Wan , Tingting Jiang

Modern unmanned aerial vehicles (UAVs) are irreplaceable in search and rescue (SAR) missions to obtain a situational overview or provide closeups without endangering personnel. However, UAVs heavily rely on global navigation satellite…

机器人学 · 计算机科学 2024-12-04 Jan Quenzel , Linus T. Mallwitz , Benedikt T. Arnold , Sven Behnke

Embodied scene understanding requires not only comprehending visual-spatial information that has been observed but also determining where to explore next in the 3D physical world. Existing 3D Vision-Language (3D-VL) models primarily focus…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Ziyu Zhu , Xilin Wang , Yixuan Li , Zhuofan Zhang , Xiaojian Ma , Yixin Chen , Baoxiong Jia , Wei Liang , Qian Yu , Zhidong Deng , Siyuan Huang , Qing Li

Progress in 3D vision-language learning has been hindered by the scarcity of large-scale 3D datasets. We introduce UniVLG, a unified architecture for 2D and 3D vision-language understanding that bridges the gap between existing 2D-centric…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Ayush Jain , Alexander Swerdlow , Yuzhou Wang , Sergio Arnaud , Ada Martin , Alexander Sax , Franziska Meier , Katerina Fragkiadaki

Despite notable advancements in remote sensing vision-language models (VLMs), existing models often struggle with spatial understanding, limiting their effectiveness in real-world applications. To push the boundaries of VLMs in remote…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Yue Zhou , Ran Ding , Xue Yang , Xue Jiang , Xingzhao Liu

Existing vision-language-action (VLA) models act in 3D real-world but are typically built on 2D encoders, leaving a spatial reasoning gap that limits generalization and adaptability. Recent 3D integration techniques for VLAs either require…

3D Gaussian Splatting (3DGS), a 3D representation method with photorealistic real-time rendering capabilities, is regarded as an effective tool for narrowing the sim-to-real gap. However, it lacks fine-grained semantics and physical…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Bingchen Miao , Rong Wei , Zhiqi Ge , Xiaoquan sun , Shiqi Gao , Jingzhe Zhu , Renhan Wang , Siliang Tang , Jun Xiao , Rui Tang , Juncheng Li

Visual localization in large-scale UAV scenarios is a critical capability for autonomous systems, yet it remains challenging due to geometric complexity and environmental variations. While 3D Gaussian Splatting (3DGS) has emerged as a…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Xiang Zhang , Tengfei Wang , Fang Xu , Xin Wang , Zongqian Zhan

Synergistic spatial intelligence between UAVs and satellites is indispensable for emergency response and security operations, as it uniquely integrates macro-scale global coverage with dynamic, real-time local perception. However, the…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Dian Liu , Jie Feng , Di Li , Yuhui Zheng , Guanbin Li , Weisheng Dong , Guangming Shi

Despite significant advancements in dynamic neural rendering, existing methods fail to address the unique challenges posed by UAV-captured scenarios, particularly those involving monocular camera setups, top-down perspective, and multiple…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Jaehoon Choi , Dongki Jung , Christopher Maxey , Yonghan Lee , Sungmin Eum , Dinesh Manocha , Heesung Kwon

Navigation of UAVs in challenging environments like tunnels or mines, where it is not possible to use GNSS methods to self-localize, illumination may be uneven or nonexistent, and wall features are likely to be scarce, is a complex task,…

机器人学 · 计算机科学 2026-04-30 Lorenzo Cano , Alejandro R. Mosteo , Danilo Tardioli

Multimodal large language models (MLLMs) have achieved significant progress in image and language tasks due to the strong reasoning capability of large language models (LLMs). Nevertheless, most MLLMs suffer from limited spatial reasoning…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Jiajie Guo , Qingpeng Zhu , Jin Zeng , Xiaolong Wu , Changyong He , Weida Wang

Three-dimensional geospatial analysis is critical for applications in urban planning, climate adaptation, and environmental assessment. However, current methodologies depend on costly, specialized sensors, such as LiDAR and multispectral…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Mai Tsujimoto , Junjue Wang , Weihao Xuan , Naoto Yokoya

Spectrum sensing and the generation of 3D Radio Environment Maps (REMs) are essential for enabling spectrum sharing within cognitive radio networks. While Uncrewed Aerial Vehicles (UAVs) offer high-mobility 3D sensing, REM accuracy is…

信号处理 · 电气工程与系统科学 2026-05-26 Mushfiqur Rahman , Sung Joon Maeng , Ismail Guvenc , Chau-Wai Wong , Mihail Sichitiu , Jason A. Abrahamson , Arupjyoti Bhuyan

The efficacy of UAV swarm cooperative perception fundamentally depends on three-dimensional (3D) formation geometry, which governs target observability and sensor complementarity. In the literature, the exploitation of formation geometry…

系统与控制 · 电气工程与系统科学 2025-12-16 Kai Xiong , Xingyu Wu , Anna Duan , Supeng Leng , Jianhua He

Existing UAV vision-and-language navigation (VLN) benchmarks rarely provide realistic aerial scenes, natural process-level instructions, and sufficient scale simultaneously, making it difficult to systematically train and evaluate UAV VLN…

计算与语言 · 计算机科学 2026-05-18 Hengxing Cai , Yijie Rao , Ligang Huang , Zanyang Zhong , Jinhan Dong , Jingjun Tan , Changhao Nai , Jue Hou , Wenhao Lu , Renxin Zhong