中文
相关论文

相关论文: AeroDuo: Aerial Duo for UAV-based Vision and Langu…

200 篇论文

There is an increasing demand for using Unmanned Aerial Vehicle (UAV), known as drones, in different applications such as packages delivery, traffic monitoring, search and rescue operations, and military combat engagements. In all of these…

机器人学 · 计算机科学 2022-08-29 Fadi AlMahamid , Katarina Grolinger

Vision-Language Navigation (VLN) systems are fundamentally constrained by partial observability, as an agent can only accumulate knowledge from locations it has personally visited. As multiple robots increasingly coexist in shared…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Qunchao Jin , Yiliao Song , Qi Wu

Unmanned aerial vehicles (UAVs) have been widely adopted in various real-world applications. However, the control and optimization of multi-UAV systems remain a significant challenge, particularly in dynamic and constrained environments.…

机器学习 · 计算机科学 2025-06-10 Zijiang Yan , Hao Zhou , Jianhua Pei , Hina Tabassum

While Vision-Language-Action (VLA) models have achieved remarkable success in ground-based embodied intelligence, their application to Aerial Manipulation Systems (AMS) remains a largely unexplored frontier. The inherent characteristics of…

机器人学 · 计算机科学 2026-02-04 Jianli Sun , Bin Tian , Qiyao Zhang , Chengxiang Li , Zihan Song , Zhiyong Cui , Yisheng Lv , Yonglin Tian

In the Vision-and-Language Navigation (VLN) task an embodied agent navigates a 3D environment, following natural language instructions. A challenge in this task is how to handle 'off the path' scenarios where an agent veers from a reference…

计算机视觉与模式识别 · 计算机科学 2021-10-01 Sonia Raychaudhuri , Saim Wani , Shivansh Patel , Unnat Jain , Angel X. Chang

The aspiration of the Vision-and-Language Navigation (VLN) task has long been to develop an embodied agent with robust adaptability, capable of seamlessly transferring its navigation capabilities across various tasks. Despite remarkable…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Siqi Zhang , Yanyuan Qiao , Qunbo Wang , Longteng Guo , Zhihua Wei , Jing Liu

Bridging the gap between embodied intelligence and embedded deployment remains a key challenge in intelligent robotic systems, where perception, reasoning, and planning must operate under strict constraints on computation, memory, energy,…

机器人学 · 计算机科学 2026-05-19 Kuan Xu , Ruimeng Liu , Yizhuo Yang , Denan Liang , Tongxing Jin , Shenghai Yuan , Chen Wang , Lihua Xie

Vision-and-Language Navigation (VLN) requires agents to follow long-horizon instructions and navigate complex 3D environments. However, existing approaches face two major challenges: constructing an effective long-term memory bank and…

机器人学 · 计算机科学 2026-03-27 Zihao Xin , Wentong Li , Yixuan Jiang , Bin Wang , Runmin Cong , Jie Qin , Shengjun Huang

Aerial Vision-and-Language Navigation (AVLN) requires Unmanned Aerial Vehicle (UAV) agents to localize targets in large-scale urban environments based on linguistic instructions. While successful navigation demands both global environmental…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Xichen Ding , Jianzhe Gao , Cong Pan , Wenguan Wang , Jie Qin

Visual language navigation (VLN) is an embodied task demanding a wide range of skills encompassing understanding, perception, and planning. For such a multifaceted challenge, previous VLN methods totally rely on one model's own thinking to…

机器人学 · 计算机科学 2023-09-21 Yuxing Long , Xiaoqi Li , Wenzhe Cai , Hao Dong

Absolute Visual Localization (AVL) enables an Unmanned Aerial Vehicle (UAV) to determine its position in GNSS-denied environments by establishing geometric relationships between UAV images and geo-tagged reference maps. While many previous…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yibin Ye , Xichao Teng , Shuo Chen , Leqi Liu , Kun Wang , Xiaokai Song , Zhang Li

The rapid development of the low-altitude economy emphasizes the critical need for effective perception and intent recognition of non-cooperative unmanned aerial vehicles (UAVs). The advanced generative reasoning capabilities of multimodal…

系统与控制 · 电气工程与系统科学 2025-09-09 Guangyu Lei , Tianhao Liang , Yuqi Ping , Xinglin Chen , Longyu Zhou , Junwei Wu , Xiyuan Zhang , Huahao Ding , Xingjian Zhang , Weijie Yuan , Tingting Zhang , Qinyu Zhang

We consider the problem of Vision-and-Language Navigation (VLN). The majority of current methods for VLN are trained end-to-end using either unstructured memory such as LSTM, or using cross-modal attention over the egocentric observations…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Georgios Georgakis , Karl Schmeckpeper , Karan Wanchoo , Soham Dan , Eleni Miltsakaki , Dan Roth , Kostas Daniilidis

Drones have been widely used in many areas of our daily lives. It relieves people of the burden of holding a controller all the time and makes drone control easier to use for people with disabilities or occupied hands. However, the control…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Xinyi Wang , Xuan Cui , Danxu Li , Fang Liu , Licheng Jiao

In most existing embodied navigation tasks, instructions are well-defined and unambiguous, such as instruction following and object searching. Under this idealized setting, agents are required solely to produce effective navigation outputs…

机器人学 · 计算机科学 2026-01-26 Wensi Huang , Shaohao Zhu , Meng Wei , Jinming Xu , Xihui Liu , Hanqing Wang , Tai Wang , Feng Zhao , Jiangmiao Pang

Deep Learning has revolutionized our ability to solve complex problems such as Vision-and-Language Navigation (VLN). This task requires the agent to navigate to a goal purely based on visual sensory inputs given natural language…

机器人学 · 计算机科学 2021-04-22 Muhammad Zubair Irshad , Chih-Yao Ma , Zsolt Kira

In vision-and-language navigation (VLN), an embodied agent is required to navigate in realistic 3D environments following natural language instructions. One major bottleneck for existing VLN approaches is the lack of sufficient training…

计算机视觉与模式识别 · 计算机科学 2022-08-26 Shizhe Chen , Pierre-Louis Guhur , Makarand Tapaswi , Cordelia Schmid , Ivan Laptev

Synergistic spatial intelligence between UAVs and satellites is indispensable for emergency response and security operations, as it uniquely integrates macro-scale global coverage with dynamic, real-time local perception. However, the…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Dian Liu , Jie Feng , Di Li , Yuhui Zheng , Guanbin Li , Weisheng Dong , Guangming Shi

Vision-and-Language Navigation (VLN) is the task that requires an agent to navigate through the environment based on natural language instructions. At each step, the agent takes the next action by selecting from a set of navigable…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Jialu Li , Mohit Bansal

Vision-language Navigation (VLN) requires an agent to understand visual observations and language instructions to navigate in unseen environments. Most existing approaches rely on static scene assumptions and struggle to generalize in…

机器人学 · 计算机科学 2026-03-24 Xiangchen Liu , Hanghan Zheng , Jeil Jeong , Minsung Yoon , Lin Zhao , Zhide Zhong , Haoang Li , Sung-Eui Yoon