English
Related papers

Related papers: AerialMind: Towards Referring Multi-Object Trackin…

200 papers

As a significant application of multi-source information fusion in intelligent transportation perception systems, Referring Multi-Object Tracking (RMOT) involves localizing and tracking specific objects in video sequences based on language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Shaofeng Liang , Runwei Guan , Wangwang Lian , Daizong Liu , Xiaolou Sun , Dongming Wu , Yutao Yue , Weiping Ding , Hui Xiong

Aerial navigation is a fundamental yet underexplored capability in embodied intelligence, enabling agents to operate in large-scale, unstructured environments where traditional navigation paradigms fall short. However, most existing…

Robotics · Computer Science 2025-08-25 Jianqiang Xiao , Yuexuan Sun , Yixin Shao , Boxi Gan , Rongqiang Liu , Yanjing Wu , Weili Guan , Xiang Deng

This paper addresses the problem of multi-object tracking in Unmanned Aerial Vehicle (UAV) footage. It plays a critical role in various UAV applications, including traffic monitoring systems and real-time suspect tracking by the police.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 InPyo Song , Jangwon Lee

Vision-Language MOT is a crucial tracking problem and has drawn increasing attention recently. It aims to track objects based on human language commands, replacing the traditional use of templates or pre-set information from training sets…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yunhao Li , Xiaoqiong Liu , Luke Liu , Heng Fan , Libo Zhang

Recent advances in large Vision-Language Models (VLMs) have provided rich semantic understanding that empowers drones to search for open-set objects via natural language instructions. However, prior systems struggle to integrate VLMs into…

Robotics · Computer Science 2026-01-21 Xuecheng Chen , Zongzhuo Liu , Jianfa Ma , Bang Du , Tiantian Zhang , Xueqian Wang , Boyu Zhou

To autonomously navigate in real-world environments, special in search and rescue operations, Unmanned Aerial Vehicles (UAVs) necessitate comprehensive maps to ensure safety. However, the prevalent metric map often lacks semantic…

Robotics · Computer Science 2024-01-17 Thanh Nguyen Canh , Armagan Elibol , Nak Young Chong , Xiem HoangVan

Aerial Vision-and-Language Navigation (VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and navigate complex urban environments using onboard visual observation. This task holds promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Huilin Xu , Zhuoyang Liu , Yixiang Luomei , Feng Xu

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Nowadays, unmanned aerial vehicles (UAVs) are commonly used in search and rescue scenarios to gather information in the search area. The automatic identification of the person searched for in aerial footage could increase the autonomy of…

Robotics · Computer Science 2026-01-05 Yannik Blei , Michael Krawez , Nisarga Nilavadi , Tanja Katharina Kaiser , Wolfram Burgard

Multiple object tracking (MOT) in Unmanned Aerial Vehicle (UAV) videos is important for diverse applications in computer vision. Current MOT trackers rely on accurate object detection results and precise matching of target reidentification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Jianbo Ma , Chuanming Tang , Fei Wu , Can Zhao , Jianlin Zhang , Zhiyong Xu

With the advantage of high mobility, Unmanned Aerial Vehicles (UAVs) are used to fuel numerous important applications in computer vision, delivering more efficiency and convenience than surveillance cameras with fixed camera angle, scale…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Dawei Du , Yuankai Qi , Hongyang Yu , Yifan Yang , Kaiwen Duan , Guorong Li , Weigang Zhang , Qingming Huang , Qi Tian

Multi-Object Tracking (MOT) is evolving from geometric localization to Semantic MOT (SMOT) to answer complex relational queries, yet progress is hindered by semantic data scarcity and a structural disconnect between tracking architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Pan Liao , Feng Yang , Di Wu , Jinwen Yu , Yuhua Zhu , Wenhui Zhao , Dingwen Zhang

Search and rescue operations require unmanned aerial vehicles to both traverse unknown unstructured environments at high speed and track targets once detected. Achieving both capabilities under degraded sensing and without global…

Robotics · Computer Science 2025-09-30 Alessandro Saviolo , Jeffrey Mao , Giuseppe Loianno

Language-vision understanding has driven the development of advanced perception systems, most notably the emerging paradigm of Referring Multi-Object Tracking (RMOT). By leveraging natural-language queries, RMOT systems can selectively…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Halima Bouzidi , Haoyu Liu , Mohammad Abdullah Al Faruque

In this paper, we address the challenge of Multi-Object Tracking (MOT) in moving Unmanned Aerial Vehicle (UAV) scenarios, where irregular flight trajectories, such as hovering, turning left/right, and moving up/down, lead to significantly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Deyi Ji , Lanyun Zhu , Siqi Gao , Qi Zhu , Yiru Zhao , Peng Xu , Yue Ding , Hongtao Lu , Jieping Ye , Feng Wu , Feng Zhao

Unmanned aerial vehicle (UAV) tracking is crucial for autonomous navigation and has broad applications in robotic automation fields. However, reliable UAV tracking remains a challenging task due to various difficulties like frequent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Changhong Fu , Mutian Cai , Sihang Li , Kunhan Lu , Haobo Zuo , Chongjun Liu

Referring multi-object tracking (RMOT) is a task of associating all the objects in a video that semantically match with given textual queries or referring expressions. Existing RMOT approaches decompose object grounding and tracking into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zijia Lu , Jingru Yi , Jue Wang , Yuxiao Chen , Junwen Chen , Xinyu Li , Davide Modolo

Multi-object tracking (MOT) is a crucial component of situational awareness in military defense applications. With the growing use of unmanned aerial systems (UASs), MOT methods for aerial surveillance is in high demand. Application of MOT…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Wanlin Xie , Jaime Ide , Daniel Izadi , Sean Banger , Thayne Walker , Ryan Ceresani , Dylan Spagnuolo , Christopher Guagliano , Henry Diaz , Jason Twedt

We present a multirotor Unmanned Aerial Vehicle control (UAV) and estimation system for supporting replicable research through realistic simulations and real-world experiments. We propose a unique multi-frame localization paradigm for…

Robotics · Computer Science 2025-04-24 Tomas Baca , Matej Petrlik , Matous Vrba , Vojtech Spurny , Robert Penicka , Daniel Hert , Martin Saska

Open-vocabulary multi-object tracking (OVMOT) represents a critical new challenge involving the detection and tracking of diverse object categories in videos, encompassing both seen categories (base classes) and unseen categories (novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zekun Qian , Ruize Han , Junhui Hou , Linqi Song , Wei Feng