English
Related papers

Related papers: Edge-Optimized Multimodal Learning for UAV Video U…

200 papers

Drone-based target detection presents inherent challenges, such as the high density and overlap of targets in drone-based images, as well as the blurriness of targets under varying lighting conditions, which complicates identification.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Yuchen Zheng , Yuxin Jing , Jufeng Zhao , Guangmang Cui

Autonomous landing is essential for drones deployed in emergency deliveries, post-disaster response, and other large-scale missions. By enabling self-docking on charging platforms, it facilitates continuous operation and significantly…

Robotics · Computer Science 2025-05-13 Siwei Cai , Yuwei Wu , Lifeng Zhou

Aiming towards a holistic understanding of multiple downstream tasks simultaneously, there is a need for extracting features with better transferability. Though many latest self-supervised pre-training methods have achieved impressive…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Xiwen Liang , Yangxin Wu , Jianhua Han , Hang Xu , Chunjing Xu , Xiaodan Liang

Multimodal learning models have become increasingly important as they surpass single-modality approaches on diverse tasks ranging from question-answering to autonomous driving. Despite the importance of multimodal learning, existing efforts…

Machine Learning · Computer Science 2024-10-23 Michal Golovanevsky , Eva Schiller , Akira Nair , Eric Han , Ritambhara Singh , Carsten Eickhoff

Unmanned aerial vehicles (UAVs) are becoming a viable platform for sensing and estimation in a wide variety of applications including disaster response, search and rescue, and security monitoring. These sensing UAVs have limited battery and…

Networking and Internet Architecture · Computer Science 2022-06-08 Lorson Blair , Carlos A. Varela , Stacy Patterson

In recent literature, few-shot classification has predominantly been defined by the N-way k-shot meta-learning problem. Models designed for this purpose are usually trained to excel on standard benchmarks following a restricted setup,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Constance Ferragu , Philomene Chagniot , Vincent Coyette

Road damage detection is a critical task for ensuring traffic safety and maintaining infrastructure integrity. While deep learning-based detection methods are now widely adopted, they still face two core challenges: first, the inadequate…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Zicheng Lin , Weichao Pan

We present the Qwen2-VL Series, an advanced upgrade of the previous Qwen-VL models that redefines the conventional predetermined-resolution approach in visual processing. Qwen2-VL introduces the Naive Dynamic Resolution mechanism, which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Peng Wang , Shuai Bai , Sinan Tan , Shijie Wang , Zhihao Fan , Jinze Bai , Keqin Chen , Xuejing Liu , Jialin Wang , Wenbin Ge , Yang Fan , Kai Dang , Mengfei Du , Xuancheng Ren , Rui Men , Dayiheng Liu , Chang Zhou , Jingren Zhou , Junyang Lin

Unmanned Aerial Vehicles (UAVs) are evolving into language-interactive platforms, enabling more intuitive forms of human-drone interaction. While prior works have primarily focused on high-level planning and long-horizon navigation, we…

Robotics · Computer Science 2025-05-27 Xiangyu Wang , Donglin Yang , Yue Liao , Wenhao Zheng , wenjun wu , Bin Dai , Hongsheng Li , Si Liu

In-context learning (ICL) involves reasoning from given contextual examples. As more modalities comes, this procedure is becoming more challenging as the interleaved input modalities convolutes the understanding process. This is exemplified…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yixin Chen , Shuai Zhang , Boran Han , Jiaya Jia

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

In this study, we investigate the task of data pre-selection, which aims to select instances for labeling from an unlabeled dataset through a single pass, thereby optimizing performance for undefined downstream tasks with a limited…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Xin Li , Sima Behpour , Thang Doan , Wenbin He , Liang Gou , Liu Ren

As the key component in multimodal large language models (MLLMs), the ability of the visual encoder greatly affects MLLM's understanding on diverse image content. Although some large-scale pretrained vision encoders such as vision encoders…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhuofan Zong , Bingqi Ma , Dazhong Shen , Guanglu Song , Hao Shao , Dongzhi Jiang , Hongsheng Li , Yu Liu

We address vision-language-driven indoor navigation to assist visually impaired individuals in reaching a target location using images and natural language guidance. Traditional navigation systems are ineffective indoors due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Xiao Li , Bharat Gandhi , Ming Zhan , Mohit Nehra , Zhicheng Zhang , Yuchen Sun , Meijia Song , Naisheng Zhang , Xi Wang

Existing approaches to drone visual geo-localization predominantly adopt the image-based setting, where a single drone-view snapshot is matched with images from other platforms. Such task formulation, however, underutilizes the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hao Ju , Shaofei Huang , Si Liu , Zhedong Zheng

Swarm UAV autonomous flight for Embodied Long-Horizon (ELH) tasks is crucial for advancing the low-altitude economy. However, existing methods focus only on specific basic tasks due to dataset limitations, failing in real-world deployment…

Robotics · Computer Science 2025-11-20 Tongtong Feng , Xin Wang , Feilin Han , Leping Zhang , Wenwu Zhu

In recent years, significant progress has been made in the field of underwater image enhancement (UIE). However, its practical utility for high-level vision tasks, such as underwater object detection (UOD) in Autonomous Underwater Vehicles…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Junjie Wen , Jinqiang Cui , Benyun Zhao , Bingxin Han , Xuchen Liu , Zhi Gao , Ben M. Chen

This paper presents the design, implementation, and evolution of a comprehensive multimodal room-monitoring system that integrates synchronized video and audio processing for real-time activity recognition and anomaly detection. We describe…

Sound · Computer Science 2025-11-25 Aman Verma , Keshav Samdani , Mohd. Samiuddin Shafi

Autonomous UAV flight in confined, wall-dense environments requires low-latency and reliable motion planning under strict safety constraints. Traditional optimization-based planners suffer from mapping latency and easily fall into local…

Depth completion and object detection are two crucial tasks often used for aerial 3D mapping, path planning, and collision avoidance of Uncrewed Aerial Vehicles (UAVs). Common solutions include using measurements from a LiDAR sensor;…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Sara Hatami Gazani , Fardad Dadboud , Miodrag Bolic , Iraj Mantegh , Homayoun Najjaran