English
Related papers

Related papers: Tri-Modal Fusion Transformers for UAV-based Object…

200 papers

Service mobile robots are often required to avoid dynamic objects while performing their tasks, but they usually have only limited computational resources. To further advance the practical application of service robots in complex dynamic…

Robotics · Computer Science 2026-02-25 Yushen He , Lei Zhao , Tianchen Deng , Zipeng Fang , Weidong Chen

Weakly supervised video anomaly detection (WS-VAD) is a crucial area in computer vision for developing intelligent surveillance systems. This system uses three feature streams: RGB video, optical flow, and audio signals, where each stream…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yuta Kaneko , Abu Saleh Musa Miah , Najmul Hassan , Hyoun-Sup Lee , Si-Woong Jang , Jungpil Shin

Fusing Events and RGB images for object detection leverages the robustness of Event cameras in adverse environments and the rich semantic information provided by RGB cameras. However, two critical mismatches: low-latency Events…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Haitian Zhang , Xiangyuan Wang , Chang Xu , Xinya Wang , Fang Xu , Huai Yu , Lei Yu , Wen Yang

Masked Autoencoders (MAE) play a pivotal role in learning potent representations, delivering outstanding results across various 3D perception tasks essential for autonomous driving. In real-world driving scenarios, it's commonplace to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jian Zou , Tianyu Huang , Guanglei Yang , Zhenhua Guo , Tao Luo , Chun-Mei Feng , Wangmeng Zuo

LiDAR-camera fusion can enhance the performance of 3D object detection by utilizing complementary information between depth-aware LiDAR points and semantically rich images. Existing voxel-based methods face significant challenges when…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ziying Song , Guoxin Zhang , Jun Xie , Lin Liu , Caiyan Jia , Shaoqing Xu , Zhepeng Wang

This technical report presents the 1st winning model for UG2+, a task in CVPR 2024 UAV Tracking and Pose-Estimation Challenge. This challenge faces difficulties in drone detection, UAV-type classification and 2D/3D trajectory estimation in…

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Yikai Wang , Xinghao Chen , Lele Cao , Wenbing Huang , Fuchun Sun , Yunhe Wang

Accurate and robust object detection is critical for autonomous driving. Image-based detectors face difficulties caused by low visibility in adverse weather conditions. Thus, radar-camera fusion is of particular interest but presents…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Huawei Sun , Hao Feng , Georg Stettinger , Lorenzo Servadei , Robert Wille

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

The majority of human detection methods rely on the sensor using visible lights (e.g., RGB cameras) but such sensors are limited in scenarios with degraded vision conditions. In this paper, we present a multimodal human detection system…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Kaiwen Cai , Qiyue Xia , Peize Li , John Stankovic , Chris Xiaoxuan Lu

The Vision Transformer (ViT) architecture has established its place in computer vision literature, however, training ViTs for RGB-D object recognition remains an understudied topic, viewed in recent literature only through the lens of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Georgios Tziafas , Hamidreza Kasaei

Infrastructure-based perception plays a crucial role in intelligent transportation systems, offering global situational awareness and enabling cooperative autonomy. However, existing camera-based detection models often underperform in such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yun Zhang , Zhaoliang Zheng , Johnson Liu , Zhiyu Huang , Zewei Zhou , Zonglin Meng , Tianhui Cai , Jiaqi Ma

Event cameras have attracted increasing attention in recent years due to their advantages in high dynamic range, high temporal resolution, low power consumption, and low latency. Some researchers have begun exploring pre-training directly…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Wentao Wu , Xiao Wang , Chenglong Li , Bo Jiang , Jin Tang , Bin Luo , Qi Liu

The rapid advancement of generative models has led to a growing prevalence of highly realistic AI-generated images, posing significant challenges for digital forensics and content authentication. Conventional detection methods mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Dabbrata Das , Mahshar Yahan , Md Tareq Zaman , Md Rishadul Bayesh

We propose a late-to-early recurrent feature fusion scheme for 3D object detection using temporal LiDAR point clouds. Our main motivation is fusing object-aware latent embeddings into the early stages of a 3D object detector. This feature…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Tong He , Pei Sun , Zhaoqi Leng , Chenxi Liu , Dragomir Anguelov , Mingxing Tan

The unique cost, flexibility, speed, and efficiency of modern UAVs make them an attractive choice in many applications in contemporary society. This, however, causes an ever-increasing number of reported malicious or accidental incidents,…

Artificial Intelligence · Computer Science 2024-10-22 Nikos Sakellariou , Antonios Lalas , Konstantinos Votis , Dimitrios Tzovaras

Object detection in unmanned aerial vehicle (UAV) images remains a highly challenging task, primarily caused by the complexity of background noise and the imbalance of target scales. Traditional methods easily struggle to effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Wenfeng Zhang , Jun Ni , Yue Meng , Xiaodong Pei , Wei Hu , Qibing Qin , Lei Huang

Under extreme low-light conditions, frame-based cameras suffer from severe detail loss due to limited dynamic range. Recent studies have introduced event cameras for event-guided low-light image enhancement. However, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zhanwen Liu , Huanna Song , Yang Wang , Nan Yang , Weiping Ding , Yisheng An

The dynamic range limitation of conventional RGB cameras reduces global contrast and causes loss of high-frequency details such as textures and edges in complex traffic environments (e.g., nighttime driving, tunnels), hindering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zhanwen Liu , Yujing Sun , Yang Wang , Nan Yang , Shengbo Eben Li , Xiangmo Zhao

Integrating frame-based RGB cameras with event streams offers a promising solution for robust object detection under challenging dynamic conditions. However, the inherent heterogeneity and data redundancy of these modalities often lead to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Wei Bao , Yuehan Wang , Tianhang Zhou , Siqi Li , Yue Gao