English
Related papers

Related papers: Caltech Aerial RGB-Thermal Dataset in the Wild

200 papers

High-fidelity wildfire monitoring using Unmanned Aerial Vehicles (UAVs) typically requires multimodal sensing - especially RGB and thermal imagery - which increases hardware cost and power consumption. This paper introduces SAM-TIFF, a…

Image and Video Processing · Electrical Eng. & Systems 2025-05-06 Michael Marinaccio , Fatemeh Afghah

RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions by fusing visible and thermal infrared modalities. However, existing RGBT trackers rely solely on initial-frame visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hao Li , Yuhao Wang , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

Referring Multi-Object Tracking has attracted increasing attention due to its human-friendly interactive characteristics, yet it exhibits limitations in low-visibility conditions, such as nighttime, smoke, and other challenging scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yanqiu Yu , Zhifan Jin , Sijia Chen , Tongfei Chu , En Yu , Liman Liu , Wenbing Tao

There has been exciting recent progress in using radar as a sensor for robot navigation due to its increased robustness to varying environmental conditions. However, within these different radar perception systems, ground penetrating radar…

Robotics · Computer Science 2021-07-19 Alexander Baikovitz , Paloma Sodhi , Michael Dille , Michael Kaess

RGB-D data is essential for solving many problems in computer vision. Hundreds of public RGB-D datasets containing various scenes, such as indoor, outdoor, aerial, driving, and medical, have been proposed. These datasets are useful for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Alexandre Lopes , Roberto Souza , Helio Pedrini

RGB-Thermal (RGB-T) object tracking receives more and more attention due to the strongly complementary benefits of thermal information to visible data. However, RGB-T research is limited by lacking a comprehensive evaluation platform. In…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Chenglong Li , Xinyan Liang , Yijuan Lu , Nan Zhao , Jin Tang

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

We introduce a new RGB-D object dataset captured in the wild called WildRGB-D. Unlike most existing real-world object-centric datasets which only come with RGB capturing, the direct capture of the depth channel allows better 3D annotations…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Hongchi Xia , Yang Fu , Sifei Liu , Xiaolong Wang

Numerical simulations of Earth's weather and climate require substantial amounts of computation. This has led to a growing interest in replacing subroutines that explicitly compute physical processes with approximate machine learning (ML)…

Machine Learning · Computer Science 2021-11-30 Salva Rühling Cachay , Venkatesh Ramesh , Jason N. S. Cole , Howard Barker , David Rolnick

Computer vision was long a tool used for aiding visually impaired people to move around their environment and avoid obstacles and falls. Solutions are limited to either indoor or outdoor scenes, which limits the kind of places and scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Leyla Benhamida , Khadidja Delloul , Slimane Larabi

Accurate state estimation and multi-modal perception are prerequisites for autonomous legged robots in complex, large-scale environments. To date, no large-scale public legged-robot dataset captures the real-world conditions needed to…

Marine environments present significant challenges for perception and autonomy due to dynamic surfaces, limited visibility, and complex interactions between aerial, surface, and submerged sensing modalities. This paper introduces the Aerial…

In the past decade, although single-robot perception has made significant advancements, the exploration of multi-robot collaborative perception remains largely unexplored. This involves fusing compressed, intermittent, limited,…

Robotics · Computer Science 2024-05-24 Yang Zhou , Long Quang , Carlos Nieto-Granda , Giuseppe Loianno

Humans use UAVs to monitor changes in forest environments since they are lightweight and provide a large variety of surveillance data. However, their information does not present enough details for understanding the scene which is needed to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bianca-Cerasela-Zelia Blaga , Sergiu Nedevschi

We present a novel dataset covering seasonal and challenging perceptual conditions for autonomous driving. Among others, it enables research on visual odometry, global place recognition, and map-based re-localization tracking. The data was…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Patrick Wenzel , Rui Wang , Nan Yang , Qing Cheng , Qadeer Khan , Lukas von Stumberg , Niclas Zeller , Daniel Cremers

Salient object detection in complex scenes and environments is a challenging research topic. Most works focus on RGB-based salient object detection, which limits its performance of real-life applications when confronted with adverse…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zhengzheng Tu , Yan Ma , Zhun Li , Chenglong Li , Jieming Xu , Yongtao Liu

RGB-Thermal (RGBT) tracking aims to exploit visible and thermal infrared modalities for robust all-weather object tracking. However, existing RGBT trackers struggle to resolve modality discrepancies, which poses great challenges for robust…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Hao Li , Yuhao Wang , Xiantao Hu , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

In robot vision, thermal cameras hold great potential for recognizing humans even in complete darkness. However, their application to multi-person tracking (MPT) has been limited due to data scarcity and the inherent difficulty of…

Multi-sensor fusion has significant potential in perception tasks for both indoor and outdoor environments. Especially under challenging conditions such as adverse weather and low-light environments, the combined use of millimeter-wave…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Tieshuai Song , Jiandong Ye , Ao Guo , Guidong He , Bin Yang

Rapid progress in embedded computing hardware increasingly enables on-board image processing on small robots. This development opens the path to replacing costly sensors with sophisticated computer vision techniques. A case in point is the…

Robotics · Computer Science 2020-10-27 Chaoyue Niu , Danesh Tarapore , Klaus-Peter Zauner