English
Related papers

Related papers: Bringing RGB and IR Together: Hierarchical Multi-M…

200 papers

Low-light image super-resolution (LLSR) is a challenging task due to the coupled degradation of low resolution and poor illumination. To address this, we propose the Guided Texture and Feature Modulation Network (GTFMN), a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yongsong Huang , Tzu-Hsuan Peng , Tomo Miyazaki , Xiaofeng Liu , Chun-Ting Chou , Ai-Chun Pang , Shinichiro Omachi

Image-text retrieval (ITR) is a challenging task in the field of multimodal information processing due to the semantic gap between different modalities. In recent years, researchers have made great progress in exploring the accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jie Guo , Meiting Wang , Yan Zhou , Bin Song , Yuhao Chi , Wei Fan , Jianglong Chang

Machine learning (ML) has been widely used for efficient resource allocation (RA) in wireless networks. Although superb performance is achieved on small and simple networks, most existing ML-based approaches are confronted with difficulties…

Machine Learning · Computer Science 2024-10-28 Xiaochen Zhang , Haitao Zhao , Jun Xiong , Li Zhou , Jibo Wei

Multispectral object detection aims to leverage complementary information from visible (RGB) and infrared (IR) modalities to enable robust performance under diverse environmental conditions. Our key insight, derived from wavelet analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Seongmin Hwang , Daeyoung Han , Moongu Jeon

Multispectral pedestrian detection is a crucial component in various critical applications. However, a significant challenge arises due to the misalignment between these modalities, particularly under real-world conditions where data often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Taeheon Kim , Sangyun Chung , Youngjoon Yu , Yong Man Ro

The display devices like HDR10 televisions are increasingly prevalent in our daily life for visualizing high dynamic range (HDR) images. But the majority of media images on the internet remain in 8-bit standard dynamic range (SDR) format.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Liqi Xue , Tianyi Xu , Yongbao Song , Yan Liu , Lei Zhang , Xiantong Zhen , Jun Xu

Multispectral object detection, utilizing both visible (RGB) and thermal infrared (T) modals, has garnered significant attention for its robust performance across diverse weather and lighting conditions. However, effectively exploiting the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jinzhong Wang , Xuetao Tian , Shun Dai , Tao Zhuo , Haorui Zeng , Hongjuan Liu , Jiaqi Liu , Xiuwei Zhang , Yanning Zhang

Despite the rapid evolution of semantic segmentation for land cover classification in high-resolution remote sensing imagery, integrating multiple data modalities such as Digital Surface Model (DSM), RGB, and Near-infrared (NIR) remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Tong Wang , Guanzhou Chen , Xiaodong Zhang , Chenxi Liu , Xiaoliang Tan , Jiaqi Wang , Chanjuan He , Wenlin Zhou

Existing cross-modal pedestrian detection (CMPD) employs complementary information from RGB and thermal-infrared (TIR) modalities to detect pedestrians in 24h-surveillance systems.RGB captures rich pedestrian details under daylight, while…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Qian Bie , Xiao Wang , Bin Yang , Zhixi Yu , Jun Chen , Xin Xu

Semantic segmentation is important for scene understanding. To address the scenes of adverse illumination conditions of natural images, thermal infrared (TIR) images are introduced. Most existing RGB-T semantic segmentation methods follow…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Gongyang Li , Yike Wang , Zhi Liu , Xinpeng Zhang , Dan Zeng

The majority of human detection methods rely on the sensor using visible lights (e.g., RGB cameras) but such sensors are limited in scenarios with degraded vision conditions. In this paper, we present a multimodal human detection system…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Kaiwen Cai , Qiyue Xia , Peize Li , John Stankovic , Chris Xiaoxuan Lu

In this work, we investigate various methods to deal with semantic labeling of very high resolution multi-modal remote sensing data. Especially, we study how deep fully convolutional networks can be adapted to deal with multi-modal and…

Neural and Evolutionary Computing · Computer Science 2017-11-27 Nicolas Audebert , Bertrand Le Saux , Sébastien Lefèvre

Recently, large-scale visual language pre-trained (VLP) models have demonstrated impressive performance across various downstream tasks. Motivated by these advancements, pioneering efforts have emerged in multi-label image recognition with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Leilei Ma , Hongxing Xie , Lei Wang , Yanping Fu , Dengdi Sun , Haifeng Zhao

RGB-D saliency detection aims to fuse multi-modal cues to accurately localize salient regions. Existing works often adopt attention modules for feature modeling, with few methods explicitly leveraging fine-grained details to merge with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Zongwei Wu , Guillaume Allibert , Fabrice Meriaudeau , Chao Ma , Cédric Demonceaux

Text-guided multispectral object detection uses text semantics to guide semantic-aware cross-modal interaction between RGB and IR for more robust perception. However, notable limitations remain: (1) existing methods often use text only as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiaqi Wu , Zhen Wang , Enhao Huang , Kangqing Shen , Yulin Wang , Yang Yue , Yifan Pu , Gao Huang

RGB-T tracking leverages the complementary strengths of RGB and thermal infrared (TIR) modalities to address challenging scenarios such as low illumination and adverse weather. However, existing methods often fail to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhongxuan Zhang , Bi Zeng , Xinyu Ni , Yimin Du

Multispectral object detection, utilizing RGB and TIR (thermal infrared) modalities, is widely recognized as a challenging task. It requires not only the effective extraction of features from both modalities and robust fusion strategies,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Chen Zhou , Peng Cheng , Junfeng Fang , Yifan Zhang , Yibo Yan , Xiaojun Jia , Yanyan Xu , Kun Wang , Xiaochun Cao

The NIR-to-RGB spectral domain translation is a formidable task due to the inherent spectral mapping ambiguities within NIR inputs and RGB outputs. Thus, existing methods fail to reconcile the tension between maintaining texture detail…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Huiyu Zhai , Mo Chen , Xingxing Yang , Gusheng Kang

In recent years, object detection utilizing both visible (RGB) and thermal infrared (IR) imagery has garnered extensive attention and has been widely implemented across a diverse array of fields. By leveraging the complementary properties…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Tianyi Zhao , Maoxun Yuan , Feng Jiang , Nan Wang , Xingxing Wei

Benefiting from the vigorous development of deep learning, many CNN-based image super-resolution methods have emerged and achieved better results than traditional algorithms. However, it is difficult for most algorithms to adaptively adjust…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yuxi Cai , Huicheng Lai , Zhenghong Jia