English
Related papers

Related papers: RGB-T Multi-Modal Crowd Counting Based on Transfor…

200 papers

In this study, we propose a novel RGB-T tracking framework by jointly modeling both appearance and motion cues. First, to obtain a robust appearance model, we develop a novel late fusion method to infer the fusion weight maps of both RGB…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Pengyu Zhang , Jie Zhao , Dong Wang , Huchuan Lu , Xiaoyun Yang

Crowd counting aims to count the number of instantaneous people in a crowded space, and many promising solutions have been proposed for single image crowd counting. With the ubiquitous video capture devices in public safety field, how to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Xingjiao Wu , Baohan Xu , Yingbin Zheng , Hao Ye , Jing Yang , Liang He

Visible and infrared image fusion (VIF) is an important multimedia task in computer vision. Most VIF methods focus primarily on optimizing fused image quality. Recent studies have begun incorporating downstream tasks, such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 He Li , Xinyu Liu , Weihang Kong , Xingchen Zhang

RGB-Thermal (RGBT) tracking aims to achieve robust object localization across diverse environmental conditions by fusing visible and thermal infrared modalities. However, existing RGBT trackers rely solely on initial-frame visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hao Li , Yuhao Wang , Wenning Hao , Pingping Zhang , Dong Wang , Huchuan Lu

The crowd counting task aims at estimating the number of people located in an image or a frame from videos. Existing methods widely adopt density maps as the training targets to optimize the point-to-point loss. While in testing phase, we…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Xiyang Liu , Jie Yang , Wenrui Ding

Multimodal sensing has proven valuable for visual tracking, as different sensor types offer unique strengths in handling one specific challenging scene where object appearance varies. While a generalist model capable of leveraging all…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuedong Tan , Zongwei Wu , Yuqian Fu , Zhuyun Zhou , Guolei Sun , Eduard Zamfi , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

Semi-supervised crowd counting is crucial for addressing the high annotation costs of densely populated scenes. Although several methods based on pseudo-labeling have been proposed, it remains challenging to effectively and accurately…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Maochen Yang , Zekun Li , Jian Zhang , Lei Qi , Yinghuan Shi

Depth estimation in complex real-world scenarios is a challenging task, especially when relying solely on a single modality such as visible light or thermal infrared (THR) imagery. This paper proposes a novel multimodal depth estimation…

Image and Video Processing · Electrical Eng. & Systems 2025-04-30 Zelin Meng , Takanori Fukao

Crowd counting research has made significant advancements in real-world applications, but it remains a formidable challenge in cross-modal settings. Most existing methods rely solely on the optical features of RGB images, ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Youjia Zhang , Soyun Choi , Sungeun Hong

This paper investigates the role of global context for crowd counting. Specifically, a pure transformer is used to extract features with global information from overlapping image patches. Inspired by classification, we add a context token…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Guolei Sun , Yun Liu , Thomas Probst , Danda Pani Paudel , Nikola Popovic , Luc Van Gool

In this paper, a novel Unified Multi-Task Learning Framework of Real-Time Drone Supervision for Crowd Counting (MFCC) is proposed, which utilizes an image fusion network architecture to fuse images from the visible and thermal infrared…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Siqi Gu , Zhichao Lian

In this paper, we tackle the problem of Crowd Counting, and present a crowd density estimation based approach for obtaining the crowd count. Most of the existing crowd counting approaches rely on local features for estimating the crowd…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Viresh Ranjan , Mubarak Shah , Minh Hoai Nguyen

Multimodal sentiment analysis is an important research area that predicts speaker's sentiment tendency through features extracted from textual, visual and acoustic modalities. The central challenge is the fusion method of the multimodal…

Computation and Language · Computer Science 2020-09-29 Zilong Wang , Zhaohong Wan , Xiaojun Wan

The ability to learn robust multi-modality representation has played a critical role in the development of RGBT tracking. However, the regular fusion paradigm and the invariable tracking template remain restrictive to the feature…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ruichao Hou , Boyue Xu , Tongwei Ren , Gangshan Wu

We propose a novel crowd counting model that maps a given crowd scene to its density. Crowd analysis is compounded by myriad of factors like inter-occlusion between people due to extreme crowding, high similarity of appearance between…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Deepak Babu Sam , Shiv Surya , R. Venkatesh Babu

Multi-view crowd tracking estimates each person's tracking trajectories on the ground of the scene. Recent research works mainly rely on CNNs-based multi-view crowd tracking architectures, and most of them are evaluated and compared on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Qi Zhang , Jixuan Chen , Kaiyi Zhang , Xinquan Yu , Antoni B. Chan , Hui Huang

Crowd counting is an important problem in computer vision due to its wide range of applications in image understanding. Currently, this problem is typically addressed using deep learning approaches, such as Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Zhen Wang , Yuelei Li , Jia Wan , Nuno Vasconcelos

Crowd counting is an effective tool for situational awareness in public places. Automated crowd counting using images and videos is an interesting yet challenging problem that has gained significant attention in computer vision. Over the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Muhammad Asif Khan , Hamid Menouar , Ridha Hamila

We propose an end-to-end tracking framework for fusing the RGB and TIR modalities in RGB-T tracking. Our baseline tracker is DiMP (Discriminative Model Prediction), which employs a carefully designed target prediction network trained…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Lichao Zhang , Martin Danelljan , Abel Gonzalez-Garcia , Joost van de Weijer , Fahad Shahbaz Khan

Current optical flow methods exploit the stable appearance of frame (or RGB) data to establish robust correspondences across time. Event cameras, on the other hand, provide high-temporal-resolution motion cues and excel in challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Qianang Zhou , Junhui Hou , Meiyi Yang , Yongjian Deng , Youfu Li , Junlin Xiong