English
Related papers

Related papers: A Transformer-based Multimodal Fusion Model for Ef…

200 papers

Crowd counting is a fundamental problem in crowd analysis which is typically accomplished by estimating a crowd density map and summing over the density values. However, this approach suffers from background noise accumulation and loss of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yasiru Ranasinghe , Nithin Gopalakrishnan Nair , Wele Gedara Chaminda Bandara , Vishal M. Patel

Recently, convolutional neural networks (CNNs) are the leading defacto method for crowd counting. However, when dealing with video datasets, CNN-based methods still process each video frame independently, thus ignoring the powerful temporal…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Zhikang Zou , Huiliang Shao , Xiaoye Qu , Wei Wei , Pan Zhou

Recent developments in image classification and natural language processing, coupled with the rapid growth in social media usage, have enabled fundamental advances in detecting breaking events around the world in real-time. Emergency…

Machine Learning · Computer Science 2020-04-13 Mahdi Abavisani , Liwei Wu , Shengli Hu , Joel Tetreault , Alejandro Jaimes

Deep multimodal fusion by using multiple sources of data for classification or regression has exhibited a clear advantage over the unimodal counterpart on various applications. Yet, current methods including aggregation-based and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Yikai Wang , Wenbing Huang , Fuchun Sun , Tingyang Xu , Yu Rong , Junzhou Huang

Multimodal deep sensor fusion has the potential to enable autonomous vehicles to visually understand their surrounding environments in all weather conditions. However, existing deep sensor fusion methods usually employ convoluted…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Sri Aditya Deevi , Connor Lee , Lu Gan , Sushruth Nagesh , Gaurav Pandey , Soon-Jo Chung

Human state recognition is a critical topic with pervasive and important applications in human-machine systems. Multi-modal fusion, the combination of metrics from multiple data sources, has been shown as a sound method for improving the…

Human-Computer Interaction · Computer Science 2023-04-12 Ruiqi Wang , Wonse Jo , Dezhong Zhao , Weizheng Wang , Baijian Yang , Guohua Chen , Byung-Cheol Min

Crowd counting research has made significant advancements in real-world applications, but it remains a formidable challenge in cross-modal settings. Most existing methods rely solely on the optical features of RGB images, ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Youjia Zhang , Soyun Choi , Sungeun Hong

Accurate channel state information (CSI) acquisition is essential for modern wireless systems, which becomes increasingly difficult under large antenna arrays, strict pilot overhead constraints, and diverse deployment environments. Existing…

Information Theory · Computer Science 2026-03-17 Xingyu Zhou , Le Liang , Hao Ye , Jing Zhang , Chao-Kai Wen , Shi Jin

In this work, we tackle the problem of crowd counting in images. We present a Convolutional Neural Network (CNN) based density estimation approach to solve this problem. Predicting a high resolution density map in one go is a challenging…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Viresh Ranjan , Hieu Le , Minh Hoai

The mechanism of connecting multimodal signals through self-attention operation is a key factor in the success of multimodal Transformer networks in remote sensing data fusion tasks. However, traditional approaches assume access to all…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuxing Chen , Maofan Zhao , Lorenzo Bruzzone

In this paper we propose ResnetCrowd, a deep residual architecture for simultaneous crowd counting, violent behaviour detection and crowd density level classification. To train and evaluate the proposed multi-objective technique, a new 100…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Mark Marsden , Kevin McGuinness , Suzanne Little , Noel E. O'Connor

Multi-modal image fusion aims to consolidate complementary information from diverse source images into a unified representation. The fused image is expected to preserve fine details and maintain high visual fidelity. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xingxin Xu , Bing Cao , DongDong Li , Qinghua Hu , Pengfei Zhu

Color plays an important role in human visual perception, reflecting the spectrum of objects. However, the existing infrared and visible image fusion methods rarely explore how to handle multi-spectral/channel data directly and achieve high…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Jun Yue , Leyuan Fang , Shaobo Xia , Yue Deng , Jiayi Ma

Unsupervised crowd counting is a challenging yet not largely explored task. In this paper, we explore it in a transfer learning setting where we learn to detect and count persons in an unlabeled target set by transferring bi-knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Yuting Liu , Zheng Wang , Miaojing Shi , Shin'ichi Satoh , Qijun Zhao , Hongyu Yang

Wi-Fi sensing is gaining momentum as a non-intrusive and privacy-preserving alternative to vision-based systems for human identification. However, person identification through wireless signals, particularly without user motion, remains…

With the development of Artificial Intelligence, numerous real-world tasks have been accomplished using technology integrated with deep learning. To achieve optimal performance, deep neural networks typically require large volumes of data…

Machine Learning · Computer Science 2025-05-09 Yuren Zhang , Zhongnan Pu , Lei Jing

State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors. In crowded scenes, however, detectors often fail to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Weihong Ren , Xinchao Wang , Jiandong Tian , Yandong Tang , Antoni B. Chan

Transformer-based entropy models have gained prominence in recent years due to their superior ability to capture long-range dependencies in probability distribution estimation compared to convolution-based methods. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Daxin Li , Yuanchao Bai , Kai Wang , Junjun Jiang , Xianming Liu , Wen Gao

Semantic segmentation of remotely sensed urban scene images is required in a wide range of practical applications, such as land cover mapping, urban change detection, environmental protection, and economic assessment.Driven by rapid…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Libo Wang , Rui Li , Ce Zhang , Shenghui Fang , Chenxi Duan , Xiaoliang Meng , Peter M. Atkinson

Convolutional neural networks (CNN) have demonstrated outstanding Compressed Sensing (CS) performance compared to traditional, hand-crafted methods. However, they are broadly limited in terms of generalisability, inductive bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Marlon Bran Lorenzana , Craig Engstrom , Shekhar S. Chandra