English
Related papers

Related papers: A Transformer-based Multimodal Fusion Model for Ef…

200 papers

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Apoorv Singh

Images and video frames captured by cameras placed throughout smart cities are often transmitted over the network to a server to be processed by deep neural networks for various tasks. Transmission of raw images, i.e., without any form of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Arian Bakhtiarnia , Błażej Leporowski , Lukas Esterle , Alexandros Iosifidis

In real-world crowd counting applications, the crowd densities vary greatly in spatial and temporal domains. A detection based counting method will estimate crowds accurately in low density scenes, while its reliability in congested areas…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Jiang Liu , Chenqiang Gao , Deyu Meng , Alexander G. Hauptmann

In automotive sensor fusion systems, smart sensors and Vehicle-to-Everything (V2X) modules are commonly utilized. Sensor data from these systems are typically available only as processed object lists rather than raw sensor data from…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xiangzhong Liu , Jiajie Zhang , Hao Shen

The fusion technique is the key to the multimodal emotion recognition task. Recently, cross-modal attention-based fusion methods have demonstrated high performance and strong robustness. However, cross-modal attention suffers from redundant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Feng Liu , Ziwang Fu , Yunlong Wang , Qijian Zheng

Due to its variety of applications in the real-world, the task of single image-based crowd counting has received a lot of interest in the recent years. Recently, several approaches have been proposed to address various problems encountered…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Vishwanath A. Sindagi , Rajeev Yasarla , Vishal M. Patel

The task of crowd counting is extremely challenging due to complicated difficulties, especially the huge variation in vision scale. Previous works tend to adopt a naive concatenation of multi-scale information to tackle it, while the scale…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Zhikang Zou , Yifan Liu , Shuangjie Xu , Wei Wei , Shiping Wen , Pan Zhou

This paper introduces a novel method for end-to-end crowd detection that leverages object density information to enhance existing transformer-based detectors. We present CrowdQuery (CQ), whose core component is our CQ module that predicts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Marius Dähling , Sebastian Krebs , J. Marius Zöllner

With the rising number of interconnected devices and sensors, modeling distributed sensor networks is of increasing interest. Recurrent neural networks (RNN) are considered particularly well suited for modeling sensory and streaming data.…

Machine Learning · Computer Science 2017-11-15 Stephan Baier , Sigurd Spieckermann , Volker Tresp

In this paper we seek methods to effectively detect urban micro-events. Urban micro-events are events which occur in cities, have limited geographical coverage and typically affect only a small group of citizens. Because of their scale…

Machine Learning · Computer Science 2019-05-01 Maarten Sukel , Stevan Rudinac , Marcel Worring

Crowd counting is a fundamental yet challenging task, which desires rich information to generate pixel-wise crowd density maps. However, most previous methods only used the limited information of RGB images and cannot well discover…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Lingbo Liu , Jiaqi Chen , Hefeng Wu , Guanbin Li , Chenglong Li , Liang Lin

In this paper, we propose a fast fully convolutional neural network (FCNN) for crowd segmentation. By replacing the fully connected layers in CNN with 1 by 1 convolution kernels, FCNN takes whole images as inputs and directly outputs…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Kai Kang , Xiaogang Wang

As the field of remote sensing is evolving, we witness the accumulation of information from several modalities, such as multispectral (MS), hyperspectral (HSI), LiDAR etc. Each of these modalities possess its own distinct characteristics…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Rupak Bose , Shivam Pande , Biplab Banerjee

Acquiring accurate channel state information (CSI) is critical for reliable and efficient wireless communication, but challenges such as high pilot overhead and channel aging hinder timely and accurate CSI acquisition. CSI prediction, which…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Mehdi Sattari , Javad Aliakbari , Alexandre Graell i Amat , Tommy Svensson

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Li Ke , Liu Yukai

Accurate RGB-Thermal (RGB-T) crowd counting is crucial for public safety in challenging conditions. While recent Transformer-based methods excel at capturing global context, their inherent lack of spatial inductive bias causes attention to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yuhong Feng , Hongtao Chen , Qi Zhang , Jie Chen , Zhaoxi He , Mingzhe Liu , Jianghai Liao

While attention-based approaches have shown considerable progress in enhancing image fusion and addressing the challenges posed by long-range feature dependencies, their efficacy in capturing local features is compromised by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Jingjing Liu , Li Zhang , Xiaoyang Zeng , Wanquan Liu , Jianhua Zhang

Forecasting urban phenomena such as housing prices and public health indicators requires the effective integration of various geospatial data. Current methods primarily utilize task-specific models, while recent foundation models for…

Machine Learning · Computer Science 2025-10-16 Dominik J. Mühlematter , Lin Che , Ye Hong , Martin Raubal , Nina Wiedemann

Person Re-identification (ReID) aims to retrieve the specific person across non-overlapping cameras, which greatly helps intelligent transportation systems. As we all know, Convolutional Neural Networks (CNNs) and Transformers have the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yuhao Wang , Pingping Zhang , Xuehu Liu , Zhengzheng Tu , Huchuan Lu