English
Related papers

Related papers: Multimodal Attention-Enhanced Feature Fusion-based…

200 papers

Recently, the RGB images and point clouds fusion methods have been proposed to jointly estimate 2D optical flow and 3D scene flow. However, as both conventional RGB cameras and LiDAR sensors adopt a frame-based data acquisition mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zhexiong Wan , Yuxin Mao , Jing Zhang , Yuchao Dai

Compared to images, videos better reflect real-world acquisition and possess valuable temporal cues. However, existing multi-sensor fusion research predominantly integrates complementary context from multiple images rather than videos due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Linfeng Tang , Yeda Wang , Meiqi Gong , Zizhuo Li , Yuxin Deng , Xunpeng Yi , Chunyu Li , Han Xu , Hao Zhang , Jiayi Ma

Leveraging the synergy of both audio data and visual data is essential for understanding human emotions and behaviors, especially in in-the-wild setting. Traditional methods for integrating such multimodal information often stumble, leading…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jun Yu , Zerui Zhang , Zhihong Wei , Gongpeng Zhao , Zhongpeng Cai , Yongqi Wang , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Multimodal emotion recognition (MER) aims to infer human affect by jointly modeling audio and visual cues; however, existing approaches often struggle with temporal misalignment, weakly discriminative feature representations, and suboptimal…

Multimedia · Computer Science 2026-01-21 Joe Dhanith P R , Shravan Venkatraman , Vigya Sharma , Santhosh Malarvannan

The ability to understand the surrounding scene is of paramount importance for Autonomous Vehicles (AVs). This paper presents a system capable to work in an online fashion, giving an immediate response to the arise of anomalies surrounding…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Leonardo Rossi , Vittorio Bernuzzi , Tomaso Fontanini , Massimo Bertozzi , Andrea Prati

Video anomaly detection (VAD) -- commonly formulated as a multiple-instance learning problem in a weakly-supervised manner due to its labor-intensive nature -- is a challenging problem in video surveillance where the frames of anomaly need…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Hyekang Kevin Joo , Khoa Vo , Kashu Yamazaki , Ngan Le

Video Anomaly Detection (VAD) aims to locate events that deviate from normal patterns in videos. Traditional approaches often rely on extensive labeled data and incur high computational costs. Recent tuning-free methods based on Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Zhaolin Cai , Fan Li , Ziwei Zheng , Haixia Bi , Lijun He

Audio-visual speech recognition (AVSR) aims to transcribe human speech using both audio and video modalities. In practical environments with noise-corrupted audio, the role of video information becomes crucial. However, prior works have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-15 Sungnyun Kim , Kangwook Jang , Sangmin Bae , Hoirin Kim , Se-Young Yun

Video Anomaly Detection (VAD) is critical for surveillance and public safety. However, existing benchmarks are limited to either frame-level or video-level tasks, restricting a holistic view of model generalization. This work first…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Seoik Jung , Taekyung Song , Joshua Jordan Daniel , JinYoung Lee , SungJun Lee

Control Area Network (CAN) is an essential communication protocol that interacts between Electronic Control Units (ECUs) in the vehicular network. However, CAN is facing stringent security challenges due to innate security risks. Intrusion…

Artificial Intelligence · Computer Science 2024-03-18 Pengzhou Cheng , Zongru Wu , Gongshen Liu

Video anomaly detection (VAD) is crucial for intelligent surveillance, but a significant challenge lies in identifying complex anomalies, which are events defined by intricate relationships and temporal dependencies among multiple entities…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Mohammad Mahdi Hemmatyar , Mahdi Jafari , Mohammad Amin Yousefi , Mohammad Reza Nemati , Mobin Azadani , Hamid Reza Rastad , Amirmohammad Akbari

Video Anomaly Detection (VAD) plays a crucial role in modern surveillance systems, aiming to identify various anomalies in real-world situations. However, current benchmark datasets predominantly emphasize simple, single-frame anomalies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yoav Arad , Michael Werman

Video Anomaly Detection (VAD) aims to localize abnormal events on the timeline of long-range surveillance videos. Anomaly-scoring-based methods have been prevailing for years but suffer from the high complexity of thresholding and low…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Hui Lv , Qianru Sun

Industrial anomaly detection (IAD) increasingly benefits from integrating 2D and 3D data, but robust cross-modal fusion remains challenging. We propose a novel unsupervised framework, Multi-Modal Attention-Driven Fusion Restoration (MAFR),…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Usman Ali , Ali Zia , Abdul Rehman , Umer Ramzan , Zohaib Hassan , Talha Sattar , Jing Wang , Wei Xiang

Unsupervised visual anomaly detection from multi-view images presents a significant challenge: distinguishing genuine defects from benign appearance variations caused by viewpoint changes. Existing methods, often designed for single-view…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xintao Chen , Xiaohao Xu , Bozhong Zheng , Yun Liu , Yingna Wu

Video Anomaly Detection (VAD) serves as a pivotal technology in the intelligent surveillance systems, enabling the temporal or spatial identification of anomalous events within videos. While existing reviews predominantly concentrate on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yang Liu , Dingkang Yang , Yan Wang , Jing Liu , Jun Liu , Azzedine Boukerche , Peng Sun , Liang Song

Weakly supervised video anomaly detection (WSVAD) is a challenging task since only video-level labels are available for training. In previous studies, the discriminative power of the learned features is not strong enough, and the data…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Congqi Cao , Xin Zhang , Shizhou Zhang , Peng Wang , Yanning Zhang

Existing anomaly detection methods for Wireless Sensor Networks (WSNs) generally suffer from insufficient extraction of spatio-temporal correlation features, reliance on either timedomain or frequencydomain information alone, and high…

Networking and Internet Architecture · Computer Science 2026-04-28 Miao Ye , Ziheng Wang , Qiuxiang Jiang , Xingsi Xue , Wenxi Liu , Yu Ning , Cheng Zhu

Efficiently exploiting multi-modal inputs for accurate RGB-D saliency detection is a topic of high interest. Most existing works leverage cross-modal interactions to fuse the two streams of RGB-D for intermediate features' enhancement. In…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Zongwei Wu , Shriarulmozhivarman Gobichettipalayam , Brahim Tamadazte , Guillaume Allibert , Danda Pani Paudel , Cédric Demonceaux

Fault diagnosis in multimode processes plays a critical role in ensuring the safe operation of industrial systems across multiple modes. It faces a great challenge yet to be addressed - that is, the significant distributional differences…

Machine Learning · Computer Science 2025-07-24 Guangqiang Li , M. Amine Atoui , Xiangshun Li