English
Related papers

Related papers: CAGMamba: Context-Aware Gated Cross-Modal Mamba Ne…

200 papers

Multimodal sentiment analysis (MSA) aims to predict human sentiment from textual, acoustic, and visual information in videos. Recent studies improve multimodal fusion by modeling modality interaction and assigning different modality…

Multimedia · Computer Science 2026-04-08 Chen Su , Yuanhe Tian , Yan Song

As an important task in sentiment analysis, Multimodal Aspect-Based Sentiment Analysis (MABSA) has attracted increasing attention in recent years. However, previous approaches either (i) use separately pre-trained visual and textual models,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Yan Ling , Jianfei Yu , Rui Xia

Multimodal Sentiment Analysis (MSA) integrates complementary features from text, video, and audio for robust emotion understanding in human interactions. However, models suffer from severe data scarcity and high annotation costs, severely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Hongyu Zhu , Lin Chen , Xin Jin , Mingsheng Shang

Long-term time series forecasting (LTSF) provides longer insights into future trends and patterns. Over the past few years, deep learning models especially Transformers have achieved advanced performance in LTSF tasks. However, LTSF faces…

Machine Learning · Computer Science 2024-06-28 Aobo Liang , Xingguo Jiang , Yan Sun , Xiaohou Shi , Ke Li

Multimodal aspect-based sentiment analysis (MABSA) aims to identify aspect-level sentiments by jointly modeling textual and visual information, which is essential for fine-grained opinion understanding in social media. Existing approaches…

Computation and Language · Computer Science 2026-01-13 Zhongzheng Wang , Yuanhe Tian , Hongzhi Wang , Yan Song

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing…

Machine Learning · Computer Science 2026-05-15 Xingsheng Chen , Xianpei Mu , Deyu Yi , Yilin Yuan , Xingwei He , Bo Gao , Regina Zhang , Pietro Lio , Siu-Ming Yiu

Multi-modal fusion is crucial for Internet of Things (IoT) perception, widely deployed in smart homes, intelligent transport, industrial automation, and healthcare. However, existing systems often face challenges: high model complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Weiqi Yang , Xu Zhou , Jingfu Guan , Hao Du , Tianyu Bai

Multimodal sentiment analysis (MSA) is an emerging research topic that aims to understand and recognize human sentiment or emotions through multiple modalities. However, in real-world dynamic scenarios, the distribution of target data is…

Machine Learning · Computer Science 2025-02-11 Zirun Guo , Tao Jin , Wenlong Xu , Wang Lin , Yangyang Wu

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Yang Liu , Li Wan , Yiteng Huang , Ming Sun , Yangyang Shi , Florian Metze

Motion forecasting is a crucial component of autonomous driving systems, enabling the generation of accurate and smooth future trajectories to ensure safe navigation to the destination. In previous methods, potential future trajectories are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shijie Li , Xun Xu , Si Yong Yeo , Xulei Yang

Learning human motion based on a time-dependent input signal presents a challenging yet impactful task with various applications. The goal of this task is to generate or estimate human movement that consistently reflects the temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Quang Nguyen , Tri Le , Baoru Huang , Minh Nhat Vu , Ngan Le , Thieu Vo , Anh Nguyen

Natural language understanding inherently depends on integrating multiple complementary perspectives spanning from surface syntax to deep semantics and world knowledge. However, current Aspect-Based Sentiment Analysis (ABSA) systems…

Computation and Language · Computer Science 2026-03-20 Smitha Muthya Sudheendra , Mani Deep Cherukuri , Jaideep Srivastava

Emotion recognition is a challenging and actively-studied research area that plays a critical role in emotion-aware human-computer interaction systems. In a multimodal setting, temporal alignment between different modalities has not been…

Computation and Language · Computer Science 2022-01-19 Pengfei Liu , Kun Li , Helen Meng

With the rapid development of multimedia, the shift from unimodal textual sentiment analysis to multimodal image-text sentiment analysis has obtained academic and industrial attention in recent years. However, multimodal sentiment analysis…

Multimedia · Computer Science 2024-12-11 Fuhai Chen , Pengpeng Huang , Xuri Ge , Jie Huang , Zishuo Bao

Attention mechanisms have been widely used to capture long-range dependencies among nodes in Graph Transformers. Bottlenecked by the quadratic computational cost, attention mechanisms fail to scale in large graphs. Recent improvements in…

Machine Learning · Computer Science 2024-02-02 Chloe Wang , Oleksii Tsepa , Jun Ma , Bo Wang

Existing CNN-based speech separation models face local receptive field limitations and cannot effectively capture long time dependencies. Although LSTM and Transformer-based speech separation models can avoid this problem, their high…

Sound · Computer Science 2024-09-11 Kai Li , Guo Chen , Runxuan Yang , Xiaolin Hu

Accurate long-term time series forecasting (LTSF) requires the capture of complex long-range dependencies and dynamic periodic patterns. Recent advances in frequency-domain analysis offer a global perspective for uncovering temporal…

Artificial Intelligence · Computer Science 2026-04-28 Xudong Jiang , Mingshan Loo , Hanchen Yang , Wengen Li , Mingrui Zhang , Yichao Zhang , Jihong Guan , Shuigeng Zhou

The essence of multi-modal fusion lies in exploiting the complementary information inherent in diverse modalities. However, prevalent fusion methods rely on traditional neural architectures and are inadequately equipped to capture the…

Artificial Intelligence · Computer Science 2025-06-19 Wenbing Li , Hang Zhou , Junqing Yu , Zikai Song , Wei Yang

Image fusion integrates complementary information from different modalities to generate high-quality fused images, thereby enhancing downstream tasks such as object detection and semantic segmentation. Unlike task-specific techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yingying Wang , Rongjin Zhuang , Hui Zheng , Xuanhua He , Ke Cao , Xiaotong Tu , Xinghao Ding

With the increasing prevalence of multimodal content on social media, sentiment analysis faces significant challenges in effectively processing heterogeneous data and recognizing multi-label emotions. Existing methods often lack effective…

Computation and Language · Computer Science 2025-08-26 Xilai Xu , Zilin Zhao , Chengye Song , Zining Wang , Jinhe Qiang , Jiongrui Yan , Yuhuai Lin