English
Related papers

Related papers: CAGMamba: Context-Aware Gated Cross-Modal Mamba Ne…

200 papers

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

Sufficient cross-task interaction is crucial for success in multi-task dense prediction. However, sufficient interaction often results in high computational complexity, forcing existing methods to face the trade-off between interaction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Mang Cao , Sanping Zhou , Yizhe Li , Ye Deng , Wenli Huang , Le Wang

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Accurate and efficient multivariate time series (MTS) analysis is increasingly critical for a wide range of intelligent applications. Within this realm, Transformers have emerged as the predominant architecture due to their strong ability…

Machine Learning · Computer Science 2026-05-19 Rui An , Haohao Qu , Wenqi Fan , Xuequn Shang , Qing Li

In the field of multimodal medical data analysis, leveraging diverse types of data and understanding their hidden relationships continues to be a research focus. The main challenges lie in effectively modeling the complex interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xuhao Shan , Ruiquan Ge , Jikui Liu , Linglong Wu , Chi Zhang , Siqi Liu , Wenjian Qin , Wenwen Min , Ahmed Elazab , Changmiao Wang

The essence of audio-visual segmentation (AVS) lies in locating and delineating sound-emitting objects within a video stream. While Transformer-based methods have shown promise, their handling of long-range dependencies struggles due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Sitong Gong , Yunzhi Zhuge , Lu Zhang , Yifan Wang , Pingping Zhang , Lijun Wang , Huchuan Lu

Accurate prediction of RNA-associated interactions is essential for understanding cellular regulation and advancing drug discovery. While Biological Large Language Models (BioLLMs) such as ESM-2 and RiNALMo provide powerful sequence…

Genomics · Quantitative Biology 2026-02-27 Rabeya Tus Sadia , Qiang Ye , Qiang Cheng

Multi-domain aspect-based sentiment analysis (ABSA) seeks to capture fine-grained sentiment across diverse domains. While existing research narrowly focuses on single-domain applications constrained by methodological limitations and data…

Computation and Language · Computer Science 2024-03-05 Songhua Yang , Xinke Jiang , Hanjie Zhao , Wenxuan Zeng , Hongde Liu , Yuxiang Jia

Numerous CNN-Transformer hybrid models rely on high-complexity global attention mechanisms to capture long-range dependencies, which introduces non-linear computational complexity and leads to significant resource consumption. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dayu Tan , Ziwei Zhang , Yansan Su , Xin Peng , Yike Dai , Chunhou Zheng , Weimin Zhong

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

Multimodal Emotion Recognition in Conversation (ERC) plays an influential role in the field of human-computer interaction and conversational robotics since it can motivate machines to provide empathetic services. Multimodal data modeling is…

Multimedia · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Affective Computing (AC) is essential for advancing Artificial General Intelligence (AGI), with emotion recognition serving as a key component. However, human emotions are inherently dynamic, influenced not only by an individual's…

Computation and Language · Computer Science 2025-03-31 Yupei Li , Qiyang Sun , Sunil Munthumoduku Krishna Murthy , Emran Alturki , Björn W. Schuller

Learning useful representations for continuous-time dynamic graphs (CTDGs) is challenging, due to the concurrent need to span long node interaction histories and grasp nuanced temporal details. In particular, two problems emerge: (1)…

Machine Learning · Computer Science 2025-06-09 Zifeng Ding , Yifeng Li , Yuan He , Antonio Norelli , Jingcheng Wu , Volker Tresp , Michael Bronstein , Yunpu Ma

Speech Emotion Recognition (SER) plays a critical role in enhancing user experience within human-computer interaction. However, existing methods are overwhelmed by temporal domain analysis, overlooking the valuable envelope structures of…

Sound · Computer Science 2024-12-24 Jiaqi Zhao , Fei Wang , Kun Li , Yanyan Wei , Shengeng Tang , Shu Zhao , Xiao Sun

Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yaohua Zha , Yanzi Wang , Hang Guo , Jinpeng Wang , Tao Dai , Bin Chen , Zhihao Ouyang , Xue Yuerong , Ke Chen , Shu-Tao Xia

Recent Transformer-based diffusion models have shown remarkable performance, largely attributed to the ability of the self-attention mechanism to accurately capture both global and local contexts by computing all-pair interactions among…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunxiang Fu , Chaoqi Chen , Yizhou Yu

Multimodal aspect-based sentiment analysis(MABSA) seeks to identify aspect terms within paired image-text data and determine their fine grained sentiment polarities, representing a fundamental task for improving the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xiaoqiang He

Recently Mamba-based methods have shown promise in abdominal organ segmentation. However, existing approaches neglect cross-channel anatomical semantic collaboration and lack explicit boundary-aware feature fusion mechanisms. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yuyang Zheng , Mingda Zhang , Jianglong Qin , Qi Mo , Jingdan Pan , Haozhe Hu , Hongyi Huang

Semantic segmentation of multi-source remote sensing images is a fundamental task for Earth observation applications. Existing methods often struggle with insufficient multi-scale context modeling and suboptimal cross-modal feature fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Feng Gao , Zhilin Jin , Yanhai Gan , Junyu Dong , Qian Du

Accurate traffic forecasting is crucial for intelligent transportation systems, supporting effective traffic management, congestion reduction, and informed urban planning. However, traditional models often fail to adequately capture the…

Artificial Intelligence · Computer Science 2026-04-21 Dongyi He , Yuanquan Gao , Bin Jiang , He Yan