中文
相关论文

相关论文: Temporal-Frequency State Space Duality: An Efficie…

200 篇论文

Transformers have been the most successful architecture for various speech modeling tasks, including speech separation. However, the self-attention mechanism in transformers with quadratic complexity is inefficient in computation and…

音频与语音处理 · 电气工程与系统科学 2024-05-02 Xilin Jiang , Cong Han , Nima Mesgarani

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

音频与语音处理 · 电气工程与系统科学 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

In multivariate time-series forecasting (MTSF), extracting the temporal correlations of the input sequences is crucial. While popular Transformer-based predictive models can perform well, their quadratic computational complexity results in…

机器学习 · 计算机科学 2024-07-23 Shusen Ma , Yu Kang , Peng Bai , Yun-Bo Zhao

In this paper, a novel two-branch neural network model structure is proposed for multimodal emotion recognition, which consists of a time synchronous branch (TSB) and a time asynchronous branch (TAB). To capture correlations between each…

计算与语言 · 计算机科学 2021-07-23 Wen Wu , Chao Zhang , Philip C. Woodland

Tooth segmentation is a pivotal step in modern digital dentistry, essential for applications across orthodontic diagnosis and treatment planning. Despite its importance, this process is fraught with challenges due to the high noise and low…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Jing Hao , Yonghui Zhu , Lei He , Moyun Liu , James Kit Hon Tsoi , Kuo Feng Hung

Multimodal sentiment analysis (MSA) is a research field that recognizes human sentiments by combining textual, visual, and audio modalities. The main challenge lies in integrating sentiment-related information from different modalities,…

多媒体 · 计算机科学 2025-12-02 Heng Xie , Kang Zhu , Zhengqi Wen , Jianhua Tao , Xuefei Liu , Ruibo Fu , Changsheng Li

Convolutional neural networks have primarily led 3D medical image segmentation but may be limited by small receptive fields. Transformer models excel in capturing global relationships through self-attention but are challenged by high…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Ao Chang , Jiajun Zeng , Ruobing Huang , Dong Ni

In the Sound Event Localization and Detection (SELD) task, Transformer-based models have demonstrated impressive capabilities. However, the quadratic complexity of the Transformer's self-attention mechanism results in computational…

声音 · 计算机科学 2024-08-12 Da Mu , Zhicheng Zhang , Haobo Yue , Zehao Wang , Jin Tang , Jianqin Yin

Speech Emotion Recognition (SER) is an important research topic in human-computer interaction. Many recent works focus on directly extracting emotional cues through pre-trained knowledge, frequently overlooking considerations of…

音频与语音处理 · 电气工程与系统科学 2024-06-27 Haiyang Sun , Fulin Zhang , Yingying Gao , Zheng Lian , Shilei Zhang , Junlan Feng

Motor imagery (MI) classification is key for brain-computer interfaces (BCIs). Until recent years, numerous models had been proposed, ranging from classical algorithms like Common Spatial Pattern (CSP) to deep learning models such as…

人机交互 · 计算机科学 2024-09-20 Xiaoxiao Yang , Ziyu Jia

Automatic speech emotion recognition (SER) by a computer is a critical component for more natural human-machine interaction. As in human-human interaction, the capability to perceive emotion correctly is essential to take further steps in a…

声音 · 计算机科学 2022-10-27 Bagus Tris Atmaja , Masato Akagi

Speech emotion recognition (SER) is an important technology in human-computer interaction. However, achieving high performance is challenging due to emotional complexity and scarce annotated data. To tackle these challenges, we propose a…

声音 · 计算机科学 2026-03-06 Cong Wang , Yizhong Geng , Yuhua Wen , Qifei Li , Yingming Gao , Ruimin Wang , Chunfeng Wang , Hao Li , Ya Li , Wei Chen

The practical utility of Speech Emotion Recognition (SER) systems is undermined by their fragility to domain shifts, such as speaker variability, the distinction between acted and naturalistic emotions, and cross-corpus variations. While…

音频与语音处理 · 电气工程与系统科学 2026-01-26 Jiaheng Dong , Hong Jia , Ting Dang

Affective computing is very important in the relationship between man and machine. In this paper, a system for speech emotion recognition (SER) based on speech signal is proposed, which uses new techniques in different stages of processing.…

声音 · 计算机科学 2021-11-16 Fatemeh Daneshfar , Seyed Jahanshah Kabudian

We propose ss-Mamba, a novel foundation model that enhances time series forecasting by integrating semantic-aware embeddings and adaptive spline-based temporal encoding within a selective state-space modeling framework. Building upon the…

机器学习 · 计算机科学 2025-06-19 Zuochen Ye

Fine-grained emotion recognition (FER) plays a vital role in various fields, such as disease diagnosis, personalized recommendations, and multimedia mining. However, existing FER methods face three key challenges in real-world applications:…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Jingyao Wang , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Micro-expressions (MEs) are brief, involuntary facial movements that reveal genuine emotions, offering valuable insights for psychological assessment and criminal investigations. Despite significant progress in automatic ME recognition…

人机交互 · 计算机科学 2025-08-06 Xinglong Mao , Shifeng Liu , Sirui Zhao , Tong Xu , Hanchao Wang , Baozhi Jia , Enhong Chen

Speech emotion recognition is crucial to human-computer interaction. The temporal regions that represent different emotions scatter in different parts of the speech locally. Moreover, the temporal scales of important information may vary…

声音 · 计算机科学 2023-03-06 Shuaiqi Chen , Xiaofen Xing , Weibin Zhang , Weidong Chen , Xiangmin Xu

Multimodal Sentiment Analysis (MSA) requires effective modeling of cross-modal interactions and contextual dependencies while remaining computationally efficient. Existing fusion approaches predominantly rely on Transformer-based…

计算与语言 · 计算机科学 2026-04-07 Minghai Jiao , Jing Xiao , Peng Xiao , Ende Zhang , Shuang Kan , Wenyan Jiang , Jinyao Li , Yixian Liu , Haidong Xin

The emergence of Mamba as an alternative to attention-based architectures has led to the development of Mamba-based self-supervised learning (SSL) pre-trained models (PTMs) for speech and audio processing. Recent studies suggest that these…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Orchid Chetia Phukan , Mohd Mujtaba Akhtar , Girish , Swarup Ranjan Behera , Jaya Sai Kiran Patibandla , Arun Balaji Buduru , Rajesh Sharma