English
Related papers

Related papers: Temporal-Frequency State Space Duality: An Efficie…

200 papers

This paper introduces scattering transform for speech emotion recognition (SER). Scattering transform generates feature representations which remain stable to deformations and shifting in time and frequency without much loss of information.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-12 Premjeet Singh , Goutam Saha , Md Sahidullah

Speech emotion recognition systems have high prediction latency because of the high computational requirements for deep learning models and low generalizability mainly because of the poor reliability of emotional measurements across…

Sound · Computer Science 2023-02-23 Abdul Rehman , Zhen-Tao Liu , Min Wu , Wei-Hua Cao , Cheng-Shan Jiang

The continuous evolution of pre-trained speech models has greatly advanced Speech Emotion Recognition (SER). However, current research typically relies on utterance-level emotion labels, inadequately capturing the complexity of emotions…

Sound · Computer Science 2024-09-24 Yu Pan , Yuguang Yang , Heng Lu , Lei Ma , Jianjun Zhao

In recent years, speech emotion recognition (SER) has been used in wide ranging applications, from healthcare to the commercial sector. In addition to signal processing approaches, methods for SER now also use deep learning techniques.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Sneha Das , Nicole Nadine Lønfeldt , Anne Katrine Pagsberg , Line H. Clemmensen

Traffic flow prediction, a critical aspect of intelligent transportation systems, has been increasingly popular in the field of artificial intelligence, driven by the availability of extensive traffic data. The current challenges of traffic…

Machine Learning · Computer Science 2024-05-21 Zhiqi Shao , Michael G. H. Bell , Ze Wang , D. Glenn Geers , Haoning Xi , Junbin Gao

Whispered speech recognition presents significant challenges for conventional automatic speech recognition systems, particularly when combined with dialect variation. However, utilizing an efficient method to solve this problem using a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Aref Farhadipour , Homayoon Beigi , Volker Dellwo , Hadi Veisi

The wide deployment of speech-based biometric systems usually demands high-performance speaker recognition algorithms. However, most of the prior works for speaker recognition either process the speech in the frequency domain or time…

Sound · Computer Science 2023-03-08 Jiguo Li , Tianzi Zhang , Xiaobin Liu , Lirong Zheng

Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this…

Sound · Computer Science 2022-03-30 Heqing Zou , Yuke Si , Chen Chen , Deepu Rajan , Eng Siong Chng

Robustness against temporal variations is important for emotion recognition from speech audio, since emotion is ex-pressed through complex spectral patterns that can exhibit significant local dilation and compression on the time axis…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Eric Guizzo , Tillman Weyde , Jack Barnett Leveson

Speech emotion recognition is crucial in human-computer interaction, but extracting and using emotional cues from audio poses challenges. This paper introduces MFHCA, a novel method for Speech Emotion Recognition using Multi-Spatial Fusion…

Sound · Computer Science 2024-04-23 Xinxin Jiao , Liejun Wang , Yinfeng Yu

Mamba has recently emerged as a promising alternative to Transformers, offering near-linear complexity in processing sequential data. However, while channels in time series (TS) data have no specific order in general, recent studies have…

Machine Learning · Computer Science 2024-11-01 Seunghan Lee , Juri Hong , Kibok Lee , Taeyoung Park

Deep learning models like Convolutional Neural Networks and transformers have shown impressive capabilities in speech verification, gaining considerable attention in the research community. However, CNN-based approaches struggle with…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-17 Yang Liu , Li Wan , Yiteng Huang , Ming Sun , Yangyang Shi , Florian Metze

Deep learning techniques have revolutionized the infrared and visible image fusion (IVIF), showing remarkable efficacy on complex scenarios. However, current methods do not fully combine frequency domain features with global semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tianpei Zhang , Yiming Zhu , Jufeng Zhao , Guangmang Cui , Yuchen Zheng

Atmospheric turbulence is a major source of image degradation in long-range imaging systems. Although numerous deep learning-based turbulence mitigation (TM) methods have been proposed, many are slow, memory-hungry, and do not generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Xingguang Zhang , Nicholas Chimitt , Xijun Wang , Yu Yuan , Stanley H. Chan

Temporal Action Detection (TAD) in untrimmed videos poses significant challenges, particularly for Activities of Daily Living (ADL) requiring models to (1) process long-duration videos, (2) capture temporal variations in actions, and (3)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Arkaprava Sinha , Monish Soundar Raj , Pu Wang , Ahmed Helmy , Hieu Le , Srijan Das

Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition. TSC tasks require models to effectively capture discriminative information for…

Machine Learning · Computer Science 2025-12-10 Da Zhang , Bingyu Li , Zhiyuan Zhao , Yanhan Zhang , Junyu Gao , Feiping Nie , Xuelong Li

Recent years have seen a surge in the number of available frameworks for speech enhancement (SE) and recognition. Whether model-based or constructed via deep learning, these frameworks often rely in isolation on either time-domain signals…

Sound · Computer Science 2021-06-01 Sherif Abdulatif , Karim Armanious , Jayasankar T. Sajeev , Karim Guirguis , Bin Yang

Time series data plays a pivotal role in a wide variety of fields but faces challenges related to privacy concerns. Recently, synthesizing data via diffusion models is viewed as a promising solution. However, existing methods still struggle…

Machine Learning · Computer Science 2025-11-25 Zihao Yao , Jiankai Zuo , Yaying Zhang

We investigate the performance of features that can capture nonlinear recurrence dynamics embedded in the speech signal for the task of Speech Emotion Recognition (SER). Reconstruction of the phase space of each speech frame and the…

Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models. This need arises from the high sampling rate of EEG data and the long recording durations required to capture extended…

Machine Learning · Computer Science 2025-11-25 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane