English
Related papers

Related papers: Multi-Scale Time-Frequency Attention for Acoustic …

200 papers

Non-parallel training is a difficult but essential task for DNN-based speech enhancement methods, for the lack of adequate noisy and paired clean speech corpus in many real scenarios. In this paper, we propose a novel adaptive…

Sound · Computer Science 2021-09-15 Guochen Yu , Yutian Wang , Chengshi Zheng , Hui Wang , Qin Zhang

Auditory spatial attention detection (ASAD) is used to determine the direction of a listener's attention to a speaker by analyzing her/his electroencephalographic (EEG) signals. This study aimed to further improve the performance of ASAD…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Yuting Ding , Fei Chen

Sound Event Localization and Detection (SELD) involves detecting and localizing sound events using multichannel sound recordings. Previously proposed Event-Independent Network V2 (EINV2) has achieved outstanding performance on SELD.…

Sound · Computer Science 2024-06-18 Da Mu , Zhicheng Zhang , Haobo Yue

Large language models reveal deep comprehension and fluent generation in the field of multi-modality. Although significant advancements have been achieved in audio multi-modality, existing methods are rarely leverage language model for…

Sound · Computer Science 2024-08-06 Hualei Wang , Jianguo Mao , Zhifang Guo , Jiarui Wan , Hong Liu , Xiangdong Wang

Machine comprehension (MC), answering a query about a given context paragraph, requires modeling complex interactions between the context and the query. Recently, attention mechanisms have been successfully extended to MC. Typically these…

Computation and Language · Computer Science 2018-06-22 Minjoon Seo , Aniruddha Kembhavi , Ali Farhadi , Hannaneh Hajishirzi

Audio Event Recognition (AER) traditionally focuses on detecting and identifying audio events. Most existing AER models tend to detect all potential events without considering their varying significance across different contexts. This makes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Yizhou Tan , Yanru Wu , Yuanbo Hou , Xin Xu , Hui Bu , Shengchen Li , Dick Botteldooren , Mark D. Plumbley

Marked Temporal Point Processes (MTPPs) arise naturally in medical, social, commercial, and financial domains. However, existing Transformer-based methods mostly inject temporal information only via positional encodings, relying on shared…

Machine Learning · Computer Science 2026-03-25 Xinzi Tan , Kejian Zhang , Junhan Yu , Doudou Zhou

Classroom activity detection (CAD) focuses on accurately classifying whether the teacher or student is speaking and recording both the length of individual utterances during a class. A CAD solution helps teachers get instant feedback on…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-12 Hang Li , Yu Kang , Wenbiao Ding , Song Yang , Songfan Yang , Gale Yan Huang , Zitao Liu

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin

The Dual-Path Convolution Recurrent Network (DPCRN) was proposed to effectively exploit time-frequency domain information. By combining the DPRNN module with Convolution Recurrent Network (CRN), the DPCRN obtained a promising performance in…

Sound · Computer Science 2023-06-16 Liang Wan , Hongqing Liu , Yi Zhou , Jie Ji

The major challenge in audio-visual event localization task lies in how to fuse information from multiple modalities effectively. Recent works have shown that attention mechanism is beneficial to the fusion process. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Bin Duan , Hao Tang , Wei Wang , Ziliang Zong , Guowei Yang , Yan Yan

Channel attention mechanisms endeavor to recalibrate channel weights to enhance representation abilities of networks. However, mainstream methods often rely solely on global average pooling as the feature squeezer, which significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yangbo Jiang , Zhiwei Jiang , Le Han , Zenan Huang , Nenggan Zheng

Continuous, long-term monitoring of hazardous, noxious, explosive, and flammable gases in industrial environments using electronic nose (E-nose) systems faces the significant challenge of reduced gas identification accuracy due to…

Signal Processing · Electrical Eng. & Systems 2024-09-23 Wenwen Zhang , Shuhao Hu , Zhengyuan Zhang , Yuanjin Zheng , Qi Jie Wang , Zhiping Lin

Multimodal sensors provide complementary information to develop accurate machine-learning methods for human activity recognition (HAR), but introduce significantly higher computational load, which reduces efficiency. This paper proposes an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Ziqi Gao , Yuntao Wang , Jianguo Chen , Junliang Xing , Shwetak Patel , Xin Liu , Yuanchun Shi

Deep learning-based sound event localization and classification is an emerging research area within wireless acoustic sensor networks. However, current methods for sound event localization and classification typically rely on a single…

Detecting anomalies in real-world multivariate time series data is challenging due to complex temporal dependencies and inter-variable correlations. Recently, reconstruction-based deep models have been widely used to solve the problem.…

Machine Learning · Computer Science 2023-12-06 Junho Song , Keonwoo Kim , Jeonglyul Oh , Sungzoon Cho

Due to the successful development of deep image generation technology, visual data forgery detection would play a more important role in social and economic security. Existing forgery detection methods suffer from unsatisfactory…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Decheng Liu , Tao Chen , Chunlei Peng , Nannan Wang , Ruimin Hu , Xinbo Gao

Detection of atrial fibrillation (AF), a type of cardiac arrhythmia, is difficult since many cases of AF are usually clinically silent and undiagnosed. In particular paroxysmal AF is a form of AF that occurs occasionally, and has a higher…

Neurons and Cognition · Quantitative Biology 2018-05-24 Supreeth P. Shashikumar , Amit J. Shah , Gari D. Clifford , Shamim Nemati

Acoustic Echo Cancellation (AEC) plays a key role in speech interaction by suppressing the echo received at microphone introduced by acoustic reverberations from loudspeakers. Since the performance of linear adaptive filter (AF) would…

Sound · Computer Science 2021-06-02 Lu Ma , Song Yang , Yaguang Gong , Zhongqin Wu

Sound event detection (SED) is one of tasks to automate function by human auditory system which listens and understands auditory scenes. Therefore, we were inspired to make SED recognize sound events in the way human auditory system does.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Deokki Min , Hyeonuk Nam , Yong-Hwa Park