中文
相关论文

相关论文: Tensor-Train Long Short-Term Memory for Monaural S…

200 篇论文

This paper introduces a dual-signal transformation LSTM network (DTLN) for real-time speech enhancement as part of the Deep Noise Suppression Challenge (DNS-Challenge). This approach combines a short-time Fourier transform (STFT) and a…

音频与语音处理 · 电气工程与系统科学 2020-10-23 Nils L. Westhausen , Bernd T. Meyer

This paper develops a model that addresses sentence embedding, a hot topic in current natural language processing research, using recurrent neural networks with Long Short-Term Memory (LSTM) cells. Due to its ability to capture long term…

计算与语言 · 计算机科学 2016-11-18 Hamid Palangi , Li Deng , Yelong Shen , Jianfeng Gao , Xiaodong He , Jianshu Chen , Xinying Song , Rabab Ward

Large-scale transformer models have shown remarkable performance in language modelling tasks. However, such models feature billions of parameters, leading to difficulties in their deployment and prohibitive training costs from scratch. To…

人工智能 · 计算机科学 2023-06-06 Viktoriia Chekalina , Georgii Novikov , Julia Gusak , Ivan Oseledets , Alexander Panchenko

The deep neural network (DNN) based speech enhancement approaches have achieved promising performance. However, the number of parameters involved in these methods is usually enormous for the real applications of speech enhancement on the…

声音 · 计算机科学 2020-10-13 Xingwei Sun , Ze-Feng Gao , Zhong-Yi Lu , Junfeng Li , Yonghong Yan

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing (NLP) tasks, such as question-answering, sentiment analysis, text summarization, and machine…

机器学习 · 计算机科学 2024-08-05 Afia Anjum , Maksim E. Eren , Ismael Boureima , Boian Alexandrov , Manish Bhattarai

Terrain classification is a critical component of any autonomous mobile robot system operating in unknown real-world environments. Over the years, several proprioceptive terrain classification techniques have been introduced to increase…

机器人学 · 计算机科学 2018-04-04 Abhinav Valada , Wolfram Burgard

Long short-term memory (LSTM) is a type of powerful deep neural network that has been widely used in many sequence analysis and modeling applications. However, the large model size problem of LSTM networks make their practical deployment…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Yu Gong , Miao Yin , Lingyi Huang , Chunhua Deng , Yang Sui , Bo Yuan

The emergence of Long Short-Term Memory (LSTM) solves the problems of vanishing gradient and exploding gradient in traditional Recurrent Neural Networks (RNN). LSTM, as a new type of RNN, has been widely used in various fields, such as text…

机器学习 · 计算机科学 2022-10-18 Sida Xing , Feihu Han , Suiyang Khoo

To date, mainstream target speech separation (TSS) approaches are formulated to estimate the complex ratio mask (cRM) of the target speech in time-frequency domain under supervised deep learning framework. However, the existing deep models…

声音 · 计算机科学 2021-09-08 Rongzhi Gu , Shi-Xiong Zhang , Yuexian Zou , Dong Yu

High-quality and intelligible speech is essential to text-to-speech (TTS) model training, however, obtaining high-quality data for low-resource languages is challenging and expensive. Applying speech enhancement on Automatic Speech…

音频与语音处理 · 电气工程与系统科学 2023-09-20 Zhaoheng Ni , Sravya Popuri , Ning Dong , Kohei Saijo , Xiaohui Zhang , Gael Le Lan , Yangyang Shi , Vikas Chandra , Changhan Wang

State-of-the-art language models (LMs) represented by long-short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming increasingly complex and expensive for practical applications. Low-bit neural network…

计算与语言 · 计算机科学 2021-12-22 Junhao Xu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

Long short-term memory (LSTM) has been widely used for sequential data modeling. Researchers have increased LSTM depth by stacking LSTM cells to improve performance. This incurs model redundancy, increases run-time delay, and makes the…

机器学习 · 计算机科学 2018-06-01 Xiaoliang Dai , Hongxu Yin , Niraj K. Jha

Recent works have shown that Deep Recurrent Neural Networks using the LSTM architecture can achieve strong single-channel speech enhancement by estimating time-frequency masks. However, these models do not naturally generalize to…

声音 · 计算机科学 2020-12-04 Felix Grezes , Zhaoheng Ni , Viet Anh Trinh , Michael Mandel

High-dimensional token embeddings underpin Large Language Models (LLMs), as they can capture subtle semantic information and significantly enhance the modelling of complex language patterns. However, this high dimensionality also introduces…

计算与语言 · 计算机科学 2024-10-07 Mingxue Xu , Yao Lei Xu , Danilo P. Mandic

Recurrent neural networks (RNNs) have shown excellent performance in processing sequence data. However, they are both complex and memory intensive due to their recursive nature. These limitations make RNNs difficult to embed on mobile…

机器学习 · 计算机科学 2019-01-28 Arash Ardakani , Zhengyun Ji , Sean C. Smithson , Brett H. Meyer , Warren J. Gross

Speech intelligibility can be degraded due to multiple factors, such as noisy environments, technical difficulties or biological conditions. This work is focused on the development of an automatic non-intrusive system for predicting the…

音频与语音处理 · 电气工程与系统科学 2024-02-07 Miguel Fernández-Díaz , Ascensión Gallardo-Antolín

We propose a neural network-based speech enhancement (SE) method called the phase-aware recurrent two stage network (rTSN). The rTSN is an extension of our previously proposed two stage network (TSN) framework. This TSN framework was…

音频与语音处理 · 电气工程与系统科学 2020-01-28 Juntae Kim , Jaesung Bae

Nowadays, there is a strong need to deploy the target speaker separation (TSS) model on mobile devices with a limitation of the model size and computational complexity. To better perform TSS for mobile voice communication, we first make a…

声音 · 计算机科学 2021-06-08 Yuanyuan Bao , Yanze Xu , Na Xu , Wenjing Yang , Hongfeng Li , Shicong Li , Yongtao Jia , Fei Xiang , Jincheng He , Ming Li

Despite the significant progress in automatic speech recognition (ASR), distant ASR remains challenging due to noise and reverberation. A common approach to mitigate this issue consists of equipping the recording devices with multiple…

音频与语音处理 · 电气工程与系统科学 2020-05-20 Xinchi Qiu , Titouan Parcollet , Mirco Ravanelli , Nicholas Lane , Mohamed Morchid

We have shown previously that our parameter-reduced variants of Long Short-Term Memory (LSTM) Recurrent Neural Networks (RNN) are comparable in performance to the standard LSTM RNN on the MNIST dataset. In this study, we show that this is…

神经与进化计算 · 计算机科学 2019-01-23 Atra Akandeh , Fathi M. Salem