English
Related papers

Related papers: TinyLSTMs: Efficient Neural Speech Enhancement for…

200 papers

Most current speech enhancement models use spectrogram features that require an expensive transformation and result in phase information loss. Previous work has overcome these issues by using convolutional networks to learn long-range…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-17 Jalal Abdulbaqi , Yue Gu , Ivan Marsic

As Deep Neural Networks (DNNs) rapidly advance in various fields, including speech verification, they typically involve high computational costs and substantial memory consumption, which can be challenging to manage on mobile systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Yeona Hong , Woo-Jin Chung , Hong-Goo Kang

Recently, progressive learning has shown its capacity to improve speech quality and speech intelligibility when it is combined with deep neural network (DNN) and long short-term memory (LSTM) based monaural speech enhancement algorithms,…

Sound · Computer Science 2020-01-14 Andong Li , Minmin Yuan , Chengshi Zheng , Xiaodong Li

Many of the current state-of-the-art Large Vocabulary Continuous Speech Recognition Systems (LVCSR) are hybrids of neural networks and Hidden Markov Models (HMMs). Most of these systems contain separate components that deal with the…

Computation and Language · Computer Science 2016-03-16 Dzmitry Bahdanau , Jan Chorowski , Dmitriy Serdyuk , Philemon Brakel , Yoshua Bengio

The increasing size and complexity of Large Language Models (LLMs) pose challenges for their deployment on personal computers and mobile devices. Aggressive post-training model compression is necessary to reduce the models' size, but it…

Computation and Language · Computer Science 2024-10-01 Zining Zhang , Yao Chen , Bingsheng He , Zhenjie Zhang

The significant computational costs of deploying neural networks in large-scale or resource constrained environments, such as data centers and mobile devices, has spurred interest in model compression, which can achieve a reduction in both…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Jonathan A. Cox

Deep learning approaches have demonstrated success in modeling analog audio effects. Nevertheless, challenges remain in modeling more complex effects that involve time-varying nonlinear elements, such as dynamic range compressors. Existing…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-18 Christian J. Steinmetz , Joshua D. Reiss

Robustness against noise is critical for keyword spotting (KWS) in real-world environments. To improve the robustness, a speech enhancement front-end is involved. Instead of treating the speech enhancement as a separated preprocessing…

Sound · Computer Science 2019-06-21 Yue Gu , Zhihao Du , Hui Zhang , Xueliang Zhang

Deep neural network based full-band speech enhancement systems face challenges of high demand of computational resources and imbalanced frequency distribution. In this paper, a light-weight full-band model is proposed with two dedicated…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-05 Qinwen Hu , Zhongshu Hou , Xiaohuai Le , Jing Lu

While Transformer has become the de-facto standard for speech, modeling upon the fine-grained frame-level features remains an open challenge of capturing long-distance dependencies and distributing the attention weights. We propose…

Computation and Language · Computer Science 2023-05-30 Chen Xu , Yuhao Zhang , Chengbo Jiao , Xiaoqian Liu , Chi Hu , Xin Zeng , Tong Xiao , Anxiang Ma , Huizhen Wang , JingBo Zhu

Speech enhancement algorithms based on deep learning have greatly surpassed their traditional counterparts and are now being considered for the task of removing acoustic echo from hands-free communication systems. This is a challenging…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Jean-Marc Valin , Srikanth Tenneti , Karim Helwani , Umut Isik , Arvindh Krishnaswamy

Sound processing in the human auditory system is complex and highly non-linear, whereas hearing aids (HAs) still rely on simplified descriptions of auditory processing or hearing loss to restore hearing. Even though standard HA…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Fotios Drakopoulos , Sarah Verhulst

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

Machine Learning · Computer Science 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

Modern Neural Networks are eminent in achieving state of the art performance on tasks under Computer Vision, Natural Language Processing and related verticals. However, they are notorious for their voracious memory and compute appetite…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Harshit Rampal , Aman Mohanty

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-10-04 Viktoriya Krakovna , Finale Doshi-Velez

Recurrent neural networks (RNNs) are a powerful model for sequential data. End-to-end training methods such as Connectionist Temporal Classification make it possible to train RNNs for sequence labelling problems where the input-output…

Neural and Evolutionary Computing · Computer Science 2013-03-26 Alex Graves , Abdel-rahman Mohamed , Geoffrey Hinton

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

Machine Learning · Computer Science 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

In recent years, the introduction of neural networks (NNs) into the field of speech enhancement has brought significant improvements. However, many of the proposed methods are quite demanding in terms of computational complexity and memory…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-19 Ernst Seidel , Pejman Mowlaee , Tim Fingscheidt

As they become more capable, large language models (LLMs) have continued to rapidly increase in size. This has exacerbated the difficulty in running state of the art LLMs on small, edge devices. Standard techniques advocate solving this…

Recurrent Neural Networks (RNNs) are powerful tools for solving sequence-based problems, but their efficacy and execution time are dependent on the size of the network. Following recent work in simplifying these networks with model pruning…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Feiwen Zhu , Jeff Pool , Michael Andersch , Jeremy Appleyard , Fung Xie
‹ Prev 1 3 4 5 6 7 10 Next ›