English
Related papers

Related papers: Improved TDNNs using Deep Kernels and Frequency De…

200 papers

Kernels derived from deep neural networks (DNNs) in the infinite-width regime provide not only high performance in a range of machine learning tasks but also new theoretical insights into DNN training dynamics and generalization. In this…

Machine Learning · Computer Science 2021-10-22 Sina Alemohammad , Randall Balestriero , Zichao Wang , Richard Baraniuk

Convolutional Neural Networks (CNNs) excel at extracting local features hierarchically, but their performance in capturing complex correlations hinges heavily on deep architectures, which are usually computationally demanding and difficult…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Chia-Wei Hsing , Wei-Lin Tu

Recent studies in deep learning-based speech separation have proven the superiority of time-domain approaches to conventional time-frequency-based methods. Unlike the time-frequency domain approaches, the time-domain separation systems…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-30 Yi Luo , Zhuo Chen , Takuya Yoshioka

Nowadays, we mainly use various convolution neural network (CNN) structures to extract features from radio data or spectrogram in AMR. Based on expert experience and spectrograms, they not only increase the difficulty of preprocessing, but…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Miao Du , Qin Yu , Shaomin Fei , Chen Wang , Xiaofeng Gong , Ruisen Luo

Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs. Recurrent Neural Networks (RNNs) have the ability, in…

Neural and Evolutionary Computing · Computer Science 2014-02-17 Jan Koutník , Klaus Greff , Faustino Gomez , Jürgen Schmidhuber

This paper proposes a deep speech enhancement method which exploits the high potential of residual connections in a wide neural network architecture, a topology known as Wide Residual Network. This is supported on single dimensional…

Sound · Computer Science 2019-01-04 Dayana Ribas , Jorge Llombart , Antonio Miguel , Luis Vicente

This work focuses on designing low complexity hybrid tensor networks by considering trade-offs between the model complexity and practical performance. Firstly, we exploit a low-rank tensor-train deep neural network (TT-DNN) to build an…

Machine Learning · Computer Science 2022-03-14 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Javier Tejedor

Long-term time series forecasting is a vital task and has a wide range of real applications. Recent methods focus on capturing the underlying patterns from one single domain (e.g. the time domain or the frequency domain), and have not taken…

Machine Learning · Computer Science 2023-08-28 Yuxiao Luo , Ziyu Lyu , Xingyu Huang

In this work, we investigate the value of employing deep learning for the task of wireless signal modulation recognition. Recently in [1], a framework has been introduced by generating a dataset using GNU radio that mimics the imperfections…

Machine Learning · Computer Science 2018-01-08 Xiaoyu Liu , Diyu Yang , Aly El Gamal

In recent decades, neural network based methods have significantly improved the performace of speech enhancement. Most of them estimate time-frequency (T-F) representation of target speech directly or indirectly, then resynthesize waveform…

Sound · Computer Science 2020-02-06 Jingdong Li , Hui Zhang , Xueliang Zhang , Changliang Li

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

Computation and Language · Computer Science 2016-10-12 Xiangang Li , Xihong Wu

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Convolutional neural networks (CNN) have improved speech recognition performance greatly by exploiting localized time-frequency patterns. But these patterns are assumed to appear in symmetric and rigid kernels by the conventional CNN…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-19 Jiamin Xie , John H. L. Hansen

Recent advances in self-supervised learning (SSL) on Transformers have significantly improved speaker verification (SV) by providing domain-general speech representations. However, existing approaches have underutilized the multi-layered…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-16 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Juan Yun , Sung Won Han

The most recent deep neural network (DNN) models exhibit impressive denoising performance in the time-frequency (T-F) magnitude domain. However, the phase is also a critical component of the speech signal that is easily overlooked. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-10 Lu Zhang , Mingjiang Wang , Zehua Zhang , Xuyi Zhuang

Deep learning based single-channel speech enhancement tries to train a neural network model for the prediction of clean speech signal. There are a variety of popular network structures for single-channel speech enhancement, such as TCNN,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Xupeng Jia , Dongmei Li

Recently deep neural networks (DNNs) have been used to learn speaker features. However, the quality of the learned features is not sufficiently good, so a complex back-end model, either neural or probabilistic, has to be used to address the…

Sound · Computer Science 2017-05-11 Lantian Li , Yixiang Chen , Ying Shi , Zhiyuan Tang , Dong Wang

Channel Coding has been one of the central disciplines driving the success stories of current generation LTE systems and beyond. In particular, turbo codes are mostly used for cellular and other applications where a reliable data transfer…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Raja Sattiraju , Andreas Weinand , Hans D. Schotten

Convolutional Neural Networks (CNNs) are effective models for reducing spectral variations and modeling spectral correlations in acoustic features for automatic speech recognition (ASR). Hybrid speech recognition systems incorporating CNNs…

Computation and Language · Computer Science 2017-01-11 Ying Zhang , Mohammad Pezeshki , Philemon Brakel , Saizheng Zhang , Cesar Laurent Yoshua Bengio , Aaron Courville

We propose a tensor-to-vector regression approach to multi-channel speech enhancement in order to address the issue of input size explosion and hidden-layer size expansion. The key idea is to cast the conventional deep neural network (DNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-04 Jun Qi , Hu Hu , Yannan Wang , Chao-Han Huck Yang , Sabato Marco Siniscalchi , Chin-Hui Lee