English
Related papers

Related papers: Multi-path RNN for hierarchical modeling of long s…

200 papers

Deep neural networks (DNNs) are very effective for multichannel speech enhancement with fixed array geometries. However, it is not trivial to use DNNs for ad-hoc arrays with unknown order and placement of microphones. We propose a novel…

Sound · Computer Science 2022-07-06 Ashutosh Pandey , Buye Xu , Anurag Kumar , Jacob Donley , Paul Calamia , DeLiang Wang

Employing deep neural networks (DNNs) to directly learn filters for multi-channel speech enhancement has potentially two key advantages over a traditional approach combining a linear spatial filter with an independent tempo-spectral…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-23 Kristina Tesch , Nils-Hendrik Mohrmann , Timo Gerkmann

Advancements in parallel processing have lead to a surge in multilayer perceptrons' (MLP) applications and deep learning in the past decades. Recurrent Neural Networks (RNNs) give additional representational power to feedforward MLPs by…

Machine Learning · Statistics 2014-10-22 Saahil Ognawala , Justin Bayer

This study proposes two straightforward yet effective approaches to reduce the required computational time of the training process for time-series modeling through a recurrent neural network (RNN) using multi-time-scale time-series data as…

Atmospheric and Oceanic Physics · Physics 2021-11-11 Kei Ishida , Masato Kiyama , Ali Ercan , Motoki Amagasaki , Tongbi Tu

Real-world sequential signals, such as audio or video, contain critical information that is often embedded within long periods of silence or noise. While recurrent neural networks (RNNs) are designed to process such data efficiently, they…

Machine Learning · Computer Science 2026-05-01 Bojian Yin , Shurong Wang , Haoyu Tan , Sander Bohte , Federico Corradi , Guoqi Li

Multiple moving sound source localization in real-world scenarios remains a challenging issue due to interaction between sources, time-varying trajectories, distorted spatial cues, etc. In this work, we propose to use deep learning…

Sound · Computer Science 2022-02-17 Bing Yang , Hong Liu , Xiaofei Li

We propose TF-GridNet for speech separation. The model is a novel deep neural network (DNN) integrating full- and sub-band modeling in the time-frequency (T-F) domain. It stacks several blocks, each consisting of an intra-frame full-band…

A key attribute that drives the unprecedented success of modern Recurrent Neural Networks (RNNs) on learning tasks which involve sequential data, is their ability to model intricate long-term temporal dependencies. However, a well…

Machine Learning · Computer Science 2018-06-07 Yoav Levine , Or Sharir , Alon Ziv , Amnon Shashua

Recurrent neural networks (RNNs) are a powerful model for sequential data. End-to-end training methods such as Connectionist Temporal Classification make it possible to train RNNs for sequence labelling problems where the input-output…

Neural and Evolutionary Computing · Computer Science 2013-03-26 Alex Graves , Abdel-rahman Mohamed , Geoffrey Hinton

In a multi-channel separation task with multiple speakers, we aim to recover all individual speech signals from the mixture. In contrast to single-channel approaches, which rely on the different spectro-temporal characteristics of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-11 Kristina Tesch , Timo Gerkmann

The time delay neural network (TDNN) represents one of the state-of-the-art of neural solutions to text-independent speaker verification. However, they require a large number of filters to capture the speaker characteristics at any local…

Sound · Computer Science 2022-02-16 Tianchi Liu , Rohan Kumar Das , Kong Aik Lee , Haizhou Li

Traditional Feed-Forward Neural Networks (FFNN) and one-dimensional Convolutional Neural Networks (1D CNN) often encounter difficulties when dealing with long, columnar datasets that contain numerous features. The challenge arises from two…

Machine Learning · Computer Science 2024-11-12 Ayoub Jadouli , Chaker El Amrani

Processing sequential data of variable length is a major challenge in a wide range of applications, such as speech recognition, language modeling, generative image modeling and machine translation. Here, we address this challenge by…

Neural and Evolutionary Computing · Computer Science 2017-06-13 Asier Mujika , Florian Meier , Angelika Steger

Recurrent Neural Networks (RNNs) continue to show outstanding performance in sequence modeling tasks. However, training RNNs on long sequences often face challenges like slow inference, vanishing gradients and difficulty in capturing long…

Artificial Intelligence · Computer Science 2018-02-06 Victor Campos , Brendan Jou , Xavier Giro-i-Nieto , Jordi Torres , Shih-Fu Chang

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

Machine Learning · Computer Science 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

In this paper, we consider the scene parsing problem and propose a novel Multi-Path Feedback recurrent neural network (MPF-RNN) for parsing scene images. MPF-RNN can enhance the capability of RNNs in modeling long-range context information…

Computer Vision and Pattern Recognition · Computer Science 2016-11-23 Xiaojie Jin , Yunpeng Chen , Jiashi Feng , Zequn Jie , Shuicheng Yan

In this paper, we present a multimodal Recurrent Neural Network (m-RNN) model for generating novel sentence descriptions to explain the content of images. It directly models the probability distribution of generating a word given previous…

Computer Vision and Pattern Recognition · Computer Science 2014-10-07 Junhua Mao , Wei Xu , Yi Yang , Jiang Wang , Alan L. Yuille

Recently, our proposed recurrent neural network (RNN) based all deep learning minimum variance distortionless response (ADL-MVDR) beamformer method yielded superior performance over the conventional MVDR by replacing the matrix inversion…

Sound · Computer Science 2021-04-27 Xiyun Li , Yong Xu , Meng Yu , Shi-Xiong Zhang , Jiaming Xu , Bo Xu , Dong Yu

Time delay neural networks (TDNNs) are an effective acoustic model for large vocabulary speech recognition. The strength of the model can be attributed to its ability to effectively model long temporal contexts. However, current TDNN models…

Computation and Language · Computer Science 2018-02-21 Florian Kreyssig , Chao Zhang , Philip Woodland

In the domain of sequence modelling, Recurrent Neural Networks (RNN) have been capable of achieving impressive results in a variety of application areas including visual question answering, part-of-speech tagging and machine translation.…

Machine Learning · Computer Science 2018-05-22 Tharindu Fernando , Simon Denman , Aaron McFadyen , Sridha Sridharan , Clinton Fookes