English
Related papers

Related papers: Hyper Recurrent Neural Network: Condition Mechanis…

200 papers

Recurrent Neural networks (RNN) have shown promising potential for learning dynamics of sequential data. However, artificial neural networks are known to exhibit poor robustness in presence of input noise, where the sequential architecture…

Machine Learning · Computer Science 2021-05-05 Arash Amini , Guangyi Liu , Nader Motee

To simultaneously capture syntax and global semantics from a text corpus, we propose a new larger-context recurrent neural network (RNN) based language model, which extracts recurrent hierarchical semantic structure via a dynamic deep topic…

Computation and Language · Computer Science 2020-06-30 Dandan Guo , Bo Chen , Ruiying Lu , Mingyuan Zhou

We introduce a convolutional recurrent neural network (CRNN) for music tagging. CRNNs take advantage of convolutional neural networks (CNNs) for local feature extraction and recurrent neural networks for temporal summarisation of the…

Neural and Evolutionary Computing · Computer Science 2016-12-22 Keunwoo Choi , George Fazekas , Mark Sandler , Kyunghyun Cho

Recurrent neural networks (RNNs) were recently proposed for the session-based recommendation task. The models showed promising improvements over traditional recommendation approaches. In this work, we further study RNN-based models for…

Machine Learning · Computer Science 2016-09-19 Yong Kiam Tan , Xinxing Xu , Yong Liu

Recurrent neural networks (RNNs) are widely used in computational neuroscience and machine learning applications. In an RNN, each neuron computes its output as a nonlinear function of its integrated input. While the importance of RNNs,…

Neurons and Cognition · Quantitative Biology 2012-07-10 Sebastian Bitzer , Stefan J. Kiebel

The recurrent neural networks (RNN) with richly distributed internal states and flexible non-linear transition functions, have overtaken the dynamic Bayesian networks such as the hidden Markov models (HMMs) in the task of modeling highly…

Machine Learning · Computer Science 2021-08-11 Jin Huang , Ming Xiao

Deep neural networks (DNNs) represent the mainstream methodology for supervised speech enhancement, primarily due to their capability to model complex functions using hierarchical representations. However, a recent study revealed that DNNs…

Sound · Computer Science 2022-04-14 Ashutosh Pandey , DeLiang Wang

Accelerating the data acquisition of dynamic magnetic resonance imaging (MRI) leads to a challenging ill-posed inverse problem, which has received great interest from both the signal processing and machine learning community over the last…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Chen Qin , Jo Schlemper , Jose Caballero , Anthony Price , Joseph V. Hajnal , Daniel Rueckert

The effectiveness of recurrent neural networks can be largely influenced by their ability to store into their dynamical memory information extracted from input sequences at different frequencies and timescales. Such a feature can be…

Machine Learning · Computer Science 2020-07-01 Antonio Carta , Alessandro Sperduti , Davide Bacciu

This study explores the application of recurrent neural networks to recognize emotions conveyed in music, aiming to enhance music recommendation systems and support therapeutic interventions by tailoring music to fit listeners' emotional…

Sound · Computer Science 2024-05-14 Xinyu Chang , Xiangyu Zhang , Haoruo Zhang , Yulu Ran

We introduce Schr\"odingeRNN, a quantum inspired generative model for raw audio. Audio data is wave-like and is sampled from a continuous signal. Although generative modelling of raw audio has made great strides lately, relational inductive…

Sound · Computer Science 2019-11-28 Beñat Mencia Uranga , Austen Lamacraft

Recurrent Neural Networks (RNN) are known as powerful models for handling sequential data, and especially widely utilized in various natural language processing tasks. In this paper, we propose Contextual Recurrent Units (CRU) for enhancing…

Computation and Language · Computer Science 2019-11-15 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhipeng Chen , Shijin Wang , Guoping Hu

The rise of deepfake technologies has posed significant challenges to privacy, security, and information integrity, particularly in audio and multimedia content. This paper introduces a Quantum-Trained Convolutional Neural Network (QT-CNN)…

Sound · Computer Science 2024-10-15 Chu-Hsuan Abraham Lin , Chen-Yu Liu , Samuel Yen-Chi Chen , Kuan-Cheng Chen

The successful reconstruction of perceptual experiences from human brain activity has provided insights into the neural representations of sensory experiences. However, reconstructing arbitrary sounds has been avoided due to the complexity…

Sound · Computer Science 2023-06-21 Jong-Yun Park , Mitsuaki Tsukamoto , Misato Tanaka , Yukiyasu Kamitani

Recurrent neural networks (RNNs) are a widely used tool for modeling sequential data, yet they are often treated as inscrutable black boxes. Given a trained recurrent network, we would like to reverse engineer it--to obtain a quantitative,…

Machine Learning · Computer Science 2019-12-06 Niru Maheswaranathan , Alex Williams , Matthew D. Golub , Surya Ganguli , David Sussillo

This paper proposes a novel framework for recurrent neural networks (RNNs) inspired by the human memory models in the field of cognitive neuroscience to enhance information processing and transmission between adjacent RNNs' units. The…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Xi Chen , Zhihong Deng , Gehui Shen , Ting Huang

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

The Recurrent Neural Networks and their variants have shown promising performances in sequence modeling tasks such as Natural Language Processing. These models, however, turn out to be impractical and difficult to train when exposed to very…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Yinchong Yang , Denis Krompass , Volker Tresp

Deep-learning based noise reduction algorithms have proven their success especially for non-stationary noises, which makes it desirable to also use them for embedded devices like hearing aids (HAs). This, however, is currently not possible…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-24 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante-B. , Pascal Zobel , Andreas Maier

We consider the task of dimensional emotion recognition on video data using deep learning. While several previous methods have shown the benefits of training temporal neural network models such as recurrent neural networks (RNNs) on…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Pooya Khorrami , Tom Le Paine , Kevin Brady , Charlie Dagli , Thomas S. Huang