English
Related papers

Related papers: Learning Temporal Dependencies in Data Using a DBN…

200 papers

Sequences and time-series often arise in robot tasks, e.g., in activity recognition and imitation learning. In recent years, deep neural networks (DNNs) have emerged as an effective data-driven methodology for processing sequences given…

Artificial Intelligence · Computer Science 2021-01-29 Yaqi Xie , Fan Zhou , Harold Soh

Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these…

Machine Learning · Computer Science 2018-04-20 Guokun Lai , Wei-Cheng Chang , Yiming Yang , Hanxiao Liu

Long Short-Term Memory (LSTM) is a recurrent neural network (RNN) architecture that has been designed to address the vanishing and exploding gradient problems of conventional RNNs. Unlike feedforward neural networks, RNNs have cyclic…

Neural and Evolutionary Computing · Computer Science 2014-02-06 Haşim Sak , Andrew Senior , Françoise Beaufays

Deep conditional generative models are developed to simultaneously learn the temporal dependencies of multiple sequences. The model is designed by introducing a three-way weight tensor to capture the multiplicative interactions between side…

Machine Learning · Statistics 2016-05-24 Jiaming Song , Zhe Gan , Lawrence Carin

Accurate time series prediction is challenging due to the inherent nonlinearity and sensitivity to initial conditions. We propose a novel approach that enhances neural network predictions through differential learning, which involves…

Machine Learning · Computer Science 2025-03-11 Akash Yadav , Eulalia Nualart

Long short-term memory (LSTM) based acoustic modeling methods have recently been shown to give state-of-the-art performance on some speech recognition tasks. To achieve a further performance improvement, in this research, deep extensions on…

Computation and Language · Computer Science 2015-05-12 Xiangang Li , Xihong Wu

Realistic music generation has always remained as a challenging problem as it may lack structure or rationality. In this work, we propose a deep learning based music generation method in order to produce old style music particularly JAZZ…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Gullapalli Keerti , A N Vaishnavi , Prerana Mukherjee , A Sree Vidya , Gattineni Sai Sreenithya , Deeksha Nayab

Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction…

Machine Learning · Computer Science 2022-09-21 Hugo Inzirillo , Ludovic De Villelongue

Recurrent neural networks (RNNs) have shown significant improvements in recent years for speech enhancement. However, the model complexity and inference time cost of RNNs are much higher than deep feed-forward neural networks (DNNs).…

Sound · Computer Science 2020-11-12 Cunhang Fan , Bin Liu , Jianhua Tao , Jiangyan Yi , Zhengqi Wen , Leichao Song

Neural architectures such as Recurrent Neural Networks (RNNs), Transformers, and State-Space Models have shown great success in handling sequential data by learning temporal dependencies. Decision Trees (DTs), on the other hand, remain a…

Machine Learning · Computer Science 2025-02-07 Sascha Marton , Moritz Schneider

Data analytics helps basketball teams to create tactics. However, manual data collection and analytics are costly and ineffective. Therefore, we applied a deep bidirectional long short-term memory (BLSTM) and mixture density network (MDN)…

Artificial Intelligence · Computer Science 2018-02-14 Yu Zhao , Rennong Yang , Guillaume Chevalier , Rajiv Shah , Rob Romijnders

Long short-term memory (LSTM) is a kind of recurrent neural networks (RNN) for sequence and temporal dependency data modeling and its effectiveness has been extensively established. In this work, we propose a hybrid quantum-classical model…

Quantum Physics · Physics 2020-09-04 Samuel Yen-Chi Chen , Shinjae Yoo , Yao-Lung L. Fang

Considering music as a sequence of events with multiple complex dependencies, the Long Short-Term Memory (LSTM) architecture has proven very efficient in learning and reproducing musical styles. However, the generation of rhythms requires…

Sound · Computer Science 2019-01-23 Dimos Makris , Maximos Kaliakatsos-Papakostas , Katia Lida Kermanidis

Motivation: Several different threads of research have been proposed for modeling and mining temporal data. On the one hand, approaches such as dynamic Bayesian networks (DBNs) provide a formal probabilistic basis to model relationships…

Machine Learning · Computer Science 2009-04-15 Debprakash Patnaik , Srivatsan Laxman , Naren Ramakrishnan

In this paper, we apply a general deep learning (DL) framework for the answer selection task, which does not depend on manually defined features or linguistic tools. The basic framework is to build the embeddings of questions and answers…

Computation and Language · Computer Science 2016-03-29 Ming Tan , Cicero dos Santos , Bing Xiang , Bowen Zhou

The Bidirectional LSTM (BLSTM) RNN based speech synthesis system is among the best parametric Text-to-Speech (TTS) systems in terms of the naturalness of generated speech, especially the naturalness in prosody. However, the model complexity…

Computation and Language · Computer Science 2018-02-27 Mengxiao Bi , Heng Lu , Shiliang Zhang , Ming Lei , Zhijie Yan

Nowadays this is very popular to use deep architectures in machine learning. Deep Belief Networks (DBNs) are deep architectures that use stack of Restricted Boltzmann Machines (RBM) to create a powerful generative model using training data.…

Machine Learning · Computer Science 2015-08-21 Mohammad Ali Keyvanrad , Mohammad Mehdi Homayounpour

Accurate epidemic forecasting is a critical task in controlling disease transmission. Many deep learning-based models focus only on static or dynamic graphs when constructing spatial information, ignoring their relationship. Additionally,…

Machine Learning · Computer Science 2023-12-04 Junkai Mao , Yuexing Han , Gouhei Tanaka , Bing Wang

Time series prediction can be generalized as a process that extracts useful information from historical records and then determines future values. Learning long-range dependencies that are embedded in time series is often an obstacle for…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Deep learning is a popular machine learning approach which has achieved a lot of progress in all traditional machine learning areas. Internet of thing (IoT) and Smart City deployments are generating large amounts of time-series sensor data…

Networking and Internet Architecture · Computer Science 2021-04-15 Xiaofeng Xie , Di Wu , Siping Liu , Renfa Li