中文
相关论文

相关论文: Advanced LSTM: A Study about Better Time Dependenc…

200 篇论文

Recurrent Neural Networks (RNNs) are widely used in the field of natural language processing (NLP), ranging from text categorization to question answering and machine translation. However, RNNs generally read the whole text from beginning…

计算与语言 · 计算机科学 2019-05-29 Ting Huang , Gehui Shen , Zhi-Hong Deng

Long Short-Term Memory (LSTM) is a popular approach to boosting the ability of Recurrent Neural Networks to store longer term temporal information. The capacity of an LSTM network can be increased by widening and adding layers. However,…

机器学习 · 统计学 2017-12-14 Zhen He , Shaobing Gao , Liang Xiao , Daxue Liu , Hangen He , David Barber

This paper focuses on two key problems for audio-visual emotion recognition in the video. One is the audio and visual streams temporal alignment for feature level fusion. The other one is locating and re-weighting the perception attentions…

计算机视觉与模式识别 · 计算机科学 2016-03-29 Linlin Chao , Jianhua Tao , Minghao Yang , Ya Li , Zhengqi Wen

Time series prediction with deep learning methods, especially long short-term memory neural networks (LSTMs), have scored significant achievements in recent years. Despite the fact that the LSTMs can help to capture long-term dependencies,…

机器学习 · 计算机科学 2018-11-12 Youru Li , Zhenfeng Zhu , Deqiang Kong , Hua Han , Yao Zhao

Time series prediction can be generalized as a process that extracts useful information from historical records and then determines future values. Learning long-range dependencies that are embedded in time series is often an obstacle for…

神经与进化计算 · 计算机科学 2018-10-25 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks. While the recently introduced sLSTM for Natural…

机器学习 · 计算机科学 2025-02-25 Yaxuan Kong , Zepu Wang , Yuqi Nie , Tian Zhou , Stefan Zohren , Yuxuan Liang , Peng Sun , Qingsong Wen

Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong results on a variety of…

计算与语言 · 计算机科学 2015-06-02 Kai Sheng Tai , Richard Socher , Christopher D. Manning

Analysis of time-series data allows to identify long-term trends and make predictions that can help to improve our lives. With the rapid development of artificial neural networks, long short-term memory (LSTM) recurrent neural network (RNN)…

新兴技术 · 计算机科学 2018-09-11 Kazybek Adam , Kamilya Smagulova , Alex Pappachen James

Recurrent neural networks (RNNs) have led to breakthroughs in natural language processing and speech recognition, wherein hundreds of millions of people use such tools on a daily basis through smartphones, email servers and other avenues.…

无序系统与神经网络 · 物理学 2020-12-02 Sun-Ting Tsai , En-Jui Kuo , Pratyush Tiwary

We have recently shown that deep Long Short-Term Memory (LSTM) recurrent neural networks (RNNs) outperform feed forward deep neural networks (DNNs) as acoustic models for speech recognition. More recently, we have shown that the performance…

计算与语言 · 计算机科学 2015-07-27 Haşim Sak , Andrew Senior , Kanishka Rao , Françoise Beaufays

Network Traffic Matrix (TM) prediction is defined as the problem of estimating future network traffic from the previous and achieved network traffic data. It is widely used in network planning, resource management and network security. Long…

网络与互联网体系结构 · 计算机科学 2017-06-12 Abdelhadi Azzouni , Guy Pujolle

Reliable traffic flow prediction is crucial to creating intelligent transportation systems. Many big-data-based prediction approaches have been developed but they do not reflect complicated dynamic interactions between roads considering…

机器学习 · 计算机科学 2023-06-21 Won Kyung Lee , Deuk Sin Kwon , So Young Sohn

In sequence learning tasks such as language modelling, Recurrent Neural Networks must learn relationships between input features separated by time. State of the art models such as LSTM and Transformer are trained by backpropagation of…

机器学习 · 计算机科学 2019-12-04 Jeremy Gordon , David Rawlinson , Subutai Ahmad

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

机器学习 · 计算机科学 2020-11-03 Frank Xiao

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

机器学习 · 计算机科学 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

Long short-term memory (LSTM) is a robust recurrent neural network architecture for learning spatiotemporal sequential data. However, it requires significant computational power for learning and implementing from both software and hardware…

机器学习 · 计算机科学 2022-10-26 Nelly Elsayed , Zag ElSayed , Anthony S. Maida

Data-driven approaches to automated machine condition monitoring are gaining popularity due to advancements made in sensing technologies and computing algorithms. This paper proposes the use of a deep learning model, based on Long…

信号处理 · 电气工程与系统科学 2019-07-30 Jianlei Zhang , Binil Starly

Long Short-Term Memory (LSTM) is the primary recurrent neural networks architecture for acoustic modeling in automatic speech recognition systems. Residual learning is an efficient method to help neural networks converge easier and faster.…

计算与语言 · 计算机科学 2017-08-21 Lu Huang , Jiasong Sun , Ji Xu , Yi Yang

This paper applies a recurrent neural network, the LSTM, to forecast inflation. This is an appealing model for time series as it processes each time step sequentially and explicitly learns dynamic dependencies. The paper also explores the…

计量经济学 · 经济学 2023-10-03 Livia Paranhos

Long short-term memory recurrent neural networks (LSTM-RNNs) are considered state-of-the art in many speech processing tasks. The recurrence in the network, in principle, allows any input to be remembered for an indefinite time, a feature…

音频与语音处理 · 电气工程与系统科学 2020-09-02 Jeroen Zegers , Hugo Van hamme