English
Related papers

Related papers: Long Short-term Memory RNN

200 papers

Question answering is an important and difficult task in the natural language processing domain, because many basic natural language processing tasks can be cast into a question answering task. Several deep neural network architectures have…

Computation and Language · Computer Science 2017-07-10 Fenglong Ma , Radha Chitta , Saurabh Kataria , Jing Zhou , Palghat Ramesh , Tong Sun , Jing Gao

Modeling brain dynamics to better understand and control complex behaviors underlying various cognitive brain functions are of interests to engineers, mathematicians, and physicists from the last several decades. With a motivation of…

Neurons and Cognition · Quantitative Biology 2019-08-21 Benjamin Plaster , Gautam Kumar

Reason and inference require process as well as memory skills by humans. Neural networks are able to process tasks like image recognition (better than humans) but in memory aspects are still limited (by attention mechanism, size). Recurrent…

Machine Learning · Computer Science 2017-03-03 Amit Sahu

In this paper we investigate to what extent long short-term memory neural networks (LSTMs) are suitable for demand forecasting in the e-grocery retail sector. For this purpose, univariate as well as multivariate LSTM-based models were…

Machine Learning · Computer Science 2020-08-20 Marta Gołąbek , Robin Senge , Rainer Neumann

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

Recurrent Neural Networks (RNNs) with Long Short-Term Memory units (LSTM) are widely used because they are expressive and are easy to train. Our interest lies in empirically evaluating the expressiveness and the learnability of LSTMs in the…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Wojciech Zaremba , Ilya Sutskever

This paper applies a recurrent neural network, the LSTM, to forecast inflation. This is an appealing model for time series as it processes each time step sequentially and explicitly learns dynamic dependencies. The paper also explores the…

Econometrics · Economics 2023-10-03 Livia Paranhos

Meta-learning consists in learning learning algorithms. We use a Long Short Term Memory (LSTM) based network to learn to compute on-line updates of the parameters of another neural network. These parameters are stored in the cell state of…

Machine Learning · Computer Science 2016-10-20 Tom Bosc

In this paper we address the question of how to render sequence-level networks better at handling structured input. We propose a machine reading simulator which processes text incrementally from left to right and performs shallow reasoning…

Computation and Language · Computer Science 2016-09-22 Jianpeng Cheng , Li Dong , Mirella Lapata

Several variants of the Long Short-Term Memory (LSTM) architecture for recurrent neural networks have been proposed since its inception in 1995. In recent years, these networks have become the state-of-the-art models for a variety of…

Neural and Evolutionary Computing · Computer Science 2017-10-05 Klaus Greff , Rupesh Kumar Srivastava , Jan Koutník , Bas R. Steunebrink , Jürgen Schmidhuber

Time series forecasting is difficult. It is difficult even for recurrent neural networks with their inherent ability to learn sequentiality. This article presents a recurrent neural network based time series forecasting framework covering…

Machine Learning · Computer Science 2019-01-03 Gábor Petneházi

The LSTM network was proposed to overcome the difficulty in learning long-term dependence, and has made significant advancements in applications. With its success and drawbacks in mind, this paper raises the question - do RNN and LSTM have…

Machine Learning · Statistics 2020-06-11 Jingyu Zhao , Feiqing Huang , Jia Lv , Yanjie Duan , Zhen Qin , Guodong Li , Guangjian Tian

Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong results on a variety of…

Computation and Language · Computer Science 2015-06-02 Kai Sheng Tai , Richard Socher , Christopher D. Manning

This letter adopts long short-term memory(LSTM) to predict sea surface temperature(SST), which is the first attempt, to our knowledge, to use recurrent neural network to solve the problem of SST prediction, and to make one week and one…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Qin Zhang , Hui Wang , Junyu Dong , Guoqiang Zhong , Xin Sun

Long Short-Term Memory (LSTM) is a popular approach to boosting the ability of Recurrent Neural Networks to store longer term temporal information. The capacity of an LSTM network can be increased by widening and adding layers. However,…

Machine Learning · Statistics 2017-12-14 Zhen He , Shaobing Gao , Liang Xiao , Daxue Liu , Hangen He , David Barber

Matching pedestrians across multiple camera views known as human re-identification (re-identification) is a challenging problem in visual surveillance. In the existing works concentrating on feature extraction, representations are formed…

Computer Vision and Pattern Recognition · Computer Science 2016-07-29 Rahul Rama Varior , Bing Shuai , Jiwen Lu , Dong Xu , Gang Wang

Numerical modeling of different structural materials that have highly nonlinear behaviors has always been a challenging problem in engineering disciplines. Experimental data is commonly used to characterize this behavior. This study aims to…

Machine Learning · Computer Science 2020-07-28 Elif Ecem Bas , Denis Aslangil , Mohamed A. Moustafa

This paper introduces Grid Long Short-Term Memory, a network of LSTM cells arranged in a multidimensional grid that can be applied to vectors, sequences or higher dimensional data such as images. The network differs from existing deep LSTM…

Neural and Evolutionary Computing · Computer Science 2016-01-08 Nal Kalchbrenner , Ivo Danihelka , Alex Graves

Radiation therapy of thoracic and abdominal tumors requires incorporating the respiratory motion into treatments. To precisely account for the patient respiratory motions and predict the respiratory signals, a generalized model for…

Medical Physics · Physics 2019-05-22 Hui Lin , Chengyu Shi , Brian Wang , Maria F. Chan , Xiaoli Tang , Wei Ji

In this work we use the recent advances in representation learning to propose a neural architecture for the problem of natural language inference. Our approach is aligned to mimic how a human does the natural language inference process…

Computation and Language · Computer Science 2017-01-30 Biswajit Paria , K. M. Annervaz , Ambedkar Dukkipati , Ankush Chatterjee , Sanjay Podder