中文
相关论文

相关论文: LSTM-Based Text Generation: A Study on Historical …

200 篇论文

Traditional recurrent neural network architectures, such as long short-term memory neural networks (LSTM), have historically held a prominent role in time series forecasting (TSF) tasks. While the recently introduced sLSTM for Natural…

机器学习 · 计算机科学 2025-02-25 Yaxuan Kong , Zepu Wang , Yuqi Nie , Tian Zhou , Stefan Zohren , Yuxuan Liang , Peng Sun , Qingsong Wen

The development of robust generative models for highly varied non-stationary time series data is a complex yet important problem. Traditional models for time series data prediction, such as Long Short-Term Memory (LSTM), are inefficient and…

机器学习 · 计算机科学 2024-11-18 Anton Johansson , Arunselvan Ramaswamy

Demand forecasting in power sector has become an important part of modern demand management and response systems with the rise of smart metering enabled grids. Long Short-Term Memory (LSTM) shows promising results in predicting time series…

机器学习 · 计算机科学 2021-07-30 Koushik Roy , Abtahi Ishmam , Kazi Abu Taher

Recurrent Neural Networks (RNNs) are widely used in the field of natural language processing (NLP), ranging from text categorization to question answering and machine translation. However, RNNs generally read the whole text from beginning…

计算与语言 · 计算机科学 2019-05-29 Ting Huang , Gehui Shen , Zhi-Hong Deng

Deep Neural Networks (DNNs) are powerful models that have achieved excellent performance on difficult learning tasks. Although DNNs work well whenever large labeled training sets are available, they cannot be used to map sequences to…

计算与语言 · 计算机科学 2014-12-16 Ilya Sutskever , Oriol Vinyals , Quoc V. Le

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

机器学习 · 计算机科学 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

While recurrent neural networks have found success in a variety of natural language processing applications, they are general models of sequential data. We investigate how the properties of natural language data affect an LSTM's ability to…

计算与语言 · 计算机科学 2019-04-09 Nelson F. Liu , Omer Levy , Roy Schwartz , Chenhao Tan , Noah A. Smith

LSTM language models (LSTM-LMs) have been proven to be powerful and yielded significant performance improvements over count based n-gram LMs in modern speech recognition systems. Due to its infinite history states and computational load,…

计算与语言 · 计算机科学 2020-10-23 Xie Chen , Sarangarajan Parthasarathy , William Gale , Shuangyu Chang , Michael Zeng

We investigate regression for variable length sequential data containing missing samples and introduce a novel tree architecture based on the Long Short-Term Memory (LSTM) networks. In our architecture, we employ a variable number of LSTM…

机器学习 · 计算机科学 2020-05-26 S. Onur Sahin , Suleyman S. Kozat

Recurrent neural networks (RNNs) have led to breakthroughs in natural language processing and speech recognition, wherein hundreds of millions of people use such tools on a daily basis through smartphones, email servers and other avenues.…

无序系统与神经网络 · 物理学 2020-12-02 Sun-Ting Tsai , En-Jui Kuo , Pratyush Tiwary

Accurate short-term energy consumption forecasting is essential for efficient power grid management, resource allocation, and market stability. Traditional time-series models often fail to capture the complex, non-linear dependencies and…

计算机与社会 · 计算机科学 2026-01-27 Abhishek Maity , Viraj Tukarul

While the community keeps promoting end-to-end models over conventional hybrid models, which usually are long short-term memory (LSTM) models trained with a cross entropy criterion followed by a sequence discriminative training criterion,…

音频与语音处理 · 电气工程与系统科学 2020-03-18 Jinyu Li , Rui Zhao , Eric Sun , Jeremy H. M. Wong , Amit Das , Zhong Meng , Yifan Gong

Generating forecasts for time series with multiple seasonal cycles is an important use-case for many industries nowadays. Accounting for the multi-seasonal patterns becomes necessary to generate more accurate and meaningful forecasts in…

应用统计 · 统计学 2020-04-28 Kasun Bandara , Christoph Bergmeir , Hansika Hewamalage

The Long Short-Term Memory (LSTM) layer is an important advancement in the field of neural networks and machine learning, allowing for effective training and impressive inference performance. LSTM-based neural networks have been…

神经与进化计算 · 计算机科学 2019-01-04 Daniel Kent , Fathi M. Salem

Using Large Language Models (LLMs) to generate synthetic data for model training has become increasingly popular in recent years. While LLMs are capable of producing realistic training data, the effectiveness of data generation is…

计算与语言 · 计算机科学 2024-07-23 Yinheng Li , Rogerio Bonatti , Sara Abdali , Justin Wagle , Kazuhito Koishida

Long Short-Term Memory (LSTM) has achieved state-of-the-art performances on a wide range of tasks. Its outstanding performance is guaranteed by the long-term memory ability which matches the sequential data perfectly and the gating…

神经与进化计算 · 计算机科学 2019-01-29 Shiwei Liu , Decebal Constantin Mocanu , Mykola Pechenizkiy

Language models must capture statistical dependencies between words at timescales ranging from very short to very long. Earlier work has demonstrated that dependencies in natural language tend to decay with distance between words according…

计算与语言 · 计算机科学 2021-03-19 Shivangi Mahto , Vy A. Vo , Javier S. Turek , Alexander G. Huth

LSTM or Long Short Term Memory Networks is a specific type of Recurrent Neural Network (RNN) that is very effective in dealing with long sequence data and learning long term dependencies. In this work, we perform sentiment analysis on a GOP…

计算与语言 · 计算机科学 2020-05-11 Karthik Gopalakrishnan , Fathi M. Salem

The integration of quantum computing into classical machine learning architectures has emerged as a promising approach to enhance model efficiency and computational capacity. In this work, we introduce the Quantum Kernel-Based Long…

量子物理 · 物理学 2024-11-21 Yu-Chao Hsu , Tai-Yu Li , Kuan-Cheng Chen

Target-dependent sentiment classification remains a challenge: modeling the semantic relatedness of a target with its context words in a sentence. Different context words have different influences on determining the sentiment polarity of a…

计算与语言 · 计算机科学 2016-09-30 Duyu Tang , Bing Qin , Xiaocheng Feng , Ting Liu