English
Related papers

Related papers: Approximate FPGA-based LSTMs under Computation Tim…

200 papers

Fluorescence lifetime imaging (FLI) is an important technique for studying cellular environments and molecular interactions, but its real-time application is limited by slow data acquisition, which requires capturing large time-resolved…

Image and Video Processing · Electrical Eng. & Systems 2024-10-03 Ismail Erbas , Vikas Pandey , Aporva Amarnath , Naigang Wang , Karthik Swaminathan , Stefan T. Radev , Xavier Intes

The ever-increasing demand to extract temporal correlations across sequential data and perform context-based learning in this era of big data has led to the development of long short-term memory (LSTM) networks. Furthermore, there is an…

Emerging Technologies · Computer Science 2022-04-06 Honey Nikam , Siddharth Satyam , Shubham Sahay

Time series prediction can be generalized as a process that extracts useful information from historical records and then determines future values. Learning long-range dependencies that are embedded in time series is often an obstacle for…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Deep learning, and in particular Recurrent Neural Networks (RNN) have shown superior accuracy in a large variety of tasks including machine translation, language understanding, and movie frame generation. However, these deep learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Md Zahangir Alom , Adam T Moody , Naoya Maruyama , Brian C Van Essen , Tarek M. Taha

Network Traffic Matrix (TM) prediction is defined as the problem of estimating future network traffic from the previous and achieved network traffic data. It is widely used in network planning, resource management and network security. Long…

Networking and Internet Architecture · Computer Science 2017-06-12 Abdelhadi Azzouni , Guy Pujolle

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and…

This study suggests a new strategy for improving congestion control by deploying Long Short-Term Memory (LSTM) networks. LSTMs are recurrent neural networks (RNN), that excel at capturing temporal relationships and patterns in data.…

Signal Processing · Electrical Eng. & Systems 2023-09-20 Atta Ur Rahman , Bibi Saqia , Wali Ullah Khan , Khaled Rabie , Mahmood Alam , Khairullah Khan

This is part III of three-part work. In parts I and II, we have presented eight variants for simplified Long Short Term Memory (LSTM) recurrent neural networks (RNNs). It is noted that fast computation, specially in constrained computing…

Neural and Evolutionary Computing · Computer Science 2017-07-18 Atra Akandeh , Fathi M. Salem

The rapid evolution of artificial intelligence has driven interest in Long Short-Term Memory (LSTM) networks for their effectiveness in processing sequential data. However, traditional LSTMs are limited by issues such as the vanishing…

Quantum Physics · Physics 2024-08-27 Yifan Zhou , Chong Cheng Xu , Mingi Song , Yew Kee Wong , Kangsong Du

Accurate load forecasting is critical for electricity market operations and other real-time decision-making tasks in power systems. This paper considers the short-term load forecasting (STLF) problem for residential customers within a…

Machine Learning · Computer Science 2021-11-24 Yuqi Zhou , Arun Sukumaran Nair , David Ganger , Abhinandan Tripathi , Chaitanya Baone , Hao Zhu

Split Learning (SL) recently emerged as an efficient paradigm for distributed Machine Learning (ML) suitable for the Internet Of Things (IoT)-Cloud systems. However, deploying SL on resource-constrained edge IoT platforms poses a…

Machine Learning · Computer Science 2025-02-14 Romina Soledad Molina , Vukan Ninkovic , Dejan Vukobratovic , Maria Liz Crespo , Marco Zennaro

Recently, recurrent neural networks (RNNs) as powerful sequence models have re-emerged as a potential acoustic model for statistical parametric speech synthesis (SPSS). The long short-term memory (LSTM) architecture is particularly…

Computation and Language · Computer Science 2016-01-12 Zhizheng Wu , Simon King

Long Short-Term Memory (LSTM) is widely used in speech recognition. In order to achieve higher prediction accuracy, machine learning scientists have built larger and larger models. Such large model is both computation intensive and memory…

Computation and Language · Computer Science 2017-02-21 Song Han , Junlong Kang , Huizi Mao , Yiming Hu , Xin Li , Yubin Li , Dongliang Xie , Hong Luo , Song Yao , Yu Wang , Huazhong Yang , William J. Dally

We present five variants of the standard Long Short-term Memory (LSTM) recurrent neural networks by uniformly reducing blocks of adaptive parameters in the gating mechanisms. For simplicity, we refer to these models as LSTM1, LSTM2, LSTM3,…

Neural and Evolutionary Computing · Computer Science 2017-07-18 Atra Akandeh , Fathi M. Salem

Multivariate techniques based on engineered features have found wide adoption in the identification of jets resulting from hadronic top decays at the Large Hadron Collider (LHC). Recent Deep Learning developments in this area include the…

High Energy Physics - Experiment · Physics 2017-11-27 Shannon Egan , Wojciech Fedorko , Alison Lister , Jannicke Pearkes , Colin Gay

Modern Neural Networks are eminent in achieving state of the art performance on tasks under Computer Vision, Natural Language Processing and related verticals. However, they are notorious for their voracious memory and compute appetite…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Harshit Rampal , Aman Mohanty

The incessant advent of online services demands high speed and efficient recommender systems (ReS) that can maintain real-time performance along with processing very complex user-item interactions. The present study, therefore, considers…

Machine Learning · Computer Science 2025-07-03 Yushang Zhao , Haotian Lyu , Yike Peng , Aijia Sun , Feng Jiang , Xinyue Han

Recent advances in reasoning Large Language Models (LLMs) are driving the emergence of agentic AI systems. Edge deployment of LLM agents near end users is increasingly necessary to protect data privacy, enable offline use, and provide…

Machine Learning · Computer Science 2026-02-03 Hao Mark Chen , Zhiwen Mo , Guanxi Lu , Shuang Liang , Lingxiao Ma , Wayne Luk , Hongxiang Fan

Data-driven approaches to automated machine condition monitoring are gaining popularity due to advancements made in sensing technologies and computing algorithms. This paper proposes the use of a deep learning model, based on Long…

Signal Processing · Electrical Eng. & Systems 2019-07-30 Jianlei Zhang , Binil Starly