English
Related papers

Related papers: Online Training of LSTM Networks in Distributed Sy…

200 papers

Ensuring sustainability demands more efficient energy management with minimized energy wastage. Therefore, the power grid of the future should provide an unprecedented level of flexibility in energy management. To that end, intelligent…

Neural and Evolutionary Computing · Computer Science 2018-11-29 Daniel L. Marino , Kasun Amarasinghe , Milos Manic

Reliable traffic flow prediction is crucial to creating intelligent transportation systems. Many big-data-based prediction approaches have been developed but they do not reflect complicated dynamic interactions between roads considering…

Machine Learning · Computer Science 2023-06-21 Won Kyung Lee , Deuk Sin Kwon , So Young Sohn

Relation classification is an important research arena in the field of natural language processing (NLP). In this paper, we present SDP-LSTM, a novel neural network to classify the relation of two entities in a sentence. Our neural…

Computation and Language · Computer Science 2015-08-18 Xu Yan , Lili Mou , Ge Li , Yunchuan Chen , Hao Peng , Zhi Jin

This paper develops a general framework for learning interpretable data representation via Long Short-Term Memory (LSTM) recurrent neural networks over hierarchal graph structures. Instead of learning LSTM models over the pre-fixed…

Computer Vision and Pattern Recognition · Computer Science 2017-03-10 Xiaodan Liang , Liang Lin , Xiaohui Shen , Jiashi Feng , Shuicheng Yan , Eric P. Xing

Effective water resource management requires information on water availability, both in terms of quality and quantity, spatially and temporally. In this paper, we study the methodology behind Transfer Learning (TL) through fine-tuning and…

Machine Learning · Computer Science 2021-12-07 Roland Oruche , Lisa Egede , Tracy Baker , Fearghal O'Donncha

Many machine learning algorithms have been developed under the assumption that data sets are already available in batch form. Yet in many application domains data is only available sequentially overtime via compute nodes in different…

Optimization and Control · Mathematics 2020-09-10 Alfredo Garcia , Luochao Wang , Jeff Huang , Lingzhou Hong

The aim of this work is to investigate the use of Incrementally Input-to-State Stable ($\delta$ISS) deep Long Short Term Memory networks (LSTMs) for the identification of nonlinear dynamical systems. We show that suitable sufficient…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Fabio Bonassi , Alessio La Bella , Giulio Panzani , Marcello Farina , Riccardo Scattolini

In power grids, short-term load forecasting (STLF) is crucial as it contributes to the optimization of their reliability, emissions, and costs, while it enables the participation of energy companies in the energy market. STLF is a…

Recurrent neural networks (RNNs) have many advantages over more traditional system identification techniques. They may be applied to linear and nonlinear systems, and they require fewer modeling assumptions. However, these neural network…

Systems and Control · Electrical Eng. & Systems 2022-04-08 Kaicheng Niu , Mi Zhou , Chaouki T. Abdallah , Mohammad Hayajneh

Distributed deep learning systems (DDLS) train deep neural network models by utilizing the distributed resources of a cluster. Developers of DDLS are required to make many decisions to process their particular workloads in their chosen…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Matthias Langer , Zhen He , Wenny Rahayu , Yanbo Xue

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Machine learning is widely used to analyze biological sequence data. Non-sequential models such as SVMs or feed-forward neural networks are often used although they have no natural way of handling sequences of varying length. Recurrent…

Quantitative Methods · Quantitative Biology 2016-03-14 Søren Kaae Sønderby , Casper Kaae Sønderby , Henrik Nielsen , Ole Winther

Various studies among side-channel attacks have tried to extract information through leakages from electronic devices to reach the instruction flow of some appliances. However, previous methods highly depend on the resolution of traced…

Cryptography and Security · Computer Science 2022-08-15 Pouya Narimani , Seyed Amin Habibi , Mohammad Ali Akhaee

The project aims to research on combining deep learning specifically Long-Short Memory (LSTM) and basic statistics in multiple multistep time series prediction. LSTM can dive into all the pages and learn the general trends of variation in a…

Machine Learning · Statistics 2017-10-13 Chuanyun Zang

With the proliferation of distributed energy resources (DERs) in the distribution grid, it is a challenge to effectively control a large number of DERs resilient to the communication and security disruptions, as well as to provide the…

Systems and Control · Electrical Eng. & Systems 2023-08-02 Mohammad Panahazari , Matthew Koscak , Jianhua Zhang , Daqing Hou , Jing Wang , David Wenzhong Gao

Federated learning is a privacy-focused approach towards machine learning where models are trained on client devices with locally available data and aggregated at a central server. However, the dependence on a single central server is…

Machine Learning · Computer Science 2026-01-06 Shamik Bhattacharyya , Rachel Kalpana Kalaimani

Channel estimation and signal detection are essential steps to ensure the quality of end-to-end communication in orthogonal frequency-division multiplexing (OFDM) systems. In this paper, we develop a DDLSD approach, i.e., Data-driven Deep…

Information Theory · Computer Science 2021-07-29 Guangliang Pan , Zitong Liu , Wei Wang , Minglei Li

This paper introduces Grid Long Short-Term Memory, a network of LSTM cells arranged in a multidimensional grid that can be applied to vectors, sequences or higher dimensional data such as images. The network differs from existing deep LSTM…

Neural and Evolutionary Computing · Computer Science 2016-01-08 Nal Kalchbrenner , Ivo Danihelka , Alex Graves

Split Learning (SL) recently emerged as an efficient paradigm for distributed Machine Learning (ML) suitable for the Internet Of Things (IoT)-Cloud systems. However, deploying SL on resource-constrained edge IoT platforms poses a…

Machine Learning · Computer Science 2025-02-14 Romina Soledad Molina , Vukan Ninkovic , Dejan Vukobratovic , Maria Liz Crespo , Marco Zennaro

Distributed machine learning has been widely studied in the literature to scale up machine learning model training in the presence of an ever-increasing amount of data. We study distributed machine learning from another perspective, where…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-16 Yaochen Hu , Di Niu , Jianming Yang , Shengping Zhou