English
Related papers

Related papers: Neural Network Adaptive Control with Long Short-Te…

200 papers

This paper presents a novel adaptive control methodology for uncertain systems with time-varying unknown parameters and time-varying bounded disturbance. The adaptive controller ensures uniformly bounded transient and asymptotic tracking…

Optimization and Control · Mathematics 2007-05-23 Chengyu Cao , Naira Hovakimyan

Retentive Network (RetNet) represents a significant advancement in neural network architecture, offering an efficient alternative to the Transformer. While Transformers rely on self-attention to model dependencies, they suffer from high…

Computation and Language · Computer Science 2025-06-10 Haiqi Yang , Zhiyuan Li , Yi Chang , Yuan Wu

Diagnosis of cardiovascular diseases usually relies on the widely used standard 12-Lead (S12) ECG system. However, such a system could be bulky, too resource-intensive, and too specialized for personalized home-based monitoring. In…

Signal Processing · Electrical Eng. & Systems 2023-08-15 Rahul LR , Albert Shaiju , Soumya Jana

In the field of Automated Planning and Scheduling (APS), intelligent agents by virtue require an action model (blueprints of actions whose interleaved executions effectuates transitions of the system state) in order to plan and solve real…

Artificial Intelligence · Computer Science 2018-10-05 Ankuj Arora , Humbert Fiorino , Damien Pellier , Sylvie Pesty

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

Machine Learning · Computer Science 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

The transcription of handwritten text on images is one task in machine learning and one solution to solve it is using multi-dimensional recurrent neural networks (MDRNN) with connectionist temporal classification (CTC). The RNNs can contain…

Artificial Intelligence · Computer Science 2019-08-28 G. Leifert , T. Strauß , T. Grüning , R. Labahn

Automatic Modulation Recognition (AMR) plays a crucial role in wireless communication systems. Deep learning AMR strategies have achieved tremendous success in recent years. Modulated signals exhibit long temporal dependencies, and…

Signal Processing · Electrical Eng. & Systems 2024-01-03 Yunpeng Qu , Zhilin Lu , Rui Zeng , Jintao Wang , Jian Wang

Neural architecture search (NAS) has attracted much attention and has been explored for automatic speech recognition (ASR). In this work, we focus on streaming ASR scenarios and propose the latency-controlled NAS for acoustic modeling.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Liqiang He , Shulin Feng , Dan Su , Dong Yu

Traffic prediction plays an important role in evaluating the performance of telecommunication networks and attracts intense research interests. A significant number of algorithms and models have been put forward to analyse traffic data and…

Networking and Internet Architecture · Computer Science 2018-04-04 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Recurrent neural networks (RNNs), particularly long short-term memory (LSTM), have gained much attention in automatic speech recognition (ASR). Although some successful stories have been reported, training RNNs remains highly challenging,…

Machine Learning · Statistics 2016-09-21 Zhiyuan Tang , Dong Wang , Zhiyong Zhang

Multivariate techniques based on engineered features have found wide adoption in the identification of jets resulting from hadronic top decays at the Large Hadron Collider (LHC). Recent Deep Learning developments in this area include the…

High Energy Physics - Experiment · Physics 2017-11-27 Shannon Egan , Wojciech Fedorko , Alison Lister , Jannicke Pearkes , Colin Gay

Recurrent Neural Networks (RNNs) are widely used for online regression due to their ability to generalize nonlinear temporal dependencies. As an RNN model, Long-Short-Term-Memory Networks (LSTMs) are commonly preferred in practice, as these…

Machine Learning · Computer Science 2021-06-01 N. Mert Vural , Fatih Ilhan , Selim F. Yilmaz , Salih Ergüt , Suleyman S. Kozat

This paper proposes an adaptive neural network-based backstepping controller that uses rigid graph theory to address the distance-based formation control problem and target tracking for nonlinear multi-agent systems with bounded time-delay…

Systems and Control · Electrical Eng. & Systems 2020-10-13 Kiarash Aryankia , Rastko R. Selmic

Using unitary (instead of general) matrices in artificial neural networks (ANNs) is a promising way to solve the gradient explosion/vanishing problem, as well as to enable ANNs to learn long-term correlations in the data. This approach…

Machine Learning · Computer Science 2017-04-04 Li Jing , Yichen Shen , Tena Dubček , John Peurifoy , Scott Skirlo , Yann LeCun , Max Tegmark , Marin Soljačić

Machine and deep learning-based algorithms are the emerging approaches in addressing prediction problems in time series. These techniques have been shown to produce more accurate results than conventional regression-based modeling. It has…

Machine Learning · Computer Science 2019-11-22 Sima Siami-Namini , Neda Tavakoli , Akbar Siami Namin

In a typical car-following scenario, target vehicle speed fluctuations act as an external disturbance to the host vehicle and in turn affect its energy consumption. To control a host vehicle in an energy-efficient manner using model…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Sai Krishna Chada , Daniel Görges , Achim Ebert , Roman Teutsch

Spatial transformer network has been used in a layered form in conjunction with a convolutional network to enable the model to transform data spatially. In this paper, we propose a combined spatial transformer network (STN) and a Long…

Image and Video Processing · Electrical Eng. & Systems 2019-09-02 Shiyang Feng , Tianyue Chen , Hao Sun

We present Adaptive Memory Networks (AMN) that processes input-question pairs to dynamically construct a network architecture optimized for lower inference times for Question Answering (QA) tasks. AMN processes the input story to extract…

Artificial Intelligence · Computer Science 2018-02-05 Daniel Li , Asim Kadav

Spiking neural networks (SNNs) have garnered interest due to their energy efficiency and superior effectiveness on neuromorphic chips compared with traditional artificial neural networks (ANNs). One of the mainstream approaches to…

Neural and Evolutionary Computing · Computer Science 2024-04-29 Zhipeng Huang , Jianhao Ding , Zhiyu Pan , Haoran Li , Ying Fang , Zhaofei Yu , Jian K. Liu

The recurrent neural network with the long short-term memory cell (LSTM-NN) is employed to simulate the long-time dynamics of open quantum system. The bootstrap method is applied in the LSTM-NN construction and prediction, which provides a…

Chemical Physics · Physics 2021-11-05 Kunni Lin , Jiawei Peng , Feng Long Gu , Zhenggang Lan