English
Related papers

Related papers: A critical look at deep neural network for dynamic…

200 papers

Multivariate techniques based on engineered features have found wide adoption in the identification of jets resulting from hadronic top decays at the Large Hadron Collider (LHC). Recent Deep Learning developments in this area include the…

High Energy Physics - Experiment · Physics 2017-11-27 Shannon Egan , Wojciech Fedorko , Alison Lister , Jannicke Pearkes , Colin Gay

Real-time prediction of clinical interventions remains a challenge within intensive care units (ICUs). This task is complicated by data sources that are noisy, sparse, heterogeneous and outcomes that are imbalanced. In this paper, we…

Machine Learning · Computer Science 2017-05-25 Harini Suresh , Nathan Hunt , Alistair Johnson , Leo Anthony Celi , Peter Szolovits , Marzyeh Ghassemi

Deep neural networks (DNNs) have been deployed in myriad machine learning applications. However, advances in their accuracy are often achieved with increasingly complex and deep network architectures. These large, deep models are often…

Machine Learning · Computer Science 2020-04-22 Wenhan Xia , Hongxu Yin , Niraj K. Jha

Long Short-Term Memory (LSTM) is a recurrent neural network (RNN) architecture that has been designed to address the vanishing and exploding gradient problems of conventional RNNs. Unlike feedforward neural networks, RNNs have cyclic…

Neural and Evolutionary Computing · Computer Science 2014-02-06 Haşim Sak , Andrew Senior , Françoise Beaufays

A major tenet in theoretical neuroscience is that cognitive and behavioral processes are ultimately implemented in terms of the neural system dynamics. Accordingly, a major aim for the analysis of neurophysiological measurements should lie…

Machine Learning · Computer Science 2020-07-01 Georgia Koppe , Hazem Toutounji , Peter Kirsch , Stefanie Lis , Daniel Durstewitz

Recurrent Neural Networks (RNNs), and specifically a variant with Long Short-Term Memory (LSTM), are enjoying renewed interest as a result of successful applications in a wide range of machine learning problems that involve sequential data.…

Machine Learning · Computer Science 2015-11-18 Andrej Karpathy , Justin Johnson , Li Fei-Fei

LSTM or Long Short Term Memory Networks is a specific type of Recurrent Neural Network (RNN) that is very effective in dealing with long sequence data and learning long term dependencies. In this work, we perform sentiment analysis on a GOP…

Computation and Language · Computer Science 2020-05-11 Karthik Gopalakrishnan , Fathi M. Salem

This survey provides an examination of the use of Deep Neural Networks (DNN) in Collaborative Filtering (CF) recommendation systems. As the digital world increasingly relies on data-driven approaches, traditional CF techniques face…

Artificial Intelligence · Computer Science 2024-12-03 Pang Li , Shahrul Azman Mohd Noah , Hafiz Mohd Sarim

Exact numerical simulations of dynamics of open quantum systems often require immense computational resources. We demonstrate that a deep artificial neural network comprised of convolutional layers is a powerful tool for predicting…

Computational Physics · Physics 2020-12-22 Luis E. Herrera Rodriguez , Alexei A. Kananenka

We introduce a data-driven forecasting method for high-dimensional chaotic systems using long short-term memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high-dimensional dynamical systems in…

Computational Physics · Physics 2019-09-20 Pantelis R. Vlachas , Wonmin Byeon , Zhong Y. Wan , Themistoklis P. Sapsis , Petros Koumoutsakos

Distinguishing active from passive dynamics is a fundamental challenge in understanding the motion of living cells and other active matter systems. Here, we introduce a framework that combines physical modeling, analytical theory, and…

Data-driven approaches to automated machine condition monitoring are gaining popularity due to advancements made in sensing technologies and computing algorithms. This paper proposes the use of a deep learning model, based on Long…

Signal Processing · Electrical Eng. & Systems 2019-07-30 Jianlei Zhang , Binil Starly

Deep learning has yielded state-of-the-art performance on many natural language processing tasks including named entity recognition (NER). However, this typically requires large amounts of labeled data. In this work, we demonstrate that the…

Computation and Language · Computer Science 2018-02-06 Yanyao Shen , Hyokun Yun , Zachary C. Lipton , Yakov Kronrod , Animashree Anandkumar

The robotic systems continuously interact with complex dynamical systems in the physical world. Reliable predictions of spatiotemporal evolution of these dynamical systems, with limited knowledge of system dynamics, are crucial for…

Artificial Intelligence · Computer Science 2019-01-08 Yun Long , Xueyuan She , Saibal Mukhopadhyay

The time it takes for a classifier to make an accurate prediction can be crucial in many behaviour recognition problems. For example, an autonomous vehicle should detect hazardous pedestrian behaviour early enough for it to take appropriate…

Machine Learning · Computer Science 2020-02-27 Joel Janek Dabrowski , Johan Pieter de Villiers , Ashfaqur Rahman , Conrad Beyers

Reason and inference require process as well as memory skills by humans. Neural networks are able to process tasks like image recognition (better than humans) but in memory aspects are still limited (by attention mechanism, size). Recurrent…

Machine Learning · Computer Science 2017-03-03 Amit Sahu

This review aims to conduct a comparative analysis of liquid neural networks (LNNs) and traditional recurrent neural networks (RNNs) and their variants, such as long short-term memory networks (LSTMs) and gated recurrent units (GRUs). The…

Machine Learning · Computer Science 2025-10-10 Shilong Zong , Alex Bierly , Almuatazbellah Boker , Hoda Eldardiry

Learning models for dynamical systems in continuous time is significant for understanding complex phenomena and making accurate predictions. This study presents a novel approach utilizing differential neural networks (DNNs) to model…

Machine Learning · Computer Science 2024-12-13 Wenjie Mei , Xiaorui Wang , Yanrong Lu , Ke Yu , Shihua Li

We introduce a new class of non-linear models for functional data based on neural networks. Deep learning has been very successful in non-linear modeling, but there has been little work done in the functional data setting. We propose two…

Machine Learning · Computer Science 2023-05-11 Aniruddha Rajendra Rao , Matthew Reimherr

For the weakly supervised task of electrocardiogram (ECG) rhythm classification, convolutional neural networks (CNNs) and long short-term memory (LSTM) networks are two increasingly popular classification models. This work investigates…

Machine Learning · Computer Science 2019-12-03 Nora Vogt