English
Related papers

Related papers: LSTM Fully Convolutional Networks for Time Series …

200 papers

Fully Convolution Networks (FCN) have achieved great success in dense prediction tasks including semantic segmentation. In this paper, we start from discussing FCN by understanding its architecture limitations in building a strong…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Bing Shuai , Ting Liu , Gang Wang

Learning from spatio-temporal data has numerous applications such as human-behavior analysis, object tracking, video compression, and physics simulation.However, existing methods still perform poorly on challenging video tasks such as…

Machine Learning · Computer Science 2020-10-06 Jiahao Su , Wonmin Byeon , Jean Kossaifi , Furong Huang , Jan Kautz , Animashree Anandkumar

This research identifies a gap in weakly-labelled multivariate time-series classification (TSC), where state-of-the-art TSC models do not per-form well. Weakly labelled time-series are time-series containing noise and significant…

Machine Learning · Computer Science 2021-09-20 Surayez Rahman , Chang Wei Tan

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Analysis of time-series data allows to identify long-term trends and make predictions that can help to improve our lives. With the rapid development of artificial neural networks, long short-term memory (LSTM) recurrent neural network (RNN)…

Emerging Technologies · Computer Science 2018-09-11 Kazybek Adam , Kamilya Smagulova , Alex Pappachen James

Recent studies have applied deep learning methods such as convolutional recurrent neural networks (CRNs) and Transformers to brain disease classification based on dynamic functional connectivity networks (dFCNs), such as Alzheimer's disease…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Zhixiang Zhang , Biao Jie , Zhengdong Wang , Jie Zhou , Yang Yang

Data-driven approaches to automated machine condition monitoring are gaining popularity due to advancements made in sensing technologies and computing algorithms. This paper proposes the use of a deep learning model, based on Long…

Signal Processing · Electrical Eng. & Systems 2019-07-30 Jianlei Zhang , Binil Starly

Most neural network-based classifiers extract features using several hidden layers and make predictions at the output layer by utilizing these extracted features. We observe that not all features are equally pronounced in all classes; we…

Machine Learning · Computer Science 2022-11-22 Yifan Hao , Huiping Cao , K. Selcuk Candan , Jiefei Liu , Huiying Chen , Ziwei Ma

We investigate time-dependent data analysis from the perspective of recurrent kernel machines, from which models with hidden units and gated memory cells arise naturally. By considering dynamic gating of the memory cell, a model closely…

Machine Learning · Statistics 2019-10-11 Kevin J Liang , Guoyin Wang , Yitong Li , Ricardo Henao , Lawrence Carin

The Convolution Neural Network (CNN) has demonstrated the unique advantage in audio, image and text learning; recently it has also challenged Recurrent Neural Networks (RNNs) with long short-term memory cells (LSTM) in sequence-to-sequence…

Computation and Language · Computer Science 2017-12-29 Qiming Chen , Ren Wu

Convolutional Neural Networks (CNNs) have been widely employed for image Super-Resolution (SR) in recent years. Various techniques enhance SR performance by altering CNN structures or incorporating improved self-attention mechanisms.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Qizhou Chen , Qing Shao

We study the classification of animal behavior using accelerometry data through various recurrent neural network (RNN) models. We evaluate the classification performance and complexity of the considered models, which feature long short-time…

Machine Learning · Computer Science 2021-11-29 Liang Wang , Reza Arablouei , Flavio A. P. Alvarenga , Greg J. Bishop-Hurley

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

We report applications of Convolutional Neural Networks (CNN) to multi-classification classification of a large medical data set. We discuss in detail how changes in the CNN model and the data pre-processing impact the classification…

Machine Learning · Computer Science 2020-12-29 YuanZheng Hu , Marina Sokolova

This paper proposes an intelligent cache management strategy based on CNN-LSTM to improve the performance and cache hit rate of storage systems. Through comparative experiments with traditional algorithms (such as LRU and LFU) and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-20 Xiaoye Wang , Xuan Li , Linji Wang , Tingyi Ruan , Pochun Li

Attention mechanism has been regarded as an advanced technique to capture long-range feature interactions and to boost the representation capability for convolutional neural networks. However, we found two ignored problems in current…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhu Baozhou , Peter Hofstee , Jinho Lee , Zaid Al-Ars

Most existing Convolutional Neural Networks(CNNs) used for action recognition are either difficult to optimize or underuse crucial temporal information. Inspired by the fact that the recurrent model consistently makes breakthroughs in the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Zhenxing Zheng , Gaoyun An , Qiuqi Ruan

Fully convolutional neural networks give accurate, per-pixel prediction for input images and have applications like semantic segmentation. However, a typical FCN usually requires lots of floating point computation and large run-time memory,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-02 He Wen , Shuchang Zhou , Zhe Liang , Yuxiang Zhang , Dieqiao Feng , Xinyu Zhou , Cong Yao

In this study, we propose a novel adaptive control architecture, which provides dramatically better transient response performance compared to conventional adaptive control methods. What makes this architecture unique is the synergistic…

Systems and Control · Electrical Eng. & Systems 2023-01-09 Emirhan Inanc , Yigit Gurses , Abdullah Habboush , Yildiray Yildiz , Anuradha M. Annaswamy

Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Qiquan Zhang , Aaron Nicolson , Mingjiang Wang , Kuldip K. Paliwal , Chenxu Wang