English
Related papers

Related papers: Gated Res2Net for Multivariate Time Series Analysi…

200 papers

In this work, we propose a novel recurrent neural network (RNN) architecture. The proposed RNN, gated-feedback RNN (GF-RNN), extends the existing approach of stacking multiple recurrent layers by allowing and controlling signals flowing…

Neural and Evolutionary Computing · Computer Science 2015-06-18 Junyoung Chung , Caglar Gulcehre , Kyunghyun Cho , Yoshua Bengio

Graph-structured data such as social networks, functional brain networks, gene regulatory networks, communications networks have brought the interest in generalizing deep learning techniques to graph domains. In this paper, we are…

Machine Learning · Computer Science 2018-04-25 Xavier Bresson , Thomas Laurent

Multivariate time series classification (MTSC) is an important data mining task, which can be effectively solved by popular deep learning technology. Unfortunately, the existing deep learning-based methods neglect the hidden dependencies in…

Machine Learning · Computer Science 2024-08-19 Huaiyuan Liu , Xianzhang Liu , Donghua Yang , Zhiyu Liang , Hongzhi Wang , Yong Cui , Jun Gu

Multivariate time series forecasting is of great importance to many scientific disciplines and industrial sectors. The evolution of a multivariate time series depends on the dynamics of its variables and the connectivity network of causal…

Machine Learning · Computer Science 2020-09-03 Christos Koutlis , Symeon Papadopoulos , Manos Schinas , Ioannis Kompatsiaris

Discovering temporal lagged and inter-dependencies in multivariate time series data is an important task. However, in many real-world applications, such as commercial cloud management, manufacturing predictive maintenance, and portfolios…

Machine Learning · Computer Science 2018-12-12 Xuan-Hong Dang , Syed Yousaf Shah , Petros Zerfos

Recurrent and convolutional neural networks are the most common architectures used for time series forecasting in deep learning literature. These networks use parameter sharing by repeating a set of fixed architectures with fixed parameters…

Machine Learning · Computer Science 2020-11-30 Joel Janek Dabrowski , YiFan Zhang , Ashfaqur Rahman

We present Gradient Gating (G$^2$), a novel framework for improving the performance of Graph Neural Networks (GNNs). Our framework is based on gating the output of GNN layers with a mechanism for multi-rate flow of message passing…

The existing graph neural networks (GNNs) based on the spectral graph convolutional operator have been criticized for its performance degradation, which is especially common for the models with deep architectures. In this paper, we further…

Machine Learning · Computer Science 2019-09-25 Jiawei Zhang , Lin Meng

This paper addresses the challenges of fault prediction and delayed response in distributed systems by proposing an intelligent prediction method based on temporal feature learning. The method takes multi-dimensional performance metric…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Yang Wang , Wenxuan Zhu , Xuehui Quan , Heyi Wang , Chang Liu , Qiyuan Wu

Dealing with missing values and incomplete time series is a labor-intensive, tedious, inevitable task when handling data coming from real-world applications. Effective spatio-temporal representations would allow imputation methods to…

Machine Learning · Computer Science 2022-02-11 Andrea Cini , Ivan Marisca , Cesare Alippi

We consider a setting where multiple entities inter-act with each other over time and the time-varying statuses of the entities are represented as multiple correlated time series. For example, speed sensors are deployed in different…

Machine Learning · Computer Science 2021-03-23 Razvan-Gabriel Cirstea , Chenjuan Guo , Bin Yang

Time series analysis is of immense importance in extensive applications, such as weather forecasting, anomaly detection, and action recognition. This paper focuses on temporal variation modeling, which is the common key problem of extensive…

Machine Learning · Computer Science 2023-04-13 Haixu Wu , Tengge Hu , Yong Liu , Hang Zhou , Jianmin Wang , Mingsheng Long

The escalating complexity of network threats and the inherent class imbalance in traffic data present formidable challenges for modern Intrusion Detection Systems (IDS). While Graph Neural Networks (GNNs) excel in modeling topological…

Machine Learning · Computer Science 2026-04-15 Tianxiang Xu , Zhichao Wen , Xinyu Zhao , Qi Hu , Yan Li , Chang Liu

Two-stream Convolutional Networks (ConvNets) have shown strong performance for human action recognition in videos. Recently, Residual Networks (ResNets) have arisen as a new technique to train extremely deep architectures. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-11-08 Christoph Feichtenhofer , Axel Pinz , Richard P. Wildes

Recurrent Neural Networks (RNNs), which are a powerful scheme for modeling temporal and sequential data need to capture long-term dependencies on datasets and represent them in hidden layers with a powerful model to capture more information…

Machine Learning · Computer Science 2017-06-08 Andros Tjandra , Sakriani Sakti , Ruli Manurung , Mirna Adriani , Satoshi Nakamura

We introduce the Genetic-Gated Networks (G2Ns), simple neural networks that combine a gate vector composed of binary genetic genes in the hidden layer(s) of networks. Our method can take both advantages of gradient-free optimization and…

Neural and Evolutionary Computing · Computer Science 2019-03-06 Simyung Chang , John Yang , Jaeseok Choi , Nojun Kwak

Gating mechanisms have emerged as an effective strategy integrated into model designs beyond recurrent neural networks for addressing long-range dependency problems. In a broad understanding, it provides adaptive control over the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yifan Wang , Xu Ma , Yitian Zhang , Zhongruo Wang , Sung-Cheol Kim , Vahid Mirjalili , Vidya Renganathan , Yun Fu

The residual neural network (ResNet) is a popular deep network architecture which has the ability to obtain high-accuracy results on several image processing problems. In order to analyze the behavior and structure of ResNet, recent work…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Linan Zhang , Hayden Schaeffer

In visual recognition, the key to the performance improvement of ResNet is the success in establishing the stack of deep sequential convolutional layers using identical mapping by a shortcut connection. It results in multiple paths of data…

Computer Vision and Pattern Recognition · Computer Science 2018-11-19 Jung HyoungHo , Lee Ryong , Lee Sanghwan , Hwang Wonjun

Time series segmentation (TSS) is one of the time series (TS) analysis techniques, that has received considerably less attention compared to other TS related tasks. In recent years, deep learning architectures have been introduced for TSS,…

Machine Learning · Computer Science 2026-02-20 Ivana Kesić , Carolina Fortuna , Mihael Mohorčič , Blaž Bertalanič