English
Related papers

Related papers: Temporal Transformer Networks: Joint Learning of I…

200 papers

Temporal Graph Learning (TGL) has become a robust framework for discovering patterns in dynamic networks and predicting future interactions. While existing research has largely concentrated on learning from individual networks, this study…

A long-standing proposition is that by emulating the operation of the brain's neocortex, a spiking neural network (SNN) can achieve similar desirable features: flexible learning, speed, and efficiency. Temporal neural networks (TNNs) are…

Neural and Evolutionary Computing · Computer Science 2021-02-24 James E. Smith

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Fault diagnosis of rotating machinery is an important engineering problem. In recent years, fault diagnosis methods based on the Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) have been mature, but Transformer has not…

Computational Engineering, Finance, and Science · Computer Science 2021-08-31 Yuhong Jin , Lei Hou , Yushu Chen

\textit{Graph neural networks} (GNNs) are effective models for many dynamical systems consisting of entities and relations. Although most GNN applications assume a single type of entity and relation, many situations involve multiple types…

Machine Learning · Computer Science 2023-10-12 Ferran Alet , Erica Weng , Tomás Lozano Pérez , Leslie Pack Kaelbling

Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these…

Machine Learning · Computer Science 2018-04-20 Guokun Lai , Wei-Cheng Chang , Yiming Yang , Hanxiao Liu

In recent years, Deep Learning has been successfully applied to multimodal learning problems, with the aim of learning useful joint representations in data fusion applications. When the available modalities consist of time series data such…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Xitong Yang , Palghat Ramesh , Radha Chitta , Sriganesh Madhvanath , Edgar A. Bernal , Jiebo Luo

Diagnosis and prediction in some domains, like medical and industrial diagnosis, require a representation that combines uncertainty management and temporal reasoning. Based on the fact that in many cases there are few state changes in the…

Artificial Intelligence · Computer Science 2013-01-30 Gustavo Arroyo-Figueroa , Luis Enrique Sucar

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Lichao Mou , Lorenzo Bruzzone , Xiao Xiang Zhu

Time Series Anomaly Detection (TSAD) finds widespread applications across various domains such as financial markets, industrial production, and healthcare. Its primary objective is to learn the normal patterns of time series data, thereby…

Machine Learning · Computer Science 2024-07-01 Yutong Chen , Hongzuo Xu , Guansong Pang , Hezhe Qiao , Yuan Zhou , Mingsheng Shang

Adaptive gating plays a key role in temporal data processing via classical recurrent neural networks (RNN), as it facilitates retention of past information necessary to predict the future, providing a mechanism that preserves invariance to…

Quantum Physics · Physics 2023-06-12 Ivana Nikoloska , Osvaldo Simeone , Leonardo Banchi , Petar Veličković

In time-series analysis, nonlinear temporal misalignment remains a pivotal challenge that forestalls even simple averaging. Since its introduction, the Diffeomorphic Temporal Alignment Net (DTAN), which we first introduced (Weber et al.,…

Machine Learning · Computer Science 2025-02-11 Ron Shapira Weber , Oren Freifeld

Temporal networks have been widely used to model real-world complex systems such as financial systems and e-commerce systems. In a temporal network, the joint neighborhood of a set of nodes often provides crucial structural information…

Machine Learning · Computer Science 2022-12-02 Yuhong Luo , Pan Li

Modern deep learning science often assumes that neural networks learn from a fixed data distribution. However, many practically important learning problems involve data distributions that change throughout training. How does such…

Machine Learning · Computer Science 2026-05-19 Afiq Abdillah Effiezal Aswadi , Oliver Britton , Ross Baker , Matthew Farrugia-Roberts

Time series analysis is critical for emerging net- work intelligent control and management functions. However, existing statistical-based and shallow machine learning models have shown limited prediction capabilities on multivariate time…

Machine Learning · Computer Science 2026-03-13 Yufeng Xin , Ethan Fan

Learning temporal interaction networks(TIN) is previously regarded as a coarse-grained multi-sequence prediction problem, ignoring the network topology structure influence. This paper addresses this limitation and a Deep Graph Neural Point…

Machine Learning · Computer Science 2025-08-20 Su Chen , Xiaohua Qi , Xixun Lin , Yanmin Shang , Xiaolin Xu , Yangxi Li

Transfer learning for deep neural networks is the process of first training a base network on a source dataset, and then transferring the learned features (the network's weights) to a second network to be trained on a target dataset. This…

Machine Learning · Computer Science 2019-01-29 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller

With the increase of available time series data, predicting their class labels has been one of the most important challenges in a wide range of disciplines. Recent studies on time series classification show that convolutional neural…

Machine Learning · Computer Science 2021-04-07 Dongha Lee , Seonghyeon Lee , Hwanjo Yu

Quantifying the structural and functional differences of temporal networks is a fundamental and challenging problem in the era of big data. This work proposes a temporal dissimilarity measure for temporal network comparison based on the…

Social and Information Networks · Computer Science 2021-11-03 Xiu-Xiu Zhan , Chuang Liu , Zhipeng Wang , Huijuang Wang , Petter Holme , Zi-Ke Zhang

There is a need to build intelligence in operating machinery and use data analysis on monitored signals in order to quantify the health of the operating system and self-diagnose any initiations of fault. Built-in control procedures can…

Signal Processing · Electrical Eng. & Systems 2020-06-18 G. Zhang , A. R. Singer , N. Vlahopoulos