English
Related papers

Related papers: Parallel Spatio-Temporal Attention-Based TCN for M…

200 papers

Quantum machine learning models for sequential data face scalability challenges with complex multivariate signals. We introduce the Hybrid Quantum Temporal Convolutional Network (HQTCN), which combines classical temporal windowing with a…

Machine Learning · Computer Science 2026-03-02 Junghoon Justin Park , Maria Pak , Sebin Lee , Samuel Yen-Chi Chen , Shinjae Yoo , Huan-Hsin Tseng , Jiook Cha

A major obstacle to building models for effective semantic segmentation, and particularly video semantic segmentation, is a lack of large and well annotated datasets. This bottleneck is particularly prohibitive in highly specialized and…

Predictive Coding (PC) is a biologically-inspired learning framework characterised by local, parallelisable operations, properties that enable energy-efficient implementation on neuromorphic hardware. Despite this, extending PC effectively…

Machine Learning · Computer Science 2026-02-23 Tom Potter , Oliver Rhodes

With the rising number of interconnected devices and sensors, modeling distributed sensor networks is of increasing interest. Recurrent neural networks (RNN) are considered particularly well suited for modeling sensory and streaming data.…

Machine Learning · Computer Science 2017-11-15 Stephan Baier , Sigurd Spieckermann , Volker Tresp

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

Machine Learning · Computer Science 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding…

Machine Learning · Computer Science 2024-05-24 Xin Cheng , Xiuying Chen , Shuqi Li , Di Luo , Xun Wang , Dongyan Zhao , Rui Yan

The recurrent neural network and its variants have shown great success in processing sequences in recent years. However, this deep neural network has not aroused much attention in anomaly detection through predictively process monitoring.…

Machine Learning · Computer Science 2023-09-06 Jiaqi Qiu , Yu Lin , Inez Zwetsloot

Multivariate time series forecasting is extensively studied throughout the years with ubiquitous applications in areas such as finance, traffic, environment, etc. Still, concerns have been raised on traditional methods for incapable of…

Machine Learning · Computer Science 2018-09-10 Yen-Yu Chang , Fan-Yun Sun , Yueh-Hua Wu , Shou-De Lin

Recurrent Neural Network (RNN) has been widely applied for sequence modeling. In RNN, the hidden states at current step are full connected to those at previous step, thus the influence from less related features at previous step may…

Computation and Language · Computer Science 2017-05-04 Danhao Zhu , Si Shen , Xin-Yu Dai , Jiajun Chen

We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important…

Computational Physics · Physics 2020-09-29 Ge Dong , Kyle Gerard Felker , Alexey Svyatkovskiy , William Tang , Julian Kates-Harbeck

Recurrent Neural Networks (RNNs) have become the state-of-the-art choice for extracting patterns from temporal sequences. However, current RNN models are ill-suited to process irregularly sampled data triggered by events generated in…

Machine Learning · Computer Science 2016-11-01 Daniel Neil , Michael Pfeiffer , Shih-Chii Liu

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

Graph Convolutional Networks (GCNs), which model skeleton data as graphs, have obtained remarkable performance for skeleton-based action recognition. Particularly, the temporal dynamic of skeleton sequence conveys significant information in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Jianan Li , Xuemei Xie , Zhifu Zhao , Yuhan Cao , Qingzhe Pan , Guangming Shi

Deep neural networks, especially transformer-based architectures, have achieved remarkable success in semantic segmentation for environmental perception. However, existing models process video frames independently, thus failing to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Serin Varghese , Kevin Ross , Fabian Hueger , Kira Maag

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

The recurrent neural networks (RNN) can be used to solve the sequence to sequence problem, where both the input and the output have sequential structures. Usually there are some implicit relations between the structures. However, it is hard…

Computer Vision and Pattern Recognition · Computer Science 2016-01-27 Feng Wang , David M. J. Tax

Time series forecasting lies at the core of important real-world applications in many fields of science and engineering. The abundance of large time series datasets that consist of complex patterns and long-term dependencies has led to the…

Machine Learning · Computer Science 2023-12-01 Nancy Xu , Chrysoula Kosma , Michalis Vazirgiannis

Time series data usually contains local and global patterns. Most of the existing feature networks pay more attention to local features rather than the relationships among them. The latter is, however, also important yet more difficult to…

Machine Learning · Computer Science 2021-01-01 Zhiwen Xiao , Xin Xu , Huanlai Xing , Shouxi Luo , Penglin Dai , Dawei Zhan

A variety of real-world processes (over networks) produce sequences of data whose complex temporal dynamics need to be studied. More especially, the event timestamps can carry important information about the underlying network dynamics,…

Machine Learning · Computer Science 2017-03-27 Shuai Xiao , Junchi Yan , Mehrdad Farajtabar , Le Song , Xiaokang Yang , Hongyuan Zha

Spatio-temporal prediction plays an important role in many application areas especially in traffic domain. However, due to complicated spatio-temporal dependency and high non-linear dynamics in road networks, traffic prediction task is…

Machine Learning · Computer Science 2019-03-05 Bing Yu , Mengzhang Li , Jiyong Zhang , Zhanxing Zhu