中文
相关论文

相关论文: Multi-Task Time Series Forecasting With Shared Att…

200 篇论文

As Transformer-based models have achieved impressive performance on various time series tasks, Long-Term Series Forecasting (LTSF) tasks have also received extensive attention in recent years. However, due to the inherent computational…

机器学习 · 计算机科学 2024-02-06 Daojun Liang , Haixia Zhang , Dongfeng Yuan , Xiaoyan Ma , Dongyang Li , Minggao Zhang

Transformer architecture has widespread applications, particularly in Natural Language Processing and computer vision. Recently Transformers have been employed in various aspects of time-series analysis. This tutorial provides an overview…

机器学习 · 计算机科学 2023-07-27 Sabeen Ahmed , Ian E. Nielsen , Aakash Tripathi , Shamoon Siddiqui , Ghulam Rasool , Ravi P. Ramachandran

Recently, the superiority of Transformer for long-term time series forecasting (LTSF) tasks has been challenged, particularly since recent work has shown that simple models can outperform numerous Transformer-based approaches. This suggests…

机器学习 · 计算机科学 2023-10-10 Shengsheng Lin , Weiwei Lin , Wentai Wu , Songbo Wang , Yongxiang Wang

Remaining useful life prediction plays a crucial role in the health management of industrial systems. Given the increasing complexity of systems, data-driven predictive models have attracted significant research interest. Upon reviewing the…

机器学习 · 计算机科学 2024-01-30 Zhixin Huang , Yujiang He , Bernhard Sick

Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction…

机器学习 · 计算机科学 2022-09-21 Hugo Inzirillo , Ludovic De Villelongue

We introduce the concept of multiple temporal perspectives, a novel approach applicable to Recurrent Neural Network (RNN) architectures for enhancing their understanding of sequential data. This method involves maintaining diverse temporal…

机器学习 · 计算机科学 2024-07-15 Razvan-Gabriel Dumitru , Darius Peteleaza , Mihai Surdeanu

Lane change (LC) is one of the safety-critical manoeuvres in highway driving according to various road accident records. Thus, reliably predicting such manoeuvre in advance is critical for the safe and comfortable operation of automated…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Sajjad Mozaffari , Eduardo Arnold , Mehrdad Dianati , Saber Fallah

The Transformer translation model is based on the multi-head attention mechanism, which can be parallelized easily. The multi-head attention network performs the scaled dot-product attention function in parallel, empowering the model by…

计算与语言 · 计算机科学 2021-09-13 Hongfei Xu , Qiuhui Liu , Josef van Genabith , Deyi Xiong

Multivariate time series is prevalent in many scientific and industrial domains. Modeling multivariate signals is challenging due to their long-range temporal dependencies and intricate interactions--both direct and indirect. To confront…

机器学习 · 计算机科学 2023-12-01 Juhyeon Kim , Hyungeun Lee , Seungwon Yu , Ung Hwang , Wooyul Jung , Miseon Park , Kijung Yoon

Multivariate time series (MTS) forecasting has attracted much attention in many intelligent applications. It is not a trivial task, as we need to consider both intra-variable dependencies and inter-variable dependencies. However, existing…

机器学习 · 计算机科学 2021-12-15 Donghui Chen , Ling Chen , Zongjiang Shang , Youdong Zhang , Bo Wen , Chenghu Yang

This study proposes a unified forecasting framework for high-dimensional multi-task time series to meet the prediction demands of cloud native backend systems operating under highly dynamic loads, coupled metrics, and parallel tasks. The…

机器学习 · 计算机科学 2025-12-25 Zixiao Huang , Jixiao Yang , Sijia Li , Chi Zhang , Jinyu Chen , Chengda Xu

Methods for time series prediction and classification of gene regulatory networks (GRNs) from gene expression data have been treated separately so far. The recent emergence of attention-based recurrent neural networks (RNN) models boosted…

Traffic time series forecasting is challenging due to complex spatio-temporal dynamics time series from different locations often have distinct patterns; and for the same time series, patterns may vary across time, where, for example, there…

机器学习 · 计算机科学 2022-04-06 Razvan-Gabriel Cirstea , Bin Yang , Chenjuan Guo , Tung Kieu , Shirui Pan

Predictive business process monitoring focuses on predicting future characteristics of a running process using event logs. The foresight into process execution promises great potentials for efficient operations, better resource management,…

机器学习 · 计算机科学 2021-04-05 Zaharah A. Bukhsh , Aaqib Saeed , Remco M. Dijkman

Multivariate long-term time series forecasting aims to predict future sequences by utilizing historical observations, with a core focus on modeling intra-sequence and cross-channel dependencies. Numerous studies have developed diverse…

机器学习 · 计算机科学 2026-02-03 Gaoxiang Zhao , Chunmao Huang , Li Zhou , Xiaoqiang Wang

Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However,…

机器学习 · 计算机科学 2021-02-26 Yujing Wang , Yaming Yang , Jiangang Bai , Mingliang Zhang , Jing Bai , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Multivariate time series (MTS) forecasting plays an important role in the automation and optimization of intelligent applications. It is a challenging task, as we need to consider both complex intra-variable dependencies and inter-variable…

机器学习 · 计算机科学 2023-04-11 Ling Chen , Donghui Chen , Zongjiang Shang , Binqing Wu , Cen Zheng , Bo Wen , Wei Zhang

Pretrained language models based on the transformer architecture have shown great success in NLP. Textual training data often comes from the web and is thus tagged with time-specific information, but most language models ignore this…

计算与语言 · 计算机科学 2022-05-05 Guy D. Rosin , Kira Radinsky

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

机器学习 · 计算机科学 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Time-series data in real-world settings typically exhibit long-range dependencies and are observed at non-uniform intervals. In these settings, traditional sequence-based recurrent models struggle. To overcome this, researchers often…

机器学习 · 统计学 2025-01-14 Fernando Moreno-Pino , Álvaro Arroyo , Harrison Waldon , Xiaowen Dong , Álvaro Cartea