English
Related papers

Related papers: PFformer: A Position-Free Transformer Variant for …

200 papers

Multivariate time-series forecasting holds immense value across diverse applications, requiring methods to effectively capture complex temporal and inter-variable dynamics. A key challenge lies in uncovering the intrinsic patterns that…

Machine Learning · Computer Science 2025-03-12 Liang Yu , Lai Tu , Xiang Bai

Multivariate time series forecasting (MTSF) is a fundamental problem in numerous real-world applications. Recently, Transformer has become the de facto solution for MTSF, especially for the long-term cases. However, except for the one…

Machine Learning · Computer Science 2022-12-07 Zanwei Zhou , Ruizhe Zhong , Chen Yang , Yan Wang , Xiaokang Yang , Wei Shen

In the realm of time series forecasting (TSF), it is imperative for models to adeptly discern and distill hidden patterns within historical time series data to forecast future states. Transformer-based models exhibit formidable efficacy in…

Machine Learning · Computer Science 2024-04-30 Zihan Wang , Fanheng Kong , Shi Feng , Ming Wang , Xiaocui Yang , Han Zhao , Daling Wang , Yifei Zhang

Accurate forecasting of solar power output is essential for efficient integration of renewable energy into the grid. In this study, an attention-based deep learning model, inspired by transformer architecture, is used for short-term solar…

Machine Learning · Computer Science 2026-04-28 Ankan Basu , Jyotiraditya Roy , Aditya Datta , Prayas Sanyal , Sumanta Banerjee

Foundation models (FMs) have transformed natural language processing, but their success has not yet translated to time series forecasting. Existing time series foundation models (TSFMs), often based on transformer variants, struggle with…

Machine Learning · Computer Science 2025-08-20 Lars Graf , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

In order to enhance the performance of Transformer models for long-term multivariate forecasting while minimizing computational demands, this paper introduces the Joint Time-Frequency Domain Transformer (JTFT). JTFT combines time and…

Machine Learning · Computer Science 2023-10-31 Yushu Chen , Shengzhuo Liu , Jinzhe Yang , Hao Jing , Wenlai Zhao , Guangwen Yang

Time series forecasting is a key component in many industrial and business decision processes and recurrent neural network (RNN) based models have achieved impressive progress on various time series forecasting tasks. However, most of the…

Machine Learning · Computer Science 2021-01-26 Zekai Chen , Jiaze E , Xiao Zhang , Hao Sheng , Xiuzheng Cheng

Task embeddings in multi-layer perceptrons for multi-task learning and inductive transfer learning in renewable power forecasts have recently been introduced. In many cases, this approach improves the forecast error and reduces the required…

Machine Learning · Computer Science 2022-05-02 Jens Schreiber , Stephan Vogt , Bernhard Sick

In Internet of things (IoT), data is continuously recorded from different data sources and devices can suffer faults in their embedded electronics, thus leading to a high-dimensional data sets and concept drift events. Therefore, methods…

Machine Learning · Computer Science 2021-07-22 Hugo Vinicius Bitencourt , Frederico Gadelha Guimarães

Recently, Transformer-base models have made significant progress in the field of time series prediction which have achieved good results and become baseline models beyond Dlinear. The paper proposes an U-Net time series prediction model…

Machine Learning · Computer Science 2024-06-07 Li Chu , Xiao Bingjia , Yuan Qiping

Accurate traffic forecasting is essential for intelligent transportation systems, supporting a wide range of real-world applications. However, it remains challenging due to two key factors:~(1) Traffic series contain heterogeneous temporal…

Artificial Intelligence · Computer Science 2026-05-26 Ruiwen Gu , Qitai Tan , Yahao Liu , Xiao-Ping Zhang

Accurate univariate forecasting remains a pressing need in real-world systems, such as energy markets, hydrology, retail demand, and IoT monitoring, where signals are often intermittent and horizons span both short- and long-term. While…

Machine Learning · Computer Science 2025-08-26 Kyrylo Yemets , Mykola Lukashchuk , Ivan Izonin

Recently, there has been a growing interest in Long-term Time Series Forecasting (LTSF), which involves predicting long-term future values by analyzing a large amount of historical time-series data to identify patterns and trends. There…

Machine Learning · Computer Science 2026-02-17 Aitian Ma , Dongsheng Luo , Mo Sha

Accurate weather forecasting is crucial in various sectors, impacting decision-making processes and societal events. Data-driven approaches based on machine learning models have recently emerged as a promising alternative to numerical…

Machine Learning · Computer Science 2024-05-14 Zijie Li , Anthony Zhou , Saurabh Patil , Amir Barati Farimani

Transformer-based models, despite their promise for long-term time series forecasting (LTSF), suffer from an inherent low-pass filtering effect that limits their effectiveness. This issue arises due to undifferentiated propagation of…

Machine Learning · Computer Science 2026-01-23 Jingjing Bai , Yoshinobu Kawahara

Multivariate time-series analysis involves extracting informative representations from sequences of multiple interdependent variables, supporting tasks such as forecasting, imputation, and anomaly detection. In real-world scenarios, these…

Machine Learning · Computer Science 2026-05-19 Israel Zexer , Omri Azencot

Photovoltaic (PV) power forecasting plays a crucial role in optimizing the operation and planning of PV systems, thereby enabling efficient energy management and grid integration. However, un certainties caused by fluctuating weather…

Machine Learning · Computer Science 2024-06-07 Jiaxin Gao , Qinglong Cao , Yuntian Chen , Dongxiao Zhang

Transformers have gained increasing popularity in a wide range of applications, including Natural Language Processing (NLP), Computer Vision and Speech Recognition, because of their powerful representational capacity. However, harnessing…

Transformer-based models have shown strong performance in time-series forecasting by leveraging self-attention to model long-range temporal dependencies. However, their effectiveness depends critically on the quality and structure of input…

Machine Learning · Computer Science 2026-02-11 Saurish Nagrath , Saroj Kumar Panigrahy

Extrapolating future weather radar echoes from past observations is a complex task vital for precipitation nowcasting. The spatial morphology and temporal evolution of radar echoes exhibit a certain degree of correlation, yet they also…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Liangyu Xu , Wanxuan Lu , Hongfeng Yu , Fanglong Yao , Xian Sun , Kun Fu
‹ Prev 1 8 9 10 Next ›