English
Related papers

Related papers: Advancing Long-Term Multi-Energy Load Forecasting …

200 papers

Transformer-based time series foundation models face a fundamental trade-off in choice of tokenization: point-wise embeddings preserve temporal fidelity but scale poorly with sequence length, whereas fixed-length patching improves…

Artificial Intelligence · Computer Science 2026-03-13 Sravan Kumar Ankireddy , Nikita Seleznev , Nam H. Nguyen , Yulun Wu , Senthil Kumar , Furong Huang , C. Bayan Bruss

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build entropy models upon…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Yichen Qian , Ming Lin , Xiuyu Sun , Zhiyu Tan , Rong Jin

Multivariate Long Sequence Time-series Forecasting (LSTF) has been a critical task across various real-world applications. Recent advancements focus on the application of transformer architectures attributable to their ability to capture…

Machine Learning · Computer Science 2024-11-19 Shubham Tanaji Kakde , Rony Mitra , Jasashwi Mandal , Manoj Kumar Tiwari

Time series forecasting plays a vital role across scientific, industrial, and environmental domains, especially when dealing with high-dimensional and nonlinear systems. While Transformer-based models have recently achieved state-of-the-art…

Machine Learning · Computer Science 2025-08-05 Ali Forootani , Mohammad Khosravi , Masoud Barati

The Transformer architecture yields state-of-the-art results in many tasks such as natural language processing (NLP) and computer vision (CV), since the ability to efficiently capture the precise long-range dependency coupling between input…

Machine Learning · Computer Science 2023-01-06 Peiwang Tang , Xianchao Zhang

AI-based methods have been widely applied to tourism demand forecasting. However, current AI-based methods are short of the ability to process long-term dependency, and most of them lack interpretability. The Transformer used initially for…

Machine Learning · Computer Science 2021-07-26 Siyuan Yi , Xing Chen , Chuanming Tang

Transformers have recently gained popularity in time series forecasting due to their ability to capture long-term dependencies. However, many existing models focus only on capturing temporal dependencies while omitting intricate…

Machine Learning · Computer Science 2025-05-26 Donghwa Shin , Edwin Zhang

Long-short range time series forecasting is essential for predicting future trends and patterns over extended periods. While deep learning models such as Transformers have made significant strides in advancing time series forecasting, they…

Machine Learning · Computer Science 2024-09-16 Wenqing Zhang , Junming Huang , Ruotong Wang , Changsong Wei , Wenqian Huang , Yuxin Qiao

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

In the manufacturing process, sensor data collected from equipment is crucial for building predictive models to manage processes and improve productivity. However, in the field, it is challenging to gather sufficient data to build robust…

Machine Learning · Computer Science 2024-07-10 Gyeong Taek Lee , Oh-Ran Kwon

Time series data is ubiquitous in research as well as in a wide variety of industrial applications. Effectively analyzing the available historical data and providing insights into the far future allows us to make effective decisions. Recent…

Machine Learning · Computer Science 2022-10-24 Kiran Madhusudhanan , Johannes Burchert , Nghia Duong-Trung , Stefan Born , Lars Schmidt-Thieme

Accurate building load forecasting plays a critical role in facilitating demand response aggregation and optimizing energy management. However, the complex temporal dependencies and high volatility of building loads limit the improvement of…

Computational Engineering, Finance, and Science · Computer Science 2026-04-16 Hang Fan , Ying Lu , Weican Liu , Dunnan Liu , Xiaotao Chen , Shengwei Mei

Time series forecasting is a critical task across domains such as energy, finance, and meteorology, where accurate predictions enable informed decision-making. While transformer-based and large-parameter models have recently achieved…

Machine Learning · Computer Science 2026-02-11 Julien Guité-Vinet , Alexandre Blondin Massé , Éric Beaudry

When solving forecasting problems including multiple time-series features, existing approaches often fall into two extreme categories, depending on whether to utilize inter-feature information: univariate and complete-multivariate models.…

Artificial Intelligence · Computer Science 2024-08-20 Jaehoon Lee , Hankook Lee , Sungik Choi , Sungjun Cho , Moontae Lee

Time series forecasting is important in many fields that require accurate predictions for decision-making. Patching techniques, commonly used and effective in time series modeling, help capture temporal dependencies by dividing the data…

Machine Learning · Computer Science 2026-02-03 Xiangfei Qiu , Xvyuan Liu , Tianen Shen , Xingjian Wu , Hanyin Cheng , Bin Yang , Jilin Hu

Precise load forecasting in buildings could increase the bill savings potential and facilitate optimized strategies for power generation planning. With the rapid evolution of computer science, data-driven techniques, in particular the Deep…

Machine Learning · Computer Science 2023-01-30 Menna Nawar , Moustafa Shomer , Samy Faddel , Huangjie Gong

In the domain of multivariate forecasting, transformer models stand out as powerful apparatus, displaying exceptional capabilities in handling messy datasets from real-world contexts. However, the inherent complexity of these datasets,…

Machine Learning · Computer Science 2024-03-08 Jingjing Xu , Caesar Wu , Yuan-Fang Li , Pascal Bouvry