English
Related papers

Related papers: WindowMixer: Intra-Window and Inter-Window Modelin…

200 papers

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

Computation and Language · Computer Science 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

Time series forecasting, which predicts future values from past observations, plays a central role in many domains and has driven the development of highly accurate neural network models. However, the complexity of these models often limits…

Machine Learning · Computer Science 2026-03-05 Hiroki Tomioka , Genta Yoshimura

Self-awareness is the key capability of autonomous systems, e.g., autonomous driving network, which relies on highly efficient time series forecasting algorithm to enable the system to reason about the future state of the environment, as…

Machine Learning · Computer Science 2023-05-18 Minh-Thanh Bui , Duc-Thinh Ngo , Demin Lu , Zonghua Zhang

Long-term time series forecasting (LTSF) involves predicting a large number of future values of a time series based on the past values. This is an essential task in a wide range of domains including weather forecasting, stock market…

Quantum Physics · Physics 2025-03-19 Hari Hara Suthan Chittoor , Paul Robert Griffin , Ariel Neufeld , Jayne Thompson , Mile Gu

Real-world time series often exhibit complex interdependencies that cannot be captured in isolation. Global models that model past data from multiple related time series globally while producing series-specific forecasts locally are now…

Machine Learning · Computer Science 2024-05-14 Abishek Sriramulu , Christoph Bergmeir , Slawek Smyl

Time series forecasting is a crucial task in machine learning, as it has a wide range of applications including but not limited to forecasting electricity consumption, traffic, and air quality. Traditional forecasting models rely on rolling…

Machine Learning · Computer Science 2021-10-22 Shereen Elsayed , Daniela Thyssens , Ahmed Rashed , Hadi Samer Jomaa , Lars Schmidt-Thieme

Long-term time series forecasting is a long-standing challenge in various applications. A central issue in time series forecasting is that methods should expressively capture long-term dependency. Furthermore, time series forecasting…

Machine Learning · Computer Science 2024-11-06 Xingyu Zhang , Siyu Zhao , Zeen Song , Huijie Guo , Jianqi Zhang , Changwen Zheng , Wenwen Qiang

Traditional solar flare forecasting approaches have mostly relied on physics-based or data-driven models using solar magnetograms, treating flare predictions as a point-in-time classification problem. This approach has limitations,…

Machine Learning · Computer Science 2024-09-10 Anli Ji , Chetraj Pandey , Berkay Aydin

Deep time series forecasting has emerged as a rapidly growing field in recent years. Despite the exponential growth of community interests, progress on standard benchmarks is often limited to marginal improvements. A common consensus of the…

Machine Learning · Computer Science 2026-05-05 Yuxuan Wang , Haixu Wu , Yuezhou Ma , Yuchen Fang , Ziyi Zhang , Yong Liu , Shiyu Wang , Zhou Ye , Yang Xiang , Jianmin Wang , Mingsheng Long

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

We introduce a temporal feature encoding architecture called Time Series Representation Model (TSRM) for multivariate time series forecasting and imputation. The architecture is structured around CNN-based representation layers, each…

Machine Learning · Computer Science 2025-04-29 Robert Leppich , Michael Stenger , Daniel Grillmeyer , Vanessa Borst , Samuel Kounev

Recently, Transformer-base models have made significant progress in the field of time series prediction which have achieved good results and become baseline models beyond Dlinear. The paper proposes an U-Net time series prediction model…

Machine Learning · Computer Science 2024-06-07 Li Chu , Xiao Bingjia , Yuan Qiping

In the manufacturing process, sensor data collected from equipment is crucial for building predictive models to manage processes and improve productivity. However, in the field, it is challenging to gather sufficient data to build robust…

Machine Learning · Computer Science 2024-07-10 Gyeong Taek Lee , Oh-Ran Kwon

Deep forecasting models often suffer from attenuated periodic perception and entangled trend-noise representations as network depth increases. Moreover, the widely adopted channel-independent paradigm, while improving training stability,…

Machine Learning · Computer Science 2026-05-19 Hua Wang , Xianhao Jiao , Fan Zhang

The performance of transformers for time-series forecasting has improved significantly. Recent architectures learn complex temporal patterns by segmenting a time-series into patches and using the patches as tokens. The patch size controls…

Machine Learning · Computer Science 2024-03-25 Yitian Zhang , Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Mark Coates

Time series prediction is crucial for understanding and forecasting complex dynamics in various domains, ranging from finance and economics to climate and healthcare. Based on Transformer architecture, one approach involves encoding…

Machine Learning · Computer Science 2024-05-24 Xin Cheng , Xiuying Chen , Shuqi Li , Di Luo , Xun Wang , Dongyan Zhao , Rui Yan

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Time series forecasting is vital in diverse sectors such as energy and transportation, where non-stationary dynamics are deeply intertwined with external events in other modalities such as texts. However, incorporating natural…

Machine Learning · Computer Science 2026-05-12 Yunfeng Ge , Ming Jin , Yiji Zhao , Hongyan Li , Bo Du , Chang Xu , Shirui Pan

Time series anomaly detection plays a crucial role in a wide range of real-world applications. Given that time series data can exhibit different patterns at different sampling granularities, multi-scale modeling has proven beneficial for…

Machine Learning · Computer Science 2025-10-15 Beibu Li , Qichao Shentu , Yang Shu , Hui Zhang , Ming Li , Ning Jin , Bin Yang , Chenjuan Guo