English
Related papers

Related papers: WPMixer: Efficient Multi-Resolution Mixing for Lon…

200 papers

Time series forecasting is a fundamental problem with applications in climate, energy, healthcare, and finance. Many existing approaches require domain-specific feature engineering and substantial labeled data for each task. We introduce…

Machine Learning · Computer Science 2026-01-29 Olaf Yunus Laitinen Imanov , Derya Umut Kulali , Taner Yilmaz

Time series is a special type of sequence data, a sequence of real-valued random variables collected at even intervals of time. The real-world multivariate time series comes with noises and contains complicated local and global temporal…

Machine Learning · Computer Science 2023-11-21 Site Mo , Haoxin Wang , Bixiong Li , Songhai Fan , Yuankai Wu , Xianggen Liu

Transformer-based time series foundation models face a fundamental trade-off in choice of tokenization: point-wise embeddings preserve temporal fidelity but scale poorly with sequence length, whereas fixed-length patching improves…

Artificial Intelligence · Computer Science 2026-03-13 Sravan Kumar Ankireddy , Nikita Seleznev , Nam H. Nguyen , Yulun Wu , Senthil Kumar , Furong Huang , C. Bayan Bruss

Time series forecasting attempts to predict future events by analyzing past trends and patterns. Although well researched, certain critical aspects pertaining to the use of deep learning in time series forecasting remain ambiguous. Our…

Machine Learning · Computer Science 2024-03-08 Kiran Madhusudhanan , Shayan Jawed , Lars Schmidt-Thieme

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

Time series forecasting is essential for many practical applications, with the adoption of transformer-based models on the rise due to their impressive performance in NLP and CV. Transformers' key feature, the attention mechanism,…

Machine Learning · Computer Science 2024-02-09 PeiSong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

Machine Learning · Computer Science 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Data augmentation is a crucial technique for improving model generalization and robustness, particularly in deep learning models where training data is limited. Although many augmentation methods have been developed for time series…

Machine Learning · Computer Science 2026-04-13 Jafar Bakhshaliyev , Johannes Burchert , Niels Landwehr , Lars Schmidt-Thieme

Time series forecasting has long been a focus of research across diverse fields, including economics, energy, healthcare, and traffic management. Recent works have introduced innovative architectures for time series models, such as the…

Machine Learning · Computer Science 2025-03-28 Young-Chae Hong , Bei Xiao , Yangho Chen

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

Time series forecasting has received wide interest from existing research due to its broad applications and inherent challenging. The research challenge lies in identifying effective patterns in historical series and applying them to future…

Machine Learning · Computer Science 2023-07-14 Tianlong Zhao , Xiang Ma , Xuemei Li , Caiming Zhang

Among the existing Transformer-based multivariate time series forecasting methods, iTransformer, which treats each variable sequence as a token and only explicitly extracts cross-variable dependencies, and PatchTST, which adopts a…

Machine Learning · Computer Science 2025-01-08 Liyang Qin , Xiaoli Wang , Chunhua Yang , Huaiwen Zou , Haochuan Zhang

Multivariate Time Series (MTS) forecasting involves modeling temporal dependencies within historical records. Transformers have demonstrated remarkable performance in MTS forecasting due to their capability to capture long-term…

Machine Learning · Computer Science 2024-07-17 Yifan Zhang , Rui Wu , Sergiu M. Dascalu , Frederick C. Harris

Real-world multivariate time series can exhibit intricate multi-scale structures, including global trends, local periodicities, and non-stationary regimes, which makes long-horizon forecasting challenging. Although sparse Mixture-of-Experts…

Machine Learning · Computer Science 2026-03-16 Evandro S. Ortigossa , Guy Lutsker , Eran Segal

Large collections of time series data are often organized into hierarchies with different levels of aggregation; examples include product and geographical groupings. Probabilistic coherent forecasting is tasked to produce forecasts…

Time series forecasting requires capturing patterns across multiple temporal scales while maintaining computational efficiency. This paper introduces AWGformer, a novel architecture that integrates adaptive wavelet decomposition with…

Machine Learning · Computer Science 2026-01-29 Wei Li

The recent trend in deep learning methods for 3D point cloud understanding is to propose increasingly sophisticated architectures either to better capture 3D geometries or by introducing possibly undesired inductive biases. Moreover, prior…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Davide Boscaini , Fabio Poiesi

Recently, MLP-like vision models have achieved promising performances on mainstream visual recognition tasks. In contrast with vision transformers and CNNs, the success of MLP-like models shows that simple information fusion operations…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ziyu Wang , Wenhao Jiang , Yiming Zhu , Li Yuan , Yibing Song , Wei Liu

Long-term time series forecasting (LTSF) is hampered by the challenge of modeling complex dependencies that span multiple temporal scales and frequency resolutions. Existing methods, including Transformer and MLP-based models, often…

Machine Learning · Computer Science 2025-09-22 Qianyang Li , Xingjun Zhang , Shaoxun Wang , Jia Wei

Time series forecasting has various applications, such as meteorological rainfall prediction, traffic flow analysis, financial forecasting, and operational load monitoring for various systems. Due to the sparsity of time series data,…

Machine Learning · Computer Science 2025-10-01 Xiaojian Wang , Chaoli Zhang , Zhonglong Zheng , Yunliang Jiang