English
Related papers

Related papers: SiamTST: A Novel Representation Learning Framework…

200 papers

Time series analysis is widely used in extensive areas. Recently, to reduce labeling expenses and benefit various tasks, self-supervised pre-training has attracted immense interest. One mainstream paradigm is masked modeling, which…

Machine Learning · Computer Science 2023-10-24 Jiaxiang Dong , Haixu Wu , Haoran Zhang , Li Zhang , Jianmin Wang , Mingsheng Long

Multivariate time series prediction has applications in a wide variety of domains and is considered to be a very challenging task, especially when the variables have correlations and exhibit complex temporal patterns, such as seasonality…

Machine Learning · Computer Science 2020-01-07 Yuya Jeremy Ong , Mu Qiao , Divyesh Jadav

In this study, we present aLLM4TS, an innovative framework that adapts Large Language Models (LLMs) for time-series representation learning. Central to our approach is that we reconceive time-series forecasting as a self-supervised,…

Machine Learning · Computer Science 2024-03-12 Yuxuan Bian , Xuan Ju , Jiangtong Li , Zhijian Xu , Dawei Cheng , Qiang Xu

Correlated time series analysis plays an important role in many real-world industries. Learning an efficient representation of this large-scale data for further downstream tasks is necessary but challenging. In this paper, we propose a…

Machine Learning · Computer Science 2023-06-21 Luxuan Wang , Lei Bai , Ziyue Li , Rui Zhao , Fugee Tsung

Autoregressive Recurrent Neural Networks are widely employed in time-series forecasting tasks, demonstrating effectiveness in univariate and certain multivariate scenarios. However, their inherent structure does not readily accommodate the…

Machine Learning · Computer Science 2024-04-30 Gareth Davies

Transformer-based models have achieved remarkable success in multivariate time series forecasting (MTSF) by capturing long-range dependencies. However, their widespread adoption is hindered by the quadratic computational complexity of…

Machine Learning · Computer Science 2026-05-12 Fanpu Cao , Shu Yang , Zhengjian Chen , Ye Liu , Laizhong Cui

Network traffic prediction techniques have attracted much attention since they are valuable for network congestion control and user experience improvement. While existing prediction techniques can achieve favorable performance when there is…

Networking and Internet Architecture · Computer Science 2025-05-29 Hui Ma , Kai Yang

Although spatio-temporal graph neural networks have achieved great empirical success in handling multiple correlated time series, they may be impractical in some real-world scenarios due to a lack of sufficient high-quality training data.…

Signal Processing · Electrical Eng. & Systems 2021-02-10 Chao Pan , Siheng Chen , Antonio Ortega

In recent years, there has been a rapid development of spatio-temporal prediction techniques in response to the increasing demands of traffic management and travel planning. While advanced end-to-end models have achieved notable success in…

Machine Learning · Computer Science 2023-11-09 Zhonghang Li , Lianghao Xia , Yong Xu , Chao Huang

This work contributes to the development of neural forecasting models with novel randomization-based learning methods. These methods improve the fitting abilities of the neural model, in comparison to the standard method, by generating…

Machine Learning · Computer Science 2021-07-06 Grzegorz Dudek

Prediction based on Irregularly Sampled Time Series (ISTS) is of wide concern in the real-world applications. For more accurate prediction, the methods had better grasp more data characteristics. Different from ordinary time series, ISTS is…

Machine Learning · Computer Science 2021-05-04 Chenxi Sun , Shenda Hong , Moxian Song , Yanxiu Zhou , Yongyue Sun , Derun Cai , Hongyan Li

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Forecasting complex time series is an important yet challenging problem that involves various industrial applications. Recently, masked time-series modeling has been proposed to effectively model temporal dependencies for forecasting by…

Machine Learning · Computer Science 2025-07-02 Hyunwoo Seo , Chiehyeon Lim

Spatio-temporal (ST) data, which represent multiple time series data corresponding to different spatial locations, are ubiquitous in real-world dynamic systems, such as air quality readings. Forecasting over ST data is of great importance…

Machine Learning · Computer Science 2018-10-01 Zheyi Pan , Yuxuan Liang , Junbo Zhang , Xiuwen Yi , Yong Yu , Yu Zheng

Recent advances in deep forecasting models have achieved remarkable performance, yet most approaches still struggle to provide both accurate predictions and interpretable insights into temporal dynamics. This paper proposes CaReTS, a novel…

Machine Learning · Computer Science 2025-11-14 Fulong Yao , Wanqing Zhao , Chao Zheng , Xiaofei Han

High-resolution time-frequency (TF) analysis plays crucial role in characterizing multicomponent signal (MCSs) and estimating oscillatory properties. Linear time-frequency representations (TFRs) such as classical short-time Fourier…

Signal Processing · Electrical Eng. & Systems 2023-12-12 Rayyan Abdalla

Spatio-temporal forecasting is crucial in many domains, such as transportation, meteorology, and energy. However, real-world scenarios frequently present challenges such as signal anomalies, noise, and distributional shifts. Existing…

Machine Learning · Computer Science 2025-10-30 Wei Chen , Yuxuan Liang

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Accurate forecasting of renewable energy generation is fundamental to enhancing the dynamic performance of modern power grids, especially under high renewable penetration. This paper presents Channel-Time Patch Time-Series Transformer…

Machine Learning · Computer Science 2026-01-23 Kuan Lu , Menghao Huo , Yuxiao Li , Qiang Zhu , Zhenrui Chen

Spatio-temporal forecasting is essential for real-world applications such as traffic management and urban computing. Although recent methods have shown improved accuracy, they often fail to account for dynamic deviations between current…

Machine Learning · Computer Science 2025-10-07 Haotian Gao , Zheng Dong , Jiawei Yong , Shintaro Fukushima , Kenjiro Taura , Renhe Jiang