English
Related papers

Related papers: Generative Pretrained Hierarchical Transformer for…

200 papers

Anticipating supply chain disruptions before they materialize is a core challenge for firms and policymakers alike. A key difficulty is learning to reason reliably about infrequent, high-impact events from noisy and unstructured inputs - a…

Machine Learning · Computer Science 2026-04-03 Benjamin Turtel , Paul Wilczewski , Kris Skotheim

While collaborative forecasting on distributed time series is highly desirable, directly pooling localized datasets is often impractical due to data sharing constraints. Federated learning offers a promising alternative, yet conventional…

Machine Learning · Computer Science 2026-05-26 Yiming Zhou , Jiahao Wang , Mingyue Cheng , Hao Wang , Defu Lian , Enhong Chen

Multivariate time series forecasting plays a crucial role in various real-world applications. Significant efforts have been made to integrate advanced network architectures and training strategies that enhance the capture of temporal…

Machine Learning · Computer Science 2024-10-31 Zhiding Liu , Jiqian Yang , Qingyang Mao , Yuze Zhao , Mingyue Cheng , Zhi Li , Qi Liu , Enhong Chen

Time-series is ubiquitous across applications, such as transportation, finance and healthcare. Time-series is often influenced by external factors, especially in the form of asynchronous events, making forecasting difficult. However,…

Machine Learning · Computer Science 2021-02-02 Longyuan Li , Jihai Zhang , Junchi Yan , Yaohui Jin , Yunhao Zhang , Yanjie Duan , Guangjian Tian

Self-supervised Pretrained Models (PTMs) have demonstrated remarkable performance in computer vision and natural language processing tasks. These successes have prompted researchers to design PTMs for time series data. In our experiments,…

Large collections of time series data are commonly organized into structures with different levels of aggregation; examples include product and geographical groupings. It is often important to ensure that the forecasts are coherent so that…

Transformers have demonstrated impressive strength in long-term series forecasting. Existing prediction research mostly focused on mapping past short sub-series (lookback window) to future series (forecast window). The longer training…

Machine Learning · Computer Science 2023-02-22 Julong Young , Junhui Chen , Feihu Huang , Jian Peng

Automatic forecasting is the task of receiving a time series and returning a forecast for the next time steps without any human intervention. Gaussian Processes (GPs) are a powerful tool for modeling time series, but so far there are no…

Machine Learning · Statistics 2023-04-27 Giorgio Corani , Alessio Benavoli , Marco Zaffalon

We evaluated the capability of generative pre-trained transformers (GPT), to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. Discussions of potential uses (e.g., exercise generation,…

Artificial Intelligence · Computer Science 2023-10-11 Jaromir Savelka , Arav Agarwal , Christopher Bogart , Yifan Song , Majd Sakr

Time-series forecasting is a critical challenge in various domains and has witnessed substantial progress in recent years. Many real-life scenarios, such as public health, economics, and social applications, involve feedback loops where…

Machine Learning · Computer Science 2025-06-04 Zhiyuan Zhao , Haoxin Liu , Alexander Rodriguez , B. Aditya Prakash

Seasonal time series Forecasting remains a challenging problem due to the long-term dependency from seasonality. In this paper, we propose a two-stage framework to forecast univariate seasonal time series. The first stage explicitly learns…

Machine Learning · Computer Science 2021-06-08 Qingyang Xu , Qingsong Wen , Liang Sun

Time series forecasting always faces the challenge of concept drift, where data distributions evolve over time, leading to a decline in forecast model performance. Existing solutions are based on online learning, which continually organize…

Machine Learning · Computer Science 2025-12-19 Lifan Zhao , Yanyan Shen

Pre-trained models exhibit strong generalization to various downstream tasks. However, given the numerous models available in the model hub, identifying the most suitable one by individually fine-tuning is time-consuming. In this paper, we…

Machine Learning · Computer Science 2026-03-10 Tengxue Zhang , Biao Ouyang , Yang Shu , Xinyang Chen , Chenjuan Guo , Bin Yang

The rapid global expansion of solar photovoltaic (PV) capacity-reaching a record 597 GW in 2024-highlights the urgent need for robust forecasting models to mitigate the grid instability caused by the intermittent nature of solar irradiance.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Sumit Laha , Ankit Sharma , Hassan Foroosh

Time series forecasting plays a pivotal role in a wide range of applications, including weather prediction, healthcare, structural health monitoring, predictive maintenance, energy systems, and financial markets. While models such as LSTM,…

Machine Learning · Computer Science 2026-04-03 Qianying Cao , Shanqing Liu , Alan John Varghese , Jerome Darbon , Michael Triantafyllou , George Em Karniadakis

The forecasting of Multivariate Time Series (MTS) has long been an important but challenging task. Due to the non-stationary problem across long-distance time steps, previous studies primarily adopt stationarization method to attenuate the…

Machine Learning · Computer Science 2024-03-11 Muyao Wang , Wenchao Chen , Bo Chen

Trajectory prediction and planning are fundamental yet disconnected components in autonomous driving. Prediction models forecast surrounding agent motion under unknown intentions, producing multimodal distributions, while planning assumes…

Robotics · Computer Science 2026-02-04 Constantin Selzer , Fabina B. Flohr

Time series synthesis is an important research topic in the field of deep learning, which can be used for data augmentation. Time series data types can be broadly classified into regular or irregular. However, there are no existing…

Machine Learning · Computer Science 2022-10-12 Jinsung Jeon , Jeonghak Kim , Haryong Song , Seunghyeon Cho , Noseong Park

Geodetic time series -- such as Global Navigation Satellite System (GNSS) positions, satellite altimetry-derived sea surface height (SSH), and tide gauge (TG) records -- is essential for monitoring surface deformation and sea level change.…

A foundation model is a machine learning model trained on a large and diverse set of data, typically using self-supervised learning-based pre-training techniques, that can be adapted to various downstream tasks. However, current research on…