English
Related papers

Related papers: TimeRFT: Stimulating Generalizable Time Series For…

200 papers

Time series forecasting is a subject of significant scientific and industrial importance. Despite the widespread utilization of forecasting methods, there is a dearth of research aimed at comprehending the conditions under which these…

Machine Learning · Computer Science 2024-10-23 Moisés Santos , André de Carvalho , Carlos Soares

Transfer learning has become a popular task adaptation method in the era of foundation models. However, many foundation models require large storage and computing resources, which makes off-the-shelf deployment impractical. Post-training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jung Hwan Heo , Seyedarmin Azizi , Arash Fayyazi , Massoud Pedram

Time series are generated in diverse domains such as economic, traffic, health, and energy, where forecasting of future values has numerous important applications. Not surprisingly, many forecasting methods are being proposed. To ensure…

Long-term time series forecasting (LTSF) remains challenging due to the trade-off between parallel efficiency and sequential modeling of temporal coherence. Direct multi-step forecasting (DMS) methods enable fast, parallel prediction of all…

Machine Learning · Computer Science 2026-02-03 Sunho Kim , Susik Yoon

Foundational Models are an emerging widely used technique of GenAI. These models are distinguished by their scalability and the ease with which they can be adapted through the exploitation of Transfer Learning. The availability of high…

Machine Learning · Computer Science 2025-05-13 M. Germán-Morales , A. J. Rivera-Rivas , M. J. del Jesus Díaz , C. J. Carmona

The power of foundation models (FMs) lies in their capacity to learn highly expressive representations that can be adapted to a broad spectrum of tasks. However, these pretrained models require additional training stages to become effective…

Machine Learning · Computer Science 2025-10-24 Jacob L. Block , Sundararajan Srinivasan , Liam Collins , Aryan Mokhtari , Sanjay Shakkottai

Image-based reinforcement learning (RL) faces significant challenges in generalization when the visual environment undergoes substantial changes between training and deployment. Under such circumstances, learned policies may not perform…

Robotics · Computer Science 2024-07-25 Weiyao Wang , Xinyuan Fang , Gregory D. Hager

Time series forecasting (TSF) plays a critical role in decision-making for many real-world applications. Recently, LLM-based forecasters have made promising advancements. Despite their effectiveness, existing methods often lack explicit…

Machine Learning · Computer Science 2026-02-04 Xiaoyu Tao , Mingyue Cheng , Ze Guo , Shuo Yu , Yaguo Liu , Qi Liu , Shijin Wang

Point cloud foundation models demonstrate strong generalization, yet adapting them to downstream tasks remains challenging in low-data regimes. Full fine-tuning often leads to overfitting and significant drift from pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Sneha Paul , Zachary Patterson , Nizar Bouguila

Supervised fine-tuning (SFT) on domain-specific data is the dominant approach for adapting foundation models to specialized tasks. However, it has been observed that SFT models tend to forget knowledge acquired during pretraining. In vision…

Artificial Intelligence · Computer Science 2025-06-03 Yifan Hao , Xingyuan Pan , Hanning Zhang , Chenlu Ye , Rui Pan , Tong Zhang

Time series forecasting serves as an essential tool for many real-world applications, supporting tasks such as resource optimization and decision-making. Despite significant architectural advancements, most modern models still treat…

Machine Learning · Computer Science 2026-05-12 Sheng Pan , Ming Jin , Bo Du , Shirui Pan

Time series analysis plays a critical role in numerous applications, supporting tasks such as forecasting, classification, anomaly detection, and imputation. In this work, we present the time series pattern machine (TSPM), a model designed…

Machine Learning · Computer Science 2025-05-20 Shiyu Wang , Jiawei Li , Xiaoming Shi , Zhou Ye , Baichuan Mo , Wenze Lin , Shengtong Ju , Zhixuan Chu , Ming Jin

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of…

Machine Learning · Computer Science 2025-09-22 Qi Xiong , Kai Tang , Minbo Ma , Ji Zhang , Jie Xu , Tianrui Li

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

Foundation models (FMs) have opened new avenues for machine learning applications due to their ability to adapt to new and unseen tasks with minimal or no further training. Time-series foundation models (TSFMs) -- FMs trained on time-series…

Machine Learning · Computer Science 2025-12-02 Hetvi Shastri , Pragya Sharma , Walid A. Hanafy , Mani Srivastava , Prashant Shenoy

Driven by the transition towards a climate-neutral energy system, accurate energy time series forecasting is critical for planning and operation. Yet, it remains largely a dataset-specific task, requiring comprehensive training data,…

Machine Learning · Computer Science 2026-04-27 Marco Obermeier , Marco Pruckner , Florian Haselbeck , Andreas Zeiselmair

Analyzing time series data is crucial to a wide spectrum of applications, including economics, online marketplaces, and human healthcare. In particular, time series classification plays an indispensable role in segmenting different phases…

Machine Learning · Computer Science 2025-05-12 Xiwen Chen , Wenhui Zhu , Peijie Qiu , Hao Wang , Huayu Li , Zihan Li , Yalin Wang , Aristeidis Sotiras , Abolfazl Razi

Time-series forecasting models (TSFM) have evolved from classical statistical methods to sophisticated foundation models, yet understanding why and when these models succeed or fail remains challenging. Despite this known limitation, time…

Machine Learning · Computer Science 2025-08-29 Michael Widener , Kausik Lakkaraju , John Aydin , Biplav Srivastava

Large language models (LLMs) excel at mathematical reasoning and logical problem-solving. The current popular training paradigms primarily use supervised fine-tuning (SFT) and reinforcement learning (RL) to enhance the models' reasoning…

Machine Learning · Computer Science 2025-08-05 Jack Chen , Fazhong Liu , Naruto Liu , Yuhan Luo , Erqu Qin , Harry Zheng , Tian Dong , Haojin Zhu , Yan Meng , Xiao Wang

Diffusion models, initially developed for image synthesis, demonstrate remarkable generative capabilities. Recently, their application has expanded to time series forecasting (TSF), yielding promising results. Existing surveys on time…

Machine Learning · Statistics 2025-09-03 Chen Su , Zhengzhou Cai , Yuanhe Tian , Zhuochao Chang , Zihong Zheng , Yan Song