中文
相关论文

相关论文: SEMPO: Lightweight Foundation Models for Time Seri…

200 篇论文

Advances in time-series forecasting are driving a shift from conventional machine learning models to foundation models (FMs) that are trained with generalized knowledge. However, existing FMs still perform poorly in the energy fields, such…

机器学习 · 计算机科学 2024-12-24 Rui Liang , Yang Deng , Donghua Xie , Fang He , Dan Wang

The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the performance of Time…

机器学习 · 计算机科学 2025-07-15 Sami Achour , Yassine Bouher , Duong Nguyen , Nicolas Chesneau

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Spatio-temporal forecasting is crucial in transportation, logistics, and supply chain management. However, current methods struggle with large, complex datasets. We propose a dynamic, multi-modal approach that integrates the strengths of…

机器学习 · 计算机科学 2024-08-27 Sagar Srinivas Sakhinana , Geethan Sannidhi , Chidaksh Ravuru , Venkataramana Runkana

Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying…

Following its success for vision and text, the "foundation model" (FM) paradigm -- pretraining large models on massive data, then fine-tuning on target tasks -- has rapidly expanded to domains in the sciences, engineering, healthcare, and…

机器学习 · 计算机科学 2025-03-24 Zongzhe Xu , Ritvik Gupta , Wenduo Cheng , Alexander Shen , Junhong Shen , Ameet Talwalkar , Mikhail Khodak

Large time series foundation models often adopt channel-independent architectures to handle varying data dimensions, but this design ignores crucial cross-channel dependencies. Concurrently, existing multimodal approaches have not fully…

Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets to enable versatile downstream applications through finetuning, separating them from task-specific weather…

Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve strong performance, they require domain-specific training, feature engineering, and ongoing…

机器学习 · 计算机科学 2026-05-26 Kavin Soni , Debanshu Das , Vamshi Guduguntla

Foundation models (FMs) have transformed natural language processing, but their success has not yet translated to time series forecasting. Existing time series foundation models (TSFMs), often based on transformer variants, struggle with…

机器学习 · 计算机科学 2025-08-20 Lars Graf , Thomas Ortner , Stanisław Woźniak , Angeliki Pantazi

Expensive multi-objective optimization is a prevalent and crucial concern in many real-world scenarios, where sample-efficiency is vital due to the limited evaluations to recover the true Pareto front for decision making. Existing works…

机器学习 · 计算机科学 2026-02-03 Yiming Yao , Fei Liu , Liang Zhao , Xi Lin , Yilu Liu , Qingfu Zhang

Temporal non-stationarity, the phenomenon that time series distributions change over time, poses fundamental challenges to reliable time series forecasting. Intuitively, the complex time series can be decomposed into two factors, \ie…

机器学习 · 计算机科学 2025-10-21 Mingyuan Xia , Chunxu Zhang , Zijian Zhang , Hao Miao , Qidong Liu , Yuanshao Zhu , Bo Yang

Time series forecasting plays a significant role in finance, energy, meteorology, and IoT applications. Recent studies have leveraged the generalization capabilities of large language models (LLMs) to adapt to time series forecasting,…

机器学习 · 计算机科学 2026-05-12 Hao Liu , Xiaoxing Zhang , Chun Yang , Xiaobin Zhu

High-quality wind power forecasting is crucial for the operation of modern power grids. However, prevailing data-driven paradigms either train a site-specific model which cannot generalize to other locations or rely on fine-tuning of…

机器学习 · 计算机科学 2025-09-09 Hang Fan , Yu Shi , Zongliang Fu , Shuo Chen , Wei Wei , Wei Xu , Jian Li

Large pre-trained models have been vital in recent advancements in domains like language and vision, making model training for individual downstream tasks more efficient and provide superior performance. However, tackling time-series…

机器学习 · 计算机科学 2024-12-06 Harshavardhan Kamarthi , B. Aditya Prakash

This paper introduces a novel meta-learning algorithm for time series forecast model performance prediction. We model the forecast error as a function of time series features calculated from the historical time series with an efficient…

应用统计 · 统计学 2022-07-11 Thiyanga S. Talagala , Feng Li , Yanfei Kang

We present Tiny-TSM, a time series foundation model characterized by small scale, economical training, and state-of-the-art performance. It comprises 23M total parameters, trained on a single A100 GPU in less than a week using a new…

机器学习 · 计算机科学 2025-11-25 Felix Birkel

As a prominent data modality task, time series forecasting plays a pivotal role in diverse applications. With the remarkable advancements in Large Language Models (LLMs), the adoption of LLMs as the foundational architecture for time series…

机器学习 · 计算机科学 2025-07-10 Yiwen Liu , Chenyu Zhang , Junjie Song , Siqi Chen , Sun Yin , Zihan Wang , Lingming Zeng , Yuji Cao , Junming Jiao

Multi-task and few-shot time series forecasting tasks are commonly encountered in scenarios such as the launch of new products in different cities. However, traditional time series forecasting methods suffer from insufficient historical…

机器学习 · 计算机科学 2025-06-25 Pengpeng Ouyang , Dong Chen , Tong Yang , Shuo Feng , Zhao Jin , Mingliang Xu

Many scientific fields, from medicine to seismology, rely on analyzing sequences of events over time to understand complex systems. Traditionally, machine learning models must be built and trained from scratch for each new dataset, which is…

机器学习 · 计算机科学 2026-01-21 David Berghaus , Patrick Seifner , Kostadin Cvejoski , Ramses J. Sanchez