English
Related papers

Related papers: SeqFusion: Sequential Fusion of Pre-Trained Models…

200 papers

In-context learning, the ability of large language models to perform tasks using only examples provided in the prompt, has recently been adapted for time series forecasting. This paradigm enables zero-shot prediction, where past values…

Machine Learning · Computer Science 2025-11-04 Andreas Auer , Patrick Podest , Daniel Klotz , Sebastian Böck , Günter Klambauer , Sepp Hochreiter

Accurate and efficient temperature prediction is critical for optimizing the preheating process of PET preforms in industrial microwave systems prior to blow molding. We propose a novel deep learning framework for generalized temperature…

Machine Learning · Computer Science 2025-10-08 Ahmad Alsheikh , Andreas Fischer

Multi-horizon forecasting problems often contain a complex mix of inputs -- including static (i.e. time-invariant) covariates, known future inputs, and other exogenous time series that are only observed historically -- without any prior…

Machine Learning · Statistics 2020-09-29 Bryan Lim , Sercan O. Arik , Nicolas Loeff , Tomas Pfister

This work addresses the problem of analyzing multi-channel time series data %. In this paper, we by proposing an unsupervised fusion framework based on %the recently proposed convolutional transform learning. Each channel is processed by a…

Machine Learning · Computer Science 2020-11-10 Pooja Gupta , Jyoti Maggu , Angshul Majumdar , Emilie Chouzenoux , Giovanni Chierchia

Meta learning is a promising technique for solving few-shot fault prediction problems, which have attracted the attention of many researchers in recent years. Existing meta-learning methods for time series prediction, which predominantly…

Machine Learning · Computer Science 2023-11-07 Hai Su , Jiajun Hu , Songsen Yu

Time series forecasting is critical in numerous real-world applications, requiring accurate predictions of future values based on observed patterns. While traditional forecasting techniques work well in in-domain scenarios with ample data,…

Machine Learning · Computer Science 2024-11-26 Liran Nochumsohn , Michal Moshkovitz , Orly Avner , Dotan Di Castro , Omri Azencot

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

The application of data-driven remaining useful life (RUL) prediction has long been constrained by the availability of large amount of degradation data. Mainstream solutions such as domain adaptation and meta-learning still rely on large…

Machine Learning · Computer Science 2026-02-02 En Fu , Yanyan Hu , Changhua Hu , Zengwang Jin , Kaixiang Peng

In this study, we propose a novel SeqMF model to solve the problem of predicting the next app launch during mobile device usage. Although this problem can be represented as a classical collaborative filtering problem, it requires proper…

Time series forecasting plays a critical role in various real-world applications, including energy consumption prediction, disease transmission monitoring, and weather forecasting. Although substantial progress has been made in time series…

Machine Learning · Computer Science 2024-11-26 Wei Yuan , Guanhua Ye , Xiangyu Zhao , Quoc Viet Hung Nguyen , Yang Cao , Hongzhi Yin

Benefiting from prompt tuning, recent years have witnessed the promising performance of pre-trained vision-language models, e.g., CLIP, on versatile downstream tasks. In this paper, we focus on a particular setting of learning adaptive…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Chun-Mei Feng , Kai Yu , Yong Liu , Salman Khan , Wangmeng Zuo

With the growing interest in autonomous driving, there is an increasing demand for accurate and reliable road perception technologies. In complex environments without high-definition map support, autonomous vehicles must independently…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xuewei Tang , Mengmeng Yang , Tuopu Wen , Peijin Jia , Le Cui , Mingshang Luo , Kehua Sheng , Bo Zhang , Diange Yang , Kun Jiang

The proliferation of Time Series Foundation Models (TSFMs) has significantly advanced zero-shot forecasting, enabling predictions for unseen time series without task-specific fine-tuning. Extensive research has confirmed that no single TSFM…

Machine Learning · Computer Science 2025-09-26 Hao-Nan Shi , Ting-Ji Huang , Lu Han , De-Chuan Zhan , Han-Jia Ye

Small Earth data are geoscience observations with limited short-term monitoring variability, providing sparse but meaningful measurements, typically exhibiting spatiotemporal correlations. Spatiotemporal forecasting on such data is crucial…

Machine Learning · Computer Science 2025-10-13 Yuting Yang , Gang Mei , Zhengjing Ma , Nengxiong Xu , Jianbing Peng

Current operational air quality forecasts are computationally expensive, sensitive to errors in physics and emissions, and often neglect weather-related uncertainty. To address these limitations, we present AirFusion, a hybrid,…

Atmospheric and Oceanic Physics · Physics 2026-03-24 Ao Ding , Aoxing Zhang , Tzung-May Fu , Yuanlong Huang , Qianjie Chen , Yuyang Chen , Jiajia Mo , Wei Tao , Wai-Chi Cheng , Lei Zhu , Xin Yang , Guy Brasseur

Continual pre-training has demonstrated significant potential in enhancing model performance, particularly in domain-specific scenarios. The most common approach for packing data before continual pre-training involves concatenating input…

Computation and Language · Computer Science 2025-05-30 Ruicheng Yin , Xuan Gao , Changze Lv , Xiaohua Wang , Xiaoqing Zheng , Xuanjing Huang

The recent boom of large pre-trained models witnesses remarkable success in developing foundation models (FMs) for time series forecasting. Despite impressive performance across diverse downstream forecasting tasks, existing time series FMs…

Machine Learning · Computer Science 2025-10-23 Hui He , Kun Yi , Yuanchi Ma , Qi Zhang , Zhendong Niu , Guansong Pang

Spatio-temporal modeling is foundational for smart city applications, yet it is often hindered by data scarcity in many cities and regions. To bridge this gap, we propose a novel generative pre-training framework, GPD, for spatio-temporal…

Machine Learning · Computer Science 2024-03-26 Yuan Yuan , Chenyang Shao , Jingtao Ding , Depeng Jin , Yong Li

Financial time series forecasting in zero-shot settings is critical for investment decisions, especially during abrupt market regime shifts or in emerging markets with limited historical data. While Model-Agnostic Meta-Learning (MAML)…

Machine Learning · Computer Science 2025-08-04 Anxian Liu , Junying Ma , Guang Zhang

Time Series Forecasting (TSF) is key functionality in numerous fields, such as financial investment, weather services, and energy management. Although increasingly capable TSF methods occur, many of them require domain-specific data…

Machine Learning · Computer Science 2025-06-13 Zhe Li , Xiangfei Qiu , Peng Chen , Yihang Wang , Hanyin Cheng , Yang Shu , Jilin Hu , Chenjuan Guo , Aoying Zhou , Christian S. Jensen , Bin Yang