English
Related papers

Related papers: Beyond Data Scarcity: A Frequency-Driven Framework…

200 papers

The ability to forecast far into the future is highly beneficial to many applications, including but not limited to climatology, energy consumption, and logistics. However, due to noise or measurement error, it is questionable how far into…

Machine Learning · Computer Science 2022-05-26 Fan-Keng Sun , Duane S. Boning

Time series forecasting drives operational decisions in areas like finance, transportation, and energy. While supervised learning approaches achieve strong performance, they require domain-specific training, feature engineering, and ongoing…

Machine Learning · Computer Science 2026-05-26 Kavin Soni , Debanshu Das , Vamshi Guduguntla

Despite the rapid expansion of smart grids and large volumes of data at the individual consumer level, there are still various cases where adequate data collection to train accurate load forecasting models is challenging or even impossible.…

Foundation Models are designed to serve as versatile embedding machines, with strong zero shot capabilities and superior generalization performance when fine-tuned on diverse downstream tasks. While this is largely true for language and…

Machine Learning · Computer Science 2025-10-08 Nouha Karaouli , Denis Coquenet , Elisa Fromont , Martial Mermillod , Marina Reyboz

The diversity of time series applications and scarcity of domain-specific data highlight the need for time-series models with strong few-shot learning capabilities. In this work, we propose a novel training scheme and a transformer-based…

Machine Learning · Computer Science 2025-02-25 Ege Onur Taga , M. Emrullah Ildiz , Samet Oymak

Diffusion and flow-based models have enabled significant progress in generation tasks across various modalities and have recently found applications in predictive learning. However, unlike typical generation tasks that encourage sample…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu Zhang , Xingzhuo Guo , Haoran Xu , Jialong Wu , Mingsheng Long

Mining time-frequency features is critical for time series forecasting. Existing research has predominantly focused on modeling low-frequency patterns, where most time series energy is concentrated. The overlooking of mid to high frequency…

Machine Learning · Computer Science 2026-03-11 Boya Zhang , Shuaijie Yin , Huiwen Zhu , Xing He

Time series foundation models (TSFMs) have become increasingly popular for zero-shot forecasting. However, for a new time series domain not fully covered by the pretraining set, performance can suffer. Therefore, when a practitioner cares…

Machine Learning · Computer Science 2026-03-04 Thomas L. Lee , Edoardo M. Ponti , Amos Storkey

Synthetic data can improve generalization when real data is scarce, but excessive reliance may introduce distributional mismatches that degrade performance. In this paper, we present a learning-theoretic framework to quantify the trade-off…

Machine Learning · Statistics 2026-04-02 Amitis Shidani , Tyler Farghly , Yang Sun , Habib Ganjgahi , George Deligiannidis

Offline reinforcement learning (RL) offers a promising framework for training agents using pre-collected datasets without the need for further environment interaction. However, policies trained on offline data often struggle to generalise…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ahmet H. Güzel , Ilija Bogunovic , Jack Parker-Holder

One of the limiting factors in training data-driven, rare-event prediction algorithms is the scarcity of the events of interest resulting in an extreme imbalance in the data. There have been many methods introduced in the literature for…

Machine Learning · Computer Science 2021-05-18 Yang Chen , Dustin J. Kempton , Azim Ahmadzadeh , Rafal A. Angryk

Data generation-based zero-shot learning, although effective in training Small Task-specific Models (STMs) via synthetic datasets generated by Pre-trained Language Models (PLMs), is often limited by the low quality of such synthetic…

Computation and Language · Computer Science 2024-06-19 Tianyuan Zou , Yang Liu , Peng Li , Jianqing Zhang , Jingjing Liu , Ya-Qin Zhang

Synthetic training data has gained prominence in numerous learning tasks and scenarios, offering advantages such as dataset augmentation, generalization evaluation, and privacy preservation. Despite these benefits, the efficiency of…

Machine Learning · Computer Science 2024-03-21 Jianhao Yuan , Jie Zhang , Shuyang Sun , Philip Torr , Bo Zhao

Distributed computing systems often consist of hundreds of nodes, executing tasks with different resource requirements. Efficient resource provisioning and task scheduling in such systems are non-trivial and require close monitoring and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-10 Paul J. Pritz , Daniel Perez , Kin K. Leung

Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard samples lack the flexibility to handle such a variety…

Machine Learning · Computer Science 2023-11-08 Zhijie Deng , Peng Cui , Jun Zhu

Forecast combinations have been widely applied in the last few decades to improve forecasting. Estimating optimal weights that can outperform simple averages is not always an easy task. In recent years, the idea of using time series…

Methodology · Statistics 2021-10-22 Yanfei Kang , Wei Cao , Fotios Petropoulos , Feng Li

The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution…

Computation and Language · Computer Science 2024-08-13 Ruibo Liu , Jerry Wei , Fangyu Liu , Chenglei Si , Yanzhe Zhang , Jinmeng Rao , Steven Zheng , Daiyi Peng , Diyi Yang , Denny Zhou , Andrew M. Dai

Data is vital in enabling machine learning models to advance research and practical applications in finance, where accurate and robust models are essential for investment and trading decision-making. However, real-world data is limited…

Machine Learning · Computer Science 2026-03-26 Jože M. Rožanec , Tina Žezlin , Laurentiu Vasiliu , Dunja Mladenić , Radu Prodan , Dumitru Roman

We present TimeFound, an encoder-decoder transformer-based time series foundation model for out-of-the-box zero-shot forecasting. To handle time series data from various domains, TimeFound employs a multi-resolution patching strategy to…

Machine Learning · Computer Science 2025-03-07 Congxi Xiao , Jingbo Zhou , Yixiong Xiao , Xinjiang Lu , Le Zhang , Hui Xiong

Financial time-series forecasting is critical for maintaining economic stability, guiding informed policymaking, and promoting sustainable investment practices. However, it remains challenging due to various underlying pattern shifts. These…

Machine Learning · Computer Science 2025-08-28 Zhuohang Zhu , Haodong Chen , Qiang Qu , Vera Chung