English
Related papers

Related papers: ForecastPFN: Synthetically-Trained Zero-Shot Forec…

200 papers

Recently, dataset-generation-based zero-shot learning has shown promising results by training a task-specific model with a dataset synthesized from large pre-trained language models (PLMs). The final task-specific model often achieves…

Computation and Language · Computer Science 2022-10-25 Jiacheng Ye , Jiahui Gao , Jiangtao Feng , Zhiyong Wu , Tao Yu , Lingpeng Kong

While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation from example data points remains a relatively underexplored and challenging problem. To this…

Machine Learning · Computer Science 2026-05-08 Tyler Ingebrand , Ruihan Zhao , Kushagra Gupta , David Fridovich-Keil , Sandeep P. Chinchali , Ufuk Topcu

In many areas of decision-making, forecasting is an essential pillar. Consequently, many different forecasting methods have been proposed. From our experience, recently presented forecasting methods are computationally intensive, poorly…

Machine Learning · Computer Science 2023-09-29 André Bauer , Mark Leznik , Michael Stenger , Robert Leppich , Nikolas Herbst , Samuel Kounev , Ian Foster

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. These models are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series…

Risk Management · Quantitative Finance 2025-05-19 Anubha Goel , Puneet Pasricha , Martin Magris , Juho Kanniainen

Recent efforts have been dedicated to enhancing time series forecasting accuracy by introducing advanced network architectures and self-supervised pretraining strategies. Nevertheless, existing approaches still exhibit two critical…

Machine Learning · Computer Science 2024-06-19 Zhiding Liu , Jiqian Yang , Mingyue Cheng , Yucong Luo , Zhi Li

Fuzzy time series forecasting (FTSF) is a typical forecasting method with wide application. Traditional FTSF is regarded as an expert system which leads to loss of the ability to recognize undefined features. The mentioned is the main…

Machine Learning · Computer Science 2023-08-29 Tianxiang Zhan , Yuanpeng He , Yong Deng , Zhen Li

Unlike natural language processing and computer vision, the development of Foundation Models (FMs) for time series forecasting is blocked due to data scarcity. While recent efforts are focused on building such FMs by unlocking the potential…

Machine Learning · Computer Science 2024-10-10 Qingxiang Liu , Xu Liu , Chenghao Liu , Qingsong Wen , Yuxuan Liang

Prior-Data Fitted Networks (PFNs) represent a paradigm shift in tabular data prediction. We present the principles of this new paradigm and evaluate two PFNs for estimating the average treatment effect (ATE) of a binary treatment on a…

Chaotic systems are intrinsically sensitive to small errors, challenging efforts to construct predictive data-driven models of real-world dynamical systems such as fluid flows or neuronal activity. Prior efforts comprise either specialized…

Machine Learning · Computer Science 2026-03-12 Jeffrey Lai , Anthony Bao , William Gilpin

Foundation models for tabular data, such as the Tabular Prior-data Fitted Network (TabPFN), are pre-trained on a massive number of synthetic datasets generated by structural causal models (SCM). They leverage in-context learning to offer…

Machine Learning · Computer Science 2026-01-28 Qinyi Liu , Mohammad Khalil , Naman Goel

Forecasting in probabilistic time series is a complex endeavor that extends beyond predicting future values to also quantifying the uncertainty inherent in these predictions. Gaussian process regression stands out as a Bayesian machine…

Time series has been left behind in the era of pre-training and transfer learning. While research in the fields of natural language processing and computer vision are enjoying progressively larger datasets to train massive models, the most…

Machine Learning · Computer Science 2023-12-06 Gerald Woo , Chenghao Liu , Akshat Kumar , Doyen Sahoo

We propose a few-shot learning method for spatial regression. Although Gaussian processes (GPs) have been successfully used for spatial regression, they require many observations in the target task to achieve a high predictive performance.…

Machine Learning · Statistics 2020-10-12 Tomoharu Iwata , Yusuke Tanaka

While recent advancements in foundation models have significantly impacted machine learning, rigorous tests on the performance of time series foundation models (TSFMs) remain largely underexplored. This paper presents an empirical study…

Machine Learning · Computer Science 2025-01-09 Syamantak Datta Gupta

Non-stationary time series with non-linear trends are frequently encountered in applications. We consider here the feasibility of accurately forecasting the signals of multiple such time series considering jointly when the number of…

Methodology · Statistics 2016-08-05 Kerry Fendick

Learning complex time series forecasting models usually requires a large amount of data, as each model is trained from scratch for each task/data set. Leveraging learning experience with similar datasets is a well-established technique for…

Machine Learning · Computer Science 2022-08-19 Lukas Brinkmeyer , Rafael Rego Drumond , Johannes Burchert , Lars Schmidt-Thieme

Long-range time series forecasting is usually based on one of two existing forecasting strategies: Direct Forecasting and Iterative Forecasting, where the former provides low bias, high variance forecasts and the latter leads to low…

Machine Learning · Computer Science 2022-12-14 Shiyu Liu , Rohan Ghosh , Mehul Motani

Financial time-series forecasting is critical for maintaining economic stability, guiding informed policymaking, and promoting sustainable investment practices. However, it remains challenging due to various underlying pattern shifts. These…

Machine Learning · Computer Science 2025-08-28 Zhuohang Zhu , Haodong Chen , Qiang Qu , Vera Chung

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of…

Machine Learning · Computer Science 2020-06-11 Andrei Boiarov , Oleg Granichin , Olga Granichina

The output of solar power generation is significantly dependent on the available solar radiation. Thus, with the proliferation of PV generation in the modern power grid, forecasting of solar irradiance is vital for proper operation of the…

Applications · Statistics 2022-09-05 Kwasi Opoku , Svetlana Lucemo , Qun Zhou Sun , Aleksandar Dimitrovski