English
Related papers

Related papers: Moirai 2.0: When Less Is More for Time Series Fore…

200 papers

We show that time series foundation models scale: a single training recipe produces reliable forecast-quality improvements from 4M to 2.5B parameters. We release Toto 2.0, a family of five open-weights forecasting models trained under this…

Forecasting in power systems often involves multivariate time series with complex dependencies and strict privacy constraints across regions. Traditional forecasting methods require significant expert knowledge and struggle to generalize…

Machine Learning · Computer Science 2026-01-21 Ren He , Yinliang Xu , Jinfeng Wang , Jeremy Watson , Jian Song

We compare the accuracy, precision and reliability of different methods for estimating key system parameters for two-level systems subject to Hamiltonian evolution and decoherence. It is demonstrated that the use of Bayesian modelling and…

Quantum Physics · Physics 2019-10-15 Sophie Schirmer , Frank Langbein

Demoir\'eing aims to remove moir\'e artifacts that often occur in images. While recent deep learning-based methods have achieved promising results, they typically require substantial computational resources, limiting their deployment on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Zheng Chen , Kewei Zhang , Xiaoyang Liu , Weihang Zhang , Mengfan Wang , Yifan Fu , Yulun Zhang

Driven by the progress of large-scale pre-training, parameter-efficient transfer learning has gained immense popularity across different subfields of Artificial Intelligence. The core is to adapt the model to downstream tasks with only a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Haixin Wang , Xinlong Yang , Jianlong Chang , Dian Jin , Jinan Sun , Shikun Zhang , Xiao Luo , Qi Tian

Motivated by recent advances in large language models for Natural Language Processing (NLP), we design a time-series foundation model for forecasting whose out-of-the-box zero-shot performance on a variety of public datasets comes close to…

Computation and Language · Computer Science 2024-04-19 Abhimanyu Das , Weihao Kong , Rajat Sen , Yichen Zhou

In-context learning, which offers substantial advantages over fine-tuning, is predominantly observed in decoder-only models, while encoder-decoder (i.e., seq2seq) models excel in methods that rely on weight updates. Recently, a few studies…

Computation and Language · Computer Science 2024-08-28 Jihyeon Lee , Dain Kim , Doohae Jung , Boseop Kim , Kyoung-Woon On

Multivariate Time Series forecasting has been an increasingly popular topic in various applications and scenarios. Recently, contrastive learning and Transformer-based models have achieved good performance in many long-term series…

Machine Learning · Computer Science 2023-01-24 Zhe Li , Zhongwen Rao , Lujia Pan , Pengyun Wang , Zenglin Xu

Time-series forecasting remains difficult in real-world settings because temporal patterns operate at multiple scales, from broad contextual trends to fast, fine-grained fluctuations that drive critical decisions. Existing neural models…

Machine Learning · Computer Science 2025-11-26 Sepideh Koohfar

Recent success in speech representation learning enables a new way to leverage unlabeled data to train speech recognition model. In speech representation learning, a large amount of unlabeled data is used in a self-supervised manner to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-15 Shaoshi Ling , Yuzong Liu

Time series forecasting is essential across domains from finance to supply chain management. This paper introduces ForecastGAN, a novel decomposition based adversarial framework addressing limitations in existing approaches for…

Machine Learning · Computer Science 2025-11-07 Syeda Sitara Wishal Fatima , Afshin Rahimi

The rapid growth of medical imaging has fueled the development of Foundation Models (FMs) to reduce the growing, unsustainable workload on radiologists. While recent FMs have shown the power of large-scale pre-training to CT and MRI…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Antoine Saporta , Baptiste Callard , Corentin Dancette , Julien Khlaut , Charles Corbière , Leo Butsanets , Amaury Prat , Pierre Manceron

Many methods for time-series forecasting are known in classical statistics, such as autoregression, moving averages, and exponential smoothing. The DeepAR framework is a novel, recent approach for time-series forecasting based on deep…

Machine Learning · Computer Science 2023-02-23 Ayla Jungbluth , Johannes Lederer

Recent advances in lightweight time series forecasting models suggest the inherent simplicity of time series forecasting tasks. In this paper, we present CMoS, a super-lightweight time series forecasting model. Instead of learning the…

Machine Learning · Computer Science 2025-05-27 Haotian Si , Changhua Pei , Jianhui Li , Dan Pei , Gaogang Xie

Transformer-based architectures achieved breakthrough performance in natural language processing and computer vision, yet they remain inferior to simpler linear baselines in multivariate long-term forecasting. To better understand this…

Machine Learning · Computer Science 2024-06-04 Romain Ilbert , Ambroise Odonnat , Vasilii Feofanov , Aladin Virmaux , Giuseppe Paolo , Themis Palpanas , Ievgen Redko

Time-series forecasting is fundamental in industrial domains like manufacturing and smart factories. As systems evolve toward automation, models must operate on edge devices (e.g., PLCs, microcontrollers) with strict constraints on latency…

Machine Learning · Computer Science 2026-01-19 Jaehoon Lee , Seungwoo Lee , Younghwi Kim , Dohee Kim , Sunghyun Sim

Financial time series often exhibit low signal-to-noise ratio, posing significant challenges for accurate data interpretation and prediction and ultimately decision making. Generative models have gained attention as powerful tools for…

Machine Learning · Computer Science 2024-09-05 Zhuohan Wang , Carmine Ventre

The performance of time series forecasting has recently been greatly improved by the introduction of transformers. In this paper, we propose a general multi-scale framework that can be applied to the state-of-the-art transformer-based time…

Machine Learning · Computer Science 2023-02-08 Amin Shabani , Amir Abdi , Lili Meng , Tristan Sylvain

In the past few years, time series foundation models have achieved superior predicting accuracy. However, real-world time series often exhibit significant diversity in their temporal patterns across different time spans and domains, making…

Machine Learning · Computer Science 2026-03-19 Aobo Liang , Yan Sun , Xiaohou Shi , Ke Li

Time series forecasting requires balancing short-term and long-term dependencies for accurate predictions. Existing methods mainly focus on long-term dependency modeling, neglecting the complexities of short-term dynamics, which may hinder…

Machine Learning · Computer Science 2024-08-29 Sijia Peng , Yun Xiong , Yangyong Zhu , Zhiqiang Shen