English
Related papers

Related papers: Empowering Time Series Analysis with Foundation Mo…

200 papers

Recent advancements in the collection and analysis of sequential educational data have brought time series analysis to a pivotal position in educational research, highlighting its essential role in facilitating data-driven decision-making.…

Machine Learning · Computer Science 2024-08-28 Shengzhong Mao , Chaoli Zhang , Yichi Song , Jindong Wang , Xiao-Jun Zeng , Zenglin Xu , Qingsong Wen

Time series analysis has become increasingly important in various domains, and developing effective models relies heavily on high-quality benchmark datasets. Inspired by the success of Natural Language Processing (NLP) benchmark datasets in…

Computation and Language · Computer Science 2024-10-15 Mohammad Asif Ibna Mustafa , Ferdinand Heinrich

Continuous-time series is essential for different modern application areas, e.g. healthcare, automobile, energy, finance, Internet of things (IoT) and other related areas. Different application needs to process as well as analyse a massive…

Machine Learning · Computer Science 2024-09-17 Mansura Habiba , Barak A. Pearlmutter , Mehrdad Maleki

Large Language Models (LLMs) offer the potential for automatic time series analysis and reporting, which is a critical task across many domains, spanning healthcare, finance, climate, energy, and many more. In this paper, we propose a…

Computation and Language · Computer Science 2024-10-10 Elizabeth Fons , Rachneet Kaur , Soham Palande , Zhen Zeng , Tucker Balch , Manuela Veloso , Svitlana Vyetrenko

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

Artificial Intelligence · Computer Science 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Recently, frequency transformation (FT) has been increasingly incorporated into deep learning models to significantly enhance state-of-the-art accuracy and efficiency in time series analysis. The advantages of FT, such as high efficiency…

Machine Learning · Computer Science 2025-06-16 Kun Yi , Qi Zhang , Wei Fan , Longbing Cao , Shoujin Wang , Guodong Long , Liang Hu , Hui He , Qingsong Wen , Hui Xiong

Time series analysis has become crucial in various fields, from engineering and finance to healthcare and social sciences. Due to their multidimensional nature, time series often need to be embedded into a fixed-dimensional feature space to…

Machine Learning · Computer Science 2025-05-27 Habib Irani , Yasamin Ghahremani , Arshia Kermani , Vangelis Metsis

Foundation Models are designed to serve as versatile embedding machines, with strong zero shot capabilities and superior generalization performance when fine-tuned on diverse downstream tasks. While this is largely true for language and…

Machine Learning · Computer Science 2025-10-08 Nouha Karaouli , Denis Coquenet , Elisa Fromont , Martial Mermillod , Marina Reyboz

Time series foundation models excel at diverse time series forecasting tasks, but their capacity for continuous improvement through incremental learning remains unexplored. We present the first comprehensive study investigating these…

Machine Learning · Computer Science 2025-04-22 Jia Liu , Cheng Jinguo , Xia Fang , Zhenyuan Ma , Yuankai Wu

Accurate forecasting of electric load and renewable generation is essential for reliable and cost effective power system operations. Recent advances in transformer based and foundation machine learning models, driven by large scale…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Muhy Eddin Za'ter , Bri-Mathias Hodge

This work studies the problem of time series analysis with generalist (or foundation) models, which are models trained across many data domains. Drawing inspiration from the widespread success of large language models, we consider the…

Machine Learning · Computer Science 2025-01-03 Sabera Talukder , Yisong Yue , Georgia Gkioxari

Large pre-trained models have been vital in recent advancements in domains like language and vision, making model training for individual downstream tasks more efficient and provide superior performance. However, tackling time-series…

Machine Learning · Computer Science 2024-12-06 Harshavardhan Kamarthi , B. Aditya Prakash

Effective utilization of time series data is often constrained by the scarcity of data quantity that reflects complex dynamics, especially under the condition of distributional shifts. Existing datasets may not encompass the full range of…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Haibei Zhu , Yousef El-Laham , Elizabeth Fons , Svitlana Vyetrenko

There is nowadays a constant flux of data being generated and collected in all types of real world systems. These data sets are often indexed by time, space or both requiring appropriate approaches to analyze the data. In univariate…

Social and Information Networks · Computer Science 2021-10-20 Vanessa Freitas Silva , Maria Eduarda Silva , Pedro Ribeiro , Fernando Silva

Foundation models can be disruptive for future AI development by scaling up deep learning in terms of model size and training data's breadth and size. These models achieve state-of-the-art performance (often through further adaptation) on a…

Artificial Intelligence · Computer Science 2022-12-20 Johannes Schneider

Financial time series forecasting is central to trading, portfolio optimization, and risk management, yet it remains challenging due to noisy, non-stationary, and heterogeneous data. Recent advances in time series foundation models (TSFMs),…

Computational Finance · Quantitative Finance 2025-11-25 Eghbal Rahimikia , Hao Ni , Weiguan Wang

Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data,…

Machine Learning · Computer Science 2024-05-08 Xiyuan Zhang , Ranak Roy Chowdhury , Rajesh K. Gupta , Jingbo Shang

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…

We introduce MOMENT, a family of open-source foundation models for general-purpose time series analysis. Pre-training large models on time series data is challenging due to (1) the absence of a large and cohesive public time series…

Machine Learning · Computer Science 2024-10-11 Mononito Goswami , Konrad Szafer , Arjun Choudhry , Yifu Cai , Shuo Li , Artur Dubrawski

Humans possess an extraordinary ability to create and utilize tools, allowing them to overcome physical limitations and explore new frontiers. With the advent of foundation models, AI systems have the potential to be equally adept in tool…