English
Related papers

Related papers: Empowering Time Series Analysis with Foundation Mo…

200 papers

Recently, there has been growing interest in incorporating textual information into foundation models for time series forecasting. However, it remains unclear whether and under what conditions such multimodal integration consistently yields…

Time-Series Mining (TSM) is an important research area since it shows great potential in practical applications. Deep learning models that rely on massive labeled data have been utilized for TSM successfully. However, constructing a…

Machine Learning · Computer Science 2024-10-07 Qianli Ma , Zhen Liu , Zhenjing Zheng , Ziyang Huang , Siying Zhu , Zhongzhong Yu , James T. Kwok

Traditional foundation models are pre-trained on broad datasets to reduce the training resources (e.g., time, energy, labeled samples) needed for fine-tuning a wide range of downstream tasks. However, traditional foundation models struggle…

Machine Learning · Computer Science 2025-04-24 Majid Farhadloo , Arun Sharma , Mingzhou Yang , Bharat Jayaprakash , William Northrop , Shashi Shekhar

The rapid advancement of Large Language Models (LLMs) has sparked growing interest in their application to time series analysis tasks. However, their ability to perform complex reasoning over temporal data in real-world application domains…

Machine Learning · Computer Science 2025-09-03 Wen Ye , Jinbo Liu , Defu Cao , Wei Yang , Yan Liu

Foundation models have garnered increasing attention for representation learning in remote sensing. Many such foundation models adopt approaches that have demonstrated success in computer vision with minimal domain-specific modification.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Kevin Lane , Morteza Karimzadeh

Process analytics is an umbrella of data-driven techniques which includes making predictions for individual process instances or overall process models. At the instance level, various novel techniques have been recently devised, tackling…

Machine Learning · Computer Science 2021-07-29 Johannes De Smedt , Anton Yeshchenko , Artem Polyvyanyy , Jochen De Weerdt , Jan Mendling

Time series forecasting is a fundamental tool with wide ranging applications, yet recent debates question whether complex nonlinear architectures truly outperform simple linear models. Prior claims of dominance of the linear model often…

Machine Learning · Computer Science 2026-02-13 Md Rakibul Haque , Vishwa Goudar , Shireen Elhabian , Warren Woodrich Pettine

Modelling and understanding time remains a challenge in contemporary video understanding models. With language emerging as a key driver towards powerful generalization, it is imperative for foundational video-language models to have a sense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Piyush Bagad , Makarand Tapaswi , Cees G. M. Snoek

Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. As a classic machine learning task, time series forecasting has recently been boosted by LLMs. Recent works treat large language…

Computation and Language · Computer Science 2024-12-31 Hua Tang , Chong Zhang , Mingyu Jin , Qinkai Yu , Zhenting Wang , Xiaobo Jin , Yongfeng Zhang , Mengnan Du

In vision-based action recognition, spatio-temporal features from different modalities are used for recognizing activities. Temporal modeling is a long challenge of action recognition. However, there are limited methods such as pre-computed…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elham Shabaninia , Hossein Nezamabadi-pour , Fatemeh Shafizadegan

Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is…

Machine Learning · Computer Science 2023-11-22 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Roman Vaculin

Financial time series forecasting presents significant challenges due to complex nonlinear relationships, temporal dependencies, variable interdependencies and limited data availability, particularly for tasks involving low-frequency data,…

General Finance · Quantitative Finance 2025-07-11 Ben A. Marconi

Time series forecasting has applications across domains and industries, especially in healthcare, but the technical expertise required to analyze data, build models, and interpret results can be a barrier to using these techniques. This…

Machine Learning · Computer Science 2025-12-10 Aaron D. Mullen , Daniel R. Harris , Svetla Slavova , V. K. Cody Bumgardner

Time series are all around in real-world applications. However, unexpected accidents for example broken sensors or missing of the signals will cause missing values in time series, making the data hard to be utilized. It then does harm to…

Machine Learning · Computer Science 2020-11-24 Chenguang Fang , Chen Wang

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

Time series data is a collection of chronological observations which is generated by several domains such as medical and financial fields. Over the years, different tasks such as classification, forecasting, and clustering have been…

Machine Learning · Computer Science 2021-02-12 Raha Moraffah , Paras Sheth , Mansooreh Karami , Anchit Bhattacharya , Qianru Wang , Anique Tahir , Adrienne Raglin , Huan Liu

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Time series prediction is a widespread and well studied problem with applications in many domains (medical, geoscience, network analysis, finance, econometry etc.). In the case of multivariate time series, the key to good performances is to…

Machine Learning · Computer Science 2022-02-09 Darko Drakulic , Jean-Marc Andreoli

Time series forecasting presents a significant challenge, particularly when its accuracy relies on external data sources rather than solely on historical values. This issue is prevalent in the financial sector, where the future behavior of…

Machine Learning · Computer Science 2024-03-22 Hajar Emami , Xuan-Hong Dang , Yousaf Shah , Petros Zerfos

The proliferation of Large Language Models (LLMs) has s fueled a shift in robot learning from automation towards general embodied Artificial Intelligence (AI). Adopting foundation models together with traditional learning methods to robot…

Robotics · Computer Science 2023-11-27 Xuan Xiao , Jiahang Liu , Zhipeng Wang , Yanmin Zhou , Yong Qi , Qian Cheng , Bin He , Shuo Jiang