中文
相关论文

相关论文: Lag-Llama: Towards Foundation Models for Probabili…

200 篇论文

Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics (e.g., to serve as risk models or augment survey datasets). However, when should a user have…

A foundation model is a machine learning model trained on a large and diverse set of data, typically using self-supervised learning-based pre-training techniques, that can be adapted to various downstream tasks. However, current research on…

Large pre-trained models have been vital in recent advancements in domains like language and vision, making model training for individual downstream tasks more efficient and provide superior performance. However, tackling time-series…

机器学习 · 计算机科学 2024-12-06 Harshavardhan Kamarthi , B. Aditya Prakash

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

机器学习 · 计算机科学 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

Prompt-based evaluations suggest that large language models (LLMs) perform poorly on time series classification, raising doubts about whether they encode meaningful temporal structure. We show that this conclusion reflects limitations of…

计算与语言 · 计算机科学 2026-03-13 Dan Schumacher , Erfan Nourbakhsh , Rocky Slavin , Anthony Rios

The recent development of foundation models for time series data has generated considerable interest in using such models across a variety of applications. Although foundation models achieve state-of-the-art predictive performance, their…

机器学习 · 计算机科学 2026-05-29 Coen Adler , Yuxin Chang , Felix Draxler , Samar Abdi , Padhraic Smyth

Time series foundation models (FMs) have emerged as a popular paradigm for zero-shot multi-domain forecasting. FMs are trained on numerous diverse datasets and claim to be effective forecasters across multiple different time series domains,…

机器学习 · 计算机科学 2025-05-20 William Toner , Thomas L. Lee , Artjom Joosen , Rajkarn Singh , Martin Asenov

Transformer-based foundation models have emerged as a dominant paradigm in time series analysis, offering unprecedented capabilities in tasks such as forecasting, anomaly detection, classification, trend analysis and many more time series…

Recent research has shown an increasing interest in utilizing pre-trained large language models (LLMs) for a variety of time series applications. However, there are three main challenges when using LLMs as foundational models for time…

机器学习 · 计算机科学 2025-07-02 Wenzhe Niu , Zongxia Xie , Yanru Sun , Wei He , Man Xu , Chao Hao

Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs),…

With the widespread adoption of Large Language Models (LLMs), there is a growing need to establish best practices for leveraging their capabilities beyond traditional natural language tasks. In this paper, a novel cross-domain knowledge…

机器学习 · 计算机科学 2025-09-29 Mohammadmahdi Ghasemloo , Alireza Moradi

Time series foundation models excel in zero-shot forecasting, handling diverse tasks without explicit training. However, the advancement of these models has been hindered by the lack of comprehensive benchmarks. To address this gap, we…

机器学习 · 计算机科学 2024-11-12 Taha Aksu , Gerald Woo , Juncheng Liu , Xu Liu , Chenghao Liu , Silvio Savarese , Caiming Xiong , Doyen Sahoo

Tabular foundation models, particularly Prior-data Fitted Networks like TabPFN have emerged as the leading contender in a myriad of tasks ranging from data imputation to label prediction on the tabular data format surpassing the historical…

机器学习 · 计算机科学 2026-04-10 Mayuka Jayawardhana , Nihal Sharma , Kazem Meidani , Bayan Bruss , Tom Goldstein , Doron Bergman

Large Language Models (LLMs) have gained popularity in time series forecasting, but their potential for anomaly detection remains largely unexplored. Our study investigates whether LLMs can understand and detect anomalies in time series…

机器学习 · 计算机科学 2025-03-13 Zihao Zhou , Rose Yu

Accurate load forecasting is crucial for maintaining the power balance between generators and consumers,particularly with the increasing integration of renewable energy sources, which introduce significant intermittent volatility. With the…

系统与控制 · 电气工程与系统科学 2024-09-04 Mingyang Gao , Suyang Zhou , Wei Gu , Zhi Wu , Haiquan Liu , Aihua Zhou

Large language models (LLMs) have been introduced to time series forecasting (TSF) to incorporate contextual knowledge beyond numerical signals. However, existing studies question whether LLMs provide genuine benefits, often reporting…

计算与语言 · 计算机科学 2026-03-04 Xin Qiu , Junlong Tong , Yirong Sun , Yunpu Ma , Wei Zhang , Xiaoyu Shen

With the evolution of large language models (LLMs), there is growing interest in leveraging LLMs for time series tasks. In this paper, we explore the characteristics of LLMs for time series forecasting by considering various existing and…

机器学习 · 计算机科学 2025-02-11 Janghoon Yang

Large pre-trained time series foundation models (TSFMs) have demonstrated promising zero-shot performance across a wide range of domains. However, a question remains: Do TSFMs succeed by memorizing patterns in training data, or do they…

Time series forecasting plays a central role in many real-world applications and has been extensively studied. Most existing approaches rely on deterministic models. However, real-world environments exhibit inherently uncertain and complex…

机器学习 · 计算机科学 2026-05-25 Minju Kim , Youngbum Hur

In this paper, we introduce TimeGPT, the first foundation model for time series, capable of generating accurate predictions for diverse datasets not seen during training. We evaluate our pre-trained model against established statistical,…

机器学习 · 计算机科学 2024-05-29 Azul Garza , Cristian Challu , Max Mergenthaler-Canseco