English
Related papers

Related papers: Logo-LLM: Local and Global Modeling with Large Lan…

200 papers

Using pre-trained large language models (LLMs) as a backbone for time series prediction has recently attracted growing research interest. Existing approaches typically split time series into patches, map them to the token space of LLMs via…

Machine Learning · Computer Science 2026-03-09 Xinyu Zhang , Shanshan Feng , Xutao Li , Kenghong Lin , Fan Li , Pengfei Jia

Recently, there has been great success in leveraging pre-trained large language models (LLMs) for time series analysis. The core idea lies in effectively aligning the modality between natural language and time series. However, the…

Machine Learning · Computer Science 2026-03-03 Zongjiang Shang , Dongliang Cui , Binqing Wu , Ling Chen

Time series analysis is essential for comprehending the complexities inherent in various realworld systems and applications. Although large language models (LLMs) have recently made significant strides, the development of artificial general…

Machine Learning · Computer Science 2024-06-04 Ming Jin , Yifan Zhang , Wei Chen , Kexin Zhang , Yuxuan Liang , Bin Yang , Jindong Wang , Shirui Pan , Qingsong Wen

With the widespread adoption of Large Language Models (LLMs), there is a growing need to establish best practices for leveraging their capabilities beyond traditional natural language tasks. In this paper, a novel cross-domain knowledge…

Machine Learning · Computer Science 2025-09-29 Mohammadmahdi Ghasemloo , Alireza Moradi

With the evolution of large language models (LLMs), there is growing interest in leveraging LLMs for time series tasks. In this paper, we explore the characteristics of LLMs for time series forecasting by considering various existing and…

Machine Learning · Computer Science 2025-02-11 Janghoon Yang

Scaling laws for large language models (LLMs) have provided useful guidance in training ever larger models for predictable performance gains. Time series forecasting shares a similar sequential structure to language, and is amenable to…

Machine Learning · Computer Science 2025-01-09 Thomas D. P. Edwards , James Alvey , Justin Alsing , Nam H. Nguyen , Benjamin D. Wandelt

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

Recent advancements in time series forecasting have explored augmenting models with text or vision modalities to improve accuracy. While text provides contextual understanding, it often lacks fine-grained temporal details. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Siru Zhong , Weilin Ruan , Ming Jin , Huan Li , Qingsong Wen , Yuxuan Liang

Large Language Model (LLM)-based systems present new opportunities for autonomous health monitoring in sensor-rich industrial environments. This study explores the potential of LLMs to detect and classify faults directly from sensor data,…

Artificial Intelligence · Computer Science 2025-09-30 Xian Yeow Lee , Lasitha Vidyaratne , Ahmed Farahat , Chetan Gupta

Temporal Knowledge Graph Forecasting (TKGF) aims to predict future events based on the observed events in history. Recently, Large Language Models (LLMs) have exhibited remarkable capabilities, generating significant research interest in…

Information Retrieval · Computer Science 2025-01-22 He Chang , Jie Wu , Zhulin Tao , Yunshan Ma , Xianglin Huang , Tat-Seng Chua

Large pre-trained models have been vital in recent advancements in domains like language and vision, making model training for individual downstream tasks more efficient and provide superior performance. However, tackling time-series…

Machine Learning · Computer Science 2024-12-06 Harshavardhan Kamarthi , B. Aditya Prakash

Adapting Large Language Models (LLMs) that are extensively trained on abundant text data, and customizing the input prompt to enable time series forecasting has received considerable attention. While recent work has shown great potential…

Machine Learning · Computer Science 2024-12-09 Jayanie Bogahawatte , Sachith Seneviratne , Maneesha Perera , Saman Halgamuge

Traffic prediction, an essential component for intelligent transportation systems, endeavours to use historical data to foresee future traffic features at specific locations. Although existing traffic prediction models often emphasize…

Machine Learning · Computer Science 2024-07-09 Chenxi Liu , Sun Yang , Qianxiong Xu , Zhishuai Li , Cheng Long , Ziyue Li , Rui Zhao

Traffic forecasting represents a crucial problem within intelligent transportation systems. In recent research, Large Language Models (LLMs) have emerged as a promising method, but their intrinsic design, tailored primarily for sequential…

Machine Learning · Computer Science 2025-09-18 Hyotaek Jeon , Hyunwook Lee , Juwon Kim , Sungahn Ko

The emerging paradigm of leveraging pretrained large language models (LLMs) for time series forecasting has predominantly employed linguistic-temporal modality alignment strategies through token-level or layer-wise feature mapping. However,…

Artificial Intelligence · Computer Science 2025-05-20 Siming Sun , Kai Zhang , Xuejun Jiang , Wenchao Meng , Qinmin Yang

Recent works have demonstrated the effectiveness of adapting pre-trained language models (LMs) for forecasting time series in the low-data regime. We build upon these findings by analyzing the effective transfer from language models to time…

Computation and Language · Computer Science 2025-06-30 Roland Riachi , Kashif Rasul , Arjun Ashok , Prateek Humane , Alexis Roger , Andrew R. Williams , Yuriy Nevmyvaka , Irina Rish

Given the significant potential of large language models (LLMs) in sequence modeling, emerging studies have begun applying them to time-series forecasting. Despite notable progress, existing methods still face two critical challenges: 1)…

Artificial Intelligence · Computer Science 2025-01-09 Pengfei Wang , Huanran Zheng , Qi'ao Xu , Silong Dai , Yiqiao Wang , Wenjing Yue , Wei Zhu , Tianwen Qian , Xiaoling Wang

Spatio-temporal prediction aims to forecast and gain insights into the ever-changing dynamics of urban environments across both time and space. Its purpose is to anticipate future patterns, trends, and events in diverse facets of urban…

Computation and Language · Computer Science 2024-05-21 Zhonghang Li , Lianghao Xia , Jiabin Tang , Yong Xu , Lei Shi , Long Xia , Dawei Yin , Chao Huang

Time series data is essential in various applications, including climate modeling, healthcare monitoring, and financial analytics. Understanding the contextual information associated with real-world time series data is often essential for…

Artificial Intelligence · Computer Science 2025-03-11 Geon Lee , Wenchao Yu , Kijung Shin , Wei Cheng , Haifeng Chen

Due to the advantages of hypergraphs in modeling high-order relationships in complex systems, they have been applied to higher-order clustering, hypergraph neural networks and computer vision. These applications rely heavily on access to…

Social and Information Networks · Computer Science 2025-10-15 Bingqiao Gu , Jiale Zeng , Xingqin Qi , Dong Li