English
Related papers

Related papers: LLM4TS: Aligning Pre-Trained LLMs as Data-Efficien…

200 papers

Time series analysis is critical for emerging net- work intelligent control and management functions. However, existing statistical-based and shallow machine learning models have shown limited prediction capabilities on multivariate time…

Machine Learning · Computer Science 2026-03-13 Yufeng Xin , Ethan Fan

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

Long-term time-series forecasting is essential for planning and decision-making in economics, energy, and transportation, where long foresight is required. To obtain such long foresight, models must be both efficient and effective in…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu , Zhou Fang , Jiaxing Qu

Time series (TS) data are ubiquitous across various application areas, rendering time series forecasting (TSF) a fundamental task. With the astounding advances in large language models (LLMs), a variety of methods have been developed to…

Artificial Intelligence · Computer Science 2025-08-25 Zhuomin Chen , Dan Li , Jiahui Zhou , Shunyu Wu , Haozheng Ye , Jian Lou , See-Kiong Ng

Deep learning has contributed remarkably to the advancement of time series analysis. Still, deep models can encounter performance bottlenecks in real-world data-scarce scenarios, which can be concealed due to the performance saturation with…

Machine Learning · Computer Science 2024-10-21 Yong Liu , Haoran Zhang , Chenyu Li , Xiangdong Huang , Jianmin Wang , Mingsheng Long

The reasoning capabilities of large language models (LLMs) have significantly advanced their performance by enabling in-depth understanding of diverse tasks. With growing interest in applying LLMs to the time series domain, this has proven…

Artificial Intelligence · Computer Science 2025-06-03 Jiahui Zhou , Dan Li , Lin Li , Zhuomin Chen , Shunyu Wu , Haozheng Ye , Jian Lou , Costas J. Spanos

Multivariate time series forecasting has seen widely ranging applications in various domains, including finance, traffic, energy, and healthcare. To capture the sophisticated temporal patterns, plenty of research studies designed complex…

Machine Learning · Computer Science 2022-07-05 Tianping Zhang , Yizhuo Zhang , Wei Cao , Jiang Bian , Xiaohan Yi , Shun Zheng , Jian Li

In the burgeoning domain of Large Language Models (LLMs), there is a growing interest in applying LLM to time series forecasting, with multiple studies focused on leveraging textual prompts to further enhance the predictive prowess. This…

Machine Learning · Computer Science 2024-11-19 Peisong Niu , Tian Zhou , Xue Wang , Liang Sun , Rong Jin

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

Pre-trained Language Models (PLMs), such as ChatGPT, have significantly advanced the field of natural language processing. This progress has inspired a series of innovative studies that explore the adaptation of PLMs to time series…

Artificial Intelligence · Computer Science 2025-06-06 Weijia Zhang , Chenlong Yin , Hao Liu , Hui Xiong

The World Wide Web needs reliable predictive capabilities to respond to changes in user behavior and usage patterns. Time series forecasting (TSF) is a key means to achieve this goal. In recent years, the large language models (LLMs) for…

Machine Learning · Computer Science 2026-01-23 Jianqi Zhang , Jingyao Wang , Wenwen Qiang , Fanjiang Xu , Changwen Zheng

Accurate analysis of industrial time-series big data is critical for the Prognostics and Health Management (PHM) of industrial equipment. While recent advancements in Large Language Models (LLMs) have shown promise in time-series analysis,…

Machine Learning · Computer Science 2026-03-10 Haiteng Wang , Yikang Li , Yunfei Zhu , Jingheng Yan , Lei Ren , Laurence T. Yang

The complexity and heterogeneity of data in many real-world applications pose significant challenges for traditional machine learning and signal processing techniques. For instance, in medicine, effective analysis of diverse physiological…

Machine Learning · Computer Science 2024-08-16 Nimeesha Chan , Felix Parker , William Bennett , Tianyi Wu , Mung Yao Jia , James Fackler , Kimia Ghobadi

Recently, Large Language Models (LLMs) have demonstrated great potential in various data mining tasks, such as knowledge question answering, mathematical reasoning, and commonsense reasoning. However, the reasoning capability of LLMs on…

Computation and Language · Computer Science 2025-05-22 He Chang , Chenchen Ye , Zhulin Tao , Jie Wu , Zhengmao Yang , Yunshan Ma , Xianglin Huang , Tat-Seng Chua

Large Language Models (LLMs) and pre-trained Language Models (LMs) have achieved impressive success on many software engineering tasks (e.g., code completion and code generation). By leveraging huge existing code corpora (e.g., GitHub),…

Software Engineering · Computer Science 2025-01-16 Xin Yin , Chao Ni , Xiaodan Xu , Xinrui Li , Xiaohu Yang

Recent work exploring the capabilities of pre-trained large language models (LLMs) has demonstrated their ability to act as general pattern machines by completing complex token sequences representing a wide array of tasks, including…

Computers and Society · Computer Science 2024-03-25 Seyed Parsa Neshaei , Richard Lee Davis , Adam Hazimeh , Bojan Lazarevski , Pierre Dillenbourg , Tanja Käser

This paper presents LLM4ES, a novel framework that exploits large pre-trained language models (LLMs) to derive user embeddings from event sequences. Event sequences are transformed into a textual representation, which is subsequently used…

Information Retrieval · Computer Science 2025-12-18 Aleksei Shestov , Omar Zoloev , Maksim Makarenko , Mikhail Orlov , Egor Fadeev , Ivan Kireev , Andrey Savchenko

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

The proliferation of edge devices has generated an unprecedented volume of time series data across different domains, motivating various well-customized methods. Recently, Large Language Models (LLMs) have emerged as a new paradigm for time…

Machine Learning · Computer Science 2025-05-06 Chenxi Liu , Shaowen Zhou , Qianxiong Xu , Hao Miao , Cheng Long , Ziyue Li , Rui Zhao

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen