English
Related papers

Related papers: Adapting Large Language Models for Time Series Mod…

200 papers

Time Series Forecasting (TSF) is critical in many real-world domains like financial planning and health monitoring. Recent studies have revealed that Large Language Models (LLMs), with their powerful in-contextual modeling capabilities,…

Machine Learning · Computer Science 2025-03-14 Jialiang Tang , Shuo Chen , Chen Gong , Jing Zhang , Dacheng Tao

Time series data is fundamental to decision-making across many domains including healthcare, finance, power systems, and logistics. However, analyzing this data correctly often requires incorporating unstructured contextual information,…

Machine Learning · Computer Science 2026-03-17 Felix Parker , Nimeesha Chan , Chi Zhang , Kimia Ghobadi

Large Language Models (LLMs) have become a cornerstone in Natural Language Processing (NLP), achieving impressive performance in text generation. Their token-level representations capture rich, human-aligned semantics. However, pooling…

Computation and Language · Computer Science 2025-09-25 Benedikt Roth , Stephan Rappensperger , Tianming Qiu , Hamza Imamović , Julian Wörmann , Hao Shen

Large language models (LLMs) have become proficient at solving a wide variety of tasks, including those involving multi-modal inputs. In particular, instantiating an LLM (such as LLaMA) with a speech encoder and training it on paired data…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Desh Raj , Gil Keren , Junteng Jia , Jay Mahadeokar , Ozlem Kalinli

In recent years, Large Language Models (LLMs) have emerged as a prominent area of interest across various research domains, including Process Mining (PM). Current applications in PM have predominantly centered on prompt engineering…

Computation and Language · Computer Science 2025-09-04 Rafael Seidi Oyamada , Jari Peeperkorn , Jochen De Weerdt , Johannes De Smedt

Large Language Models (LLMs) have significantly advanced natural language processing with exceptional task generalization capabilities. Low-Rank Adaption (LoRA) offers a cost-effective fine-tuning solution, freezing the original model…

Machine Learning · Computer Science 2025-03-18 Jun Zhang , Jue Wang , Huan Li , Lidan Shou , Ke Chen , Yang You , Guiming Xie , Xuejian Gong , Kunlong Zhou

Recently years have witnessed a rapid development of large language models (LLMs). Despite the strong ability in many language-understanding tasks, the heavy computational burden largely restricts the application of LLMs especially when one…

Machine Learning · Computer Science 2023-10-10 Yuhui Xu , Lingxi Xie , Xiaotao Gu , Xin Chen , Heng Chang , Hengheng Zhang , Zhengsu Chen , Xiaopeng Zhang , Qi Tian

Recent advances in large language models (LLMs) have shown remarkable performance across diverse tasks. However, these models are typically deployed with fixed weights, which limits their ability to adapt dynamically to the variability…

Computation and Language · Computer Science 2025-02-12 Kamer Ali Yuksel , Hassan Sawaf

Time series forecasting aims to model temporal dependencies among variables for future state inference, holding significant importance and widespread applications in real-world scenarios. Although deep learning-based methods have achieved…

Machine Learning · Computer Science 2026-05-21 Zesen Wang , Lijuan Lan , Yonggang Li

Time series analysis is pivotal in domains like financial forecasting and biomedical monitoring, yet traditional methods are constrained by limited nonlinear feature representation and long-term dependency capture. The emergence of Large…

Machine Learning · Computer Science 2025-06-16 Feifei Shi , Xueyan Yin , Kang Wang , Wanyu Tu , Qifu Sun , Huansheng Ning

Large Language Models (LLMs) have transformed both everyday life and scientific research. However, adapting LLMs from general-purpose models to specialized tasks remains challenging, particularly in resource-constrained environments.…

Machine Learning · Computer Science 2025-09-12 Hao Zhang , Bo Huang , Zhenjia Li , Xi Xiao , Hui Yi Leong , Zumeng Zhang , Xinwei Long , Tianyang Wang , Hao Xu

The capabilities of large language models (LLMs) are widely regarded as relying on autoregressive models (ARMs). We challenge this notion by introducing LLaDA, a diffusion model trained from scratch under the pre-training and supervised…

Computation and Language · Computer Science 2025-10-21 Shen Nie , Fengqi Zhu , Zebin You , Xiaolu Zhang , Jingyang Ou , Jun Hu , Jun Zhou , Yankai Lin , Ji-Rong Wen , Chongxuan Li

Adapting Large Language Models (LLMs) that are extensively trained on abundant text data, and customizing the input prompt to enable time series forecasting has received considerable attention. While recent work has shown great potential…

Machine Learning · Computer Science 2024-12-09 Jayanie Bogahawatte , Sachith Seneviratne , Maneesha Perera , Saman Halgamuge

While Foundation Models provide a general tool for rapid content creation, they regularly require task-specific adaptation. Traditionally, this exercise involves careful curation of datasets and repeated fine-tuning of the underlying model.…

Machine Learning · Computer Science 2025-06-10 Rujikorn Charakorn , Edoardo Cetin , Yujin Tang , Robert Tjarko Lange

Large language models (LLMs) have revolutionized natural language processing (NLP) by excelling at understanding and generating human-like text. However, their widespread deployment can be prohibitively expensive. SortedNet is a recent…

Computation and Language · Computer Science 2024-02-12 Parsa Kavehzadeh , Mojtaba Valipour , Marzieh Tahaei , Ali Ghodsi , Boxing Chen , Mehdi Rezagholizadeh

Pre-trained Large Language Models (LLMs) have revolutionized text processing, yet adapting Transformer-based neural networks to non-textual scientific modalities typically requires specialized architectures and extensive computational…

Instrumentation and Methods for Astrophysics · Physics 2025-08-15 Nesar Ramachandra , Yuan-Sen Ting , Zechang Sun , Azton Wells , Salman Habib

Large Language Models (LLMs) have demonstrated impressive performance in time series analysis and seems to understand the time temporal relationship well than traditional transformer-based approaches. However, since LLMs are not designed…

Machine Learning · Computer Science 2025-05-27 Liangwei Nathan Zheng , Chang George Dong , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

The rapid advancement of Large Language Models (LLMs) has sparked growing interest in their application to time series analysis tasks. However, their ability to perform complex reasoning over temporal data in real-world application domains…

Machine Learning · Computer Science 2025-09-03 Wen Ye , Jinbo Liu , Defu Cao , Wei Yang , Yan Liu

Large language models (LLMs) are effective at capturing complex, valuable conceptual representations from textual data for a wide range of real-world applications. However, in fields like Intelligent Fault Diagnosis (IFD), incorporating…

Artificial Intelligence · Computer Science 2024-12-03 Hamzah A. A. M. Qaid , Bo Zhang , Dan Li , See-Kiong Ng , Wei Li

Model selection is a critical step in time series forecasting, traditionally requiring extensive performance evaluations across various datasets. Meta-learning approaches aim to automate this process, but they typically depend on…

Machine Learning · Computer Science 2025-04-04 Wang Wei , Tiankai Yang , Hongjie Chen , Ryan A. Rossi , Yue Zhao , Franck Dernoncourt , Hoda Eldardiry