English
Related papers

Related papers: TimeCMA: Towards LLM-Empowered Multivariate Time S…

200 papers

Time series forecasting is crucial in strategic planning and decision-making across various industries. Traditional forecasting models mainly concentrate on numerical time series data, often overlooking important textual information such as…

Computation and Language · Computer Science 2025-08-07 Chanjuan Liu , Shengzhi Wang , Enqiang Zhu

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Yan Sun , Shihao Yang

Time-series forecasting in real-world applications such as finance and energy often faces challenges due to limited training data and complex, noisy temporal dynamics. Existing deep forecasting models typically supervise predictions using…

Machine Learning · Computer Science 2026-01-14 Jiacheng You , Jingcheng Yang , Yuhang Xie , Zhongxuan Wu , Xiucheng Li , Feng Li , Pengjie Wang , Jian Xu , Bo Zheng , Xinyang Chen

Time series forecasting is critical across various domains, such as weather, finance and real estate forecasting, as accurate forecasts support informed decision-making and risk mitigation. While recent deep learning models have improved…

Machine Learning · Computer Science 2025-08-12 Jianfei Wu , Wenmian Yang , Bingning Liu , Weijia Jia

Recent advancements in language modeling have shown promising results when applied to time series data. In particular, fine-tuning pre-trained large language models (LLMs) for time series classification tasks has achieved state-of-the-art…

Machine Learning · Computer Science 2025-06-03 Rachneet Kaur , Zhen Zeng , Tucker Balch , Manuela Veloso

Recently, there has been a surge of Transformer-based solutions for the long-term time series forecasting (LTSF) task. Despite the growing performance over the past few years, we question the validity of this line of research in this work.…

Artificial Intelligence · Computer Science 2022-08-18 Ailing Zeng , Muxi Chen , Lei Zhang , Qiang Xu

The immense success of the Transformer architecture in Natural Language Processing has led to its adoption in Time Se ries Forecasting (TSF), where superior performance has been shown. However, a recent important paper questioned their…

Computation and Language · Computer Science 2025-10-28 Musleh Alharthi , Kaleel Mahmood , Sarosh Patel , Ausif Mahmood

In recent times, Large Language Models (LLMs) have captured a global spotlight and revolutionized the field of Natural Language Processing. One of the factors attributed to the effectiveness of LLMs is the model architecture used for…

Machine Learning · Computer Science 2023-08-31 Oluwaseyi Ogunfowora , Homayoun Najjaran

In this paper, we introduce Masked Multi-Step Multivariate Forecasting (MMMF), a novel and general self-supervised learning framework for time series forecasting with known future information. In many real-world forecasting scenarios, some…

Machine Learning · Computer Science 2022-09-30 Yiwei Fu , Honggang Wang , Nurali Virani

The endeavor of stock trend forecasting is principally focused on predicting the future trajectory of the stock market, utilizing either manual or technical methodologies to optimize profitability. Recent advancements in machine learning…

Computational Engineering, Finance, and Science · Computer Science 2025-02-19 Mingjie Wang , Juanxi Tian , Mingze Zhang , Jianxiong Guo , Weijia Jia

Large language models (LLMs) have recently shown promise in recommendation by providing rich semantic knowledge. While most existing approaches rely on external textual corpora to align LLMs with recommender systems, we revisit a more…

Information Retrieval · Computer Science 2026-04-21 Wuhan Chen , Min Gao , Xin Xia , Zongwei Wang , Wentao Li , Shane Culpepper

Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful…

Machine Learning · Computer Science 2025-05-16 Chengsen Wang , Qi Qi , Zhongwen Rao , Lujia Pan , Jingyu Wang , Jianxin Liao

Transformer-based and MLP-based methods have emerged as leading approaches in time series forecasting (TSF). While Transformer-based methods excel in capturing long-range dependencies, they suffer from high computational complexities and…

Machine Learning · Computer Science 2025-04-16 Yifan Hu , Peiyuan Liu , Peng Zhu , Dawei Cheng , Tao Dai

Time series forecasting (TSF) is a fundamental and widely studied task, spanning methods from classical statistical approaches to modern deep learning and multimodal language modeling. Despite their effectiveness, these methods often follow…

Machine Learning · Computer Science 2025-12-23 Mingyue Cheng , Jiahao Wang , Daoyu Wang , Xiaoyu Tao , Qi Liu , Enhong Chen

Time series data is fundamental to decision-making across many domains including healthcare, finance, power systems, and logistics. However, analyzing this data correctly often requires incorporating unstructured contextual information,…

Machine Learning · Computer Science 2026-03-17 Felix Parker , Nimeesha Chan , Chi Zhang , Kimia Ghobadi

Irregularly sampled time series (ISTS) are widespread in real-world scenarios, exhibiting asynchronous observations on uneven time intervals across variables. Existing ISTS forecasting methods often solely utilize historical observations to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zhi Lei , Chenxi Liu , Hao Miao , Wanghui Qiu , Bin Yang , Chenjuan Guo

Time Series Alignment is a critical task in signal processing with numerous real-world applications. In practice, signals often exhibit temporal shifts and scaling, making classification on raw data prone to errors. This paper introduces a…

Machine Learning · Computer Science 2025-02-27 Alireza Nourbakhsh , Hoda Mohammadzade

Multimodal Large Language Models advance multimodal representation learning by acquiring transferable semantic embeddings, thereby substantially enhancing performance across a range of vision-language tasks, including cross-modal retrieval,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Da Li , Yuxiao Luo , Keping Bi , Jiafeng Guo , Wei Yuan , Biao Yang , Yan Wang , Fan Yang , Tingting Gao , Guorui Zhou

Time Series Forecasting (TSF) has long been a challenge in time series analysis. Inspired by the success of Large Language Models (LLMs), researchers are now developing Large Time Series Models (LTSMs)-universal transformer-based models…