English
Related papers

Related papers: Integrating Time Series into LLMs via Multi-layer …

200 papers

Many real-world ubiquitous applications, such as parking recommendations and air pollution monitoring, benefit significantly from accurate long-term spatio-temporal forecasting (LSTF). LSTF makes use of long-term dependency between spatial…

Machine Learning · Computer Science 2022-09-02 Wei Shao , Zhiling Jin , Shuo Wang , Yufan Kang , Xiao Xiao , Hamid Menouar , Zhaofeng Zhang , Junshan Zhang , Flora Salim

Time series, typically represented as numerical sequences, can also be transformed into images and texts, offering multi-modal views (MMVs) of the same underlying signal. These MMVs can reveal complementary patterns and enable the use of…

Machine Learning · Computer Science 2025-11-03 ChengAo Shen , Wenchao Yu , Ziming Zhao , Dongjin Song , Wei Cheng , Haifeng Chen , Jingchao Ni

It is a critical challenge to efficiently unlock the powerful reasoning potential of Large Language Models (LLMs) for specific tasks or new distributions. Existing test-time adaptation methods often require tuning model parameters, which is…

Computation and Language · Computer Science 2025-12-05 Xinyue Kang , Diwei Shi , Li Chen

Multivariate Time Series (MTS) forecasting has a wide range of applications in both industry and academia. Recent advances in Spatial-Temporal Graph Neural Network (STGNN) have achieved great progress in modelling spatial-temporal…

Machine Learning · Computer Science 2025-05-22 Huiliang Zhang , Di Wu , Arnaud Zinflou , Stephane Dellacherie , Mouhamadou Makhtar Dione , Benoit Boulet

Recent deep learning models for Long-term Time Series Forecasting (LTSF) often emphasize complex, handcrafted designs, while simpler architectures like linear models or MLPs have often outperformed these intricate solutions. In this paper,…

Machine Learning · Computer Science 2025-05-26 Yihang Lu , Yangyang Xu , Qitao Qing , Xianwei Meng

In the real world, long sequence time-series forecasting (LSTF) is needed in many cases, such as power consumption prediction and air quality prediction.Multi-dimensional long time series model has more strict requirements on the model,…

Machine Learning · Computer Science 2022-05-11 Ning Wang

Long-term time series forecasting (LTSF) is important for various domains but is confronted by challenges in handling the complex temporal-contextual relationships. As multivariate input models underperforming some recent univariate…

Machine Learning · Statistics 2026-02-06 Jiecheng Lu , Xu Han , Shihao Yang

Long-term time-series forecasting (LTTF) has become a pressing demand in many applications, such as wind power supply planning. Transformer models have been adopted to deliver high prediction capacity because of the high computational…

Machine Learning · Computer Science 2023-01-06 Yan Li , Xinjiang Lu , Haoyi Xiong , Jian Tang , Jiantao Su , Bo Jin , Dejing Dou

We consider nonnegative time series forecasting framework. Based on recent advances in Nonnegative Matrix Factorization (NMF) and Archetypal Analysis, we introduce two procedures referred to as Sliding Mask Method (SMM) and Latent Clustered…

Machine Learning · Computer Science 2021-02-11 Yohann de Castro , Luca Mencarelli

In recent work on time-series prediction, Transformers and even large language models have garnered significant attention due to their strong capabilities in sequence modeling. However, in practical deployments, time-series prediction often…

Machine Learning · Computer Science 2026-02-17 Wenxuan Xie , Fanpu Cao

The proliferation of time series foundation models has created a landscape where no single method achieves consistent superiority, framing the central challenge not as finding the best model, but as orchestrating an optimal ensemble with…

Artificial Intelligence · Computer Science 2025-12-19 Defu Cao , Michael Gee , Jinbo Liu , Hengxuan Wang , Wei Yang , Rui Wang , Yan Liu

We address a three-tier numerical framework based on manifold learning for the forecasting of high-dimensional time series. At the first step, we embed the time series into a reduced low-dimensional space using a nonlinear manifold learning…

Numerical Analysis · Mathematics 2023-03-16 Panagiotis Papaioannou , Ronen Talmon , Ioannis Kevrekidis , Constantinos Siettos

Multivariate Time Series Forecasting (MTSF) involves predicting future values of multiple interrelated time series. Recently, deep learning-based MTSF models have gained significant attention for their promising ability to mine semantics…

Machine Learning · Computer Science 2025-06-17 Chengqing Yu , Fei Wang , Chuanguang Yang , Zezhi Shao , Tao Sun , Tangwen Qian , Wei Wei , Zhulin An , Yongjun Xu

Understanding the relationship between textual news and time-series evolution is a critical yet under-explored challenge in applied data science. While multimodal learning has gained traction, existing multimodal time-series datasets fall…

Computation and Language · Computer Science 2026-02-12 Jialin Chen , Aosong Feng , Ziyu Zhao , Juan Garza , Gaukhar Nurbek , Cheng Qin , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

Spatio-Temporal Multivariate time series Forecast (STMF) uses the time series of $n$ spatially distributed variables in a period of recent past to forecast their values in a period of near future. It has important applications in…

Machine Learning · Computer Science 2025-10-29 Zibo Liu , Zhe Jiang , Zelin Xu , Tingsong Xiao , Yupu Zhang , Zhengkun Xiao , Haibo Wang , Shigang Chen

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

Text embeddings are vital for tasks such as text retrieval and semantic textual similarity (STS). Recently, the advent of pretrained language models, along with unified benchmarks like the Massive Text Embedding Benchmark (MTEB), has…

Computation and Language · Computer Science 2024-10-22 Mingxin Li , Zhijie Nie , Yanzhao Zhang , Dingkun Long , Richong Zhang , Pengjun Xie

Multimodal Large Language Models (MLLMs) have achieved notable success in enhancing translation performance by integrating multimodal information. However, existing research primarily focuses on image-guided methods, whose applicability is…

Computation and Language · Computer Science 2026-03-04 Yexing Du , Youcheng Pan , Zekun Wang , Zheng Chu , Yichong Huang , Kaiyuan Liu , Bo Yang , Yang Xiang , Ming Liu , Bing Qin

Current forecasting approaches are largely unimodal and ignore the rich textual data that often accompany the time series due to lack of well-curated multimodal benchmark dataset. In this work, we develop TimeText Corpus (TTC), a carefully…

Artificial Intelligence · Computer Science 2024-11-22 Kai Kim , Howard Tsai , Rajat Sen , Abhimanyu Das , Zihao Zhou , Abhishek Tanpure , Mathew Luo , Rose Yu

Machine learning force fields (MLFFs) are a promising approach to balance the accuracy of quantum mechanics with the efficiency of classical potentials, yet selecting an optimal model amid increasingly diverse architectures that delivers…

Machine Learning · Computer Science 2025-12-09 Bangchen Yin , Yue Yin , Yuda W. Tang , Hai Xiao