English
Related papers

Related papers: Logo-LLM: Local and Global Modeling with Large Lan…

200 papers

Recently, LLMs (Large Language Models) have been adapted for time series prediction with significant success in pattern recognition. However, the common belief is that these models are not suitable for predicting financial market returns,…

Portfolio Management · Quantitative Finance 2025-11-04 Sebastien Valeyre , Sofiane Aboura

Anomaly detection of multivariate time series is meaningful for system behavior monitoring. This paper proposes an anomaly detection method based on unsupervised Short- and Long-term Mask Representation learning (SLMR). The main idea is to…

Machine Learning · Computer Science 2022-08-24 Qiucheng Miao , Chuanfu Xu , Jun Zhan , Dong Zhu , Chengkun Wu

Despite the recent success of large language models (LLMs) in time-series forecasting, most existing methods still adopt a Deep Synchronous Fusion strategy, where dense interactions between textual and temporal features are enforced at…

Machine Learning · Computer Science 2026-04-15 Fan Zhang , Shiming Fan , Hua Wang

Large language models (LLMs) have achieved remarkable success across various domains, but effectively incorporating complex and potentially noisy user timeline data into LLMs remains a challenge. Current approaches often involve translating…

Computation and Language · Computer Science 2024-09-11 Lin Ning , Luyang Liu , Jiaxing Wu , Neo Wu , Devora Berlowitz , Sushant Prakash , Bradley Green , Shawn O'Banion , Jun Xie

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

Large Language Models (LLMs) have recently been successfully applied to regression tasks -- such as time series forecasting and tabular prediction -- by leveraging their in-context learning abilities. However, their autoregressive decoding…

Machine Learning · Computer Science 2026-03-04 Julianna Piskorz , Katarzyna Kobalczyk , Mihaela van der Schaar

Long Short-Term Memory (LSTM) networks are often used to capture temporal dependency patterns. By stacking multi-layer LSTM networks, it can capture even more complex patterns. This paper explores the effectiveness of applying stacked LSTM…

Machine Learning · Computer Science 2020-11-03 Frank Xiao

Recent work exploring the capabilities of pre-trained large language models (LLMs) has demonstrated their ability to act as general pattern machines by completing complex token sequences representing a wide array of tasks, including…

Computers and Society · Computer Science 2024-03-25 Seyed Parsa Neshaei , Richard Lee Davis , Adam Hazimeh , Bojan Lazarevski , Pierre Dillenbourg , Tanja Käser

Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics (e.g., to serve as risk models or augment survey datasets). However, when should a user have…

The rapid advancement of Large Language Models (LLMs) has led to the development of benchmarks that consider temporal dynamics, however, there remains a gap in understanding how well these models can generalize across temporal contexts due…

Computation and Language · Computer Science 2025-07-02 Chenghao Zhu , Nuo Chen , Yufei Gao , Yunyi Zhang , Prayag Tiwari , Benyou Wang

The proliferation of time series foundation models has created a landscape where no single method achieves consistent superiority, framing the central challenge not as finding the best model, but as orchestrating an optimal ensemble with…

Artificial Intelligence · Computer Science 2025-12-19 Defu Cao , Michael Gee , Jinbo Liu , Hengxuan Wang , Wei Yang , Rui Wang , Yan Liu

Time series forecasting plays a vital role in supporting decision-making across a wide range of critical applications, including energy, healthcare, and finance. Despite recent advances, forecasting accuracy remains limited due to the…

Machine Learning · Computer Science 2025-08-14 Xiaoyu Tao , Shilong Zhang , Mingyue Cheng , Daoyu Wang , Tingyue Pan , Bokai Pan , Changqing Zhang , Shijin Wang

This work presents an analytical framework for the design and analysis of LLM-based algorithms, i.e., algorithms that contain one or multiple calls of large language models (LLMs) as sub-routines and critically rely on the capabilities of…

Machine Learning · Computer Science 2025-10-14 Yanxi Chen , Yaliang Li , Bolin Ding , Jingren Zhou

Today's large language models (LLMs) typically train on short text segments (e.g., <4K tokens) due to the quadratic complexity of their Transformer architectures. As a result, their performance suffers drastically on inputs longer than…

Computation and Language · Computer Science 2024-06-26 Chi Han , Qifan Wang , Hao Peng , Wenhan Xiong , Yu Chen , Heng Ji , Sinong Wang

This paper presents a comprehensive evaluation of the capabilities of Large Language Models (LLMs) in metaphor interpretation across multiple datasets, tasks, and prompt configurations. Although metaphor processing has gained significant…

Computation and Language · Computer Science 2025-07-22 Elisa Sanchez-Bayona , Rodrigo Agerri

Time series forecasting is a long-standing and highly challenging research topic. Recently, driven by the rise of large language models (LLMs), research has increasingly shifted from purely time series methods toward harnessing textual…

Artificial Intelligence · Computer Science 2025-09-03 Shiqiao Zhou , Holger Schöner , Huanbo Lyu , Edouard Fouché , Shuo Wang

The complexity and heterogeneity of data in many real-world applications pose significant challenges for traditional machine learning and signal processing techniques. For instance, in medicine, effective analysis of diverse physiological…

Machine Learning · Computer Science 2024-08-16 Nimeesha Chan , Felix Parker , William Bennett , Tianyi Wu , Mung Yao Jia , James Fackler , Kimia Ghobadi

Large Language Models (LLMs) possess general world knowledge but often struggle to generate precise predictions in structured, domain-specific contexts such as simulations. These limitations arise from their inability to ground their broad,…

Artificial Intelligence · Computer Science 2026-01-30 Guillaume Levy , Cedric Colas , Pierre-Yves Oudeyer , Thomas Carta , Clement Romac

Large language models (LLMs) have recently demonstrated strong reasoning capabilities and attracted increasing research attention in the field of autonomous driving (AD). However, safe application of LLMs on AD perception and prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yanjiao Liu , Jiawei Liu , Xun Gong , Zifei Nie

Recent studies have shown the ability of large language models to perform a variety of tasks, including time series forecasting. The flexible nature of these models allows them to be used for many applications. In this paper, we present a…

Machine Learning · Computer Science 2024-11-04 Sarah Alnegheimish , Linh Nguyen , Laure Berti-Equille , Kalyan Veeramachaneni