English
Related papers

Related papers: Breaking the Context Bottleneck on Long Time Serie…

200 papers

Time-series forecasting often faces challenges due to data volatility, which can lead to inaccurate predictions. Variational Mode Decomposition (VMD) has emerged as a promising technique to mitigate volatility by decomposing data into…

Machine Learning · Computer Science 2024-09-05 Hafizh Raihan Kurnia Putra , Novanto Yudistira , Tirana Noor Fatyanosa

Large language model (LLM) approaches to tabular summarization rely on extensive prompt engineering, decomposition pipelines, or entity-level intermediate representations to achieve strong performance. While effective, these strategies are…

Computation and Language · Computer Science 2026-03-24 Ritam Upadhyay , Naman Ahuja , Rishabh Baral , Aparna Garimella , Vivek Gupta

Short-term load forecasting is one of the crucial sections in smart grid. Precise forecasting enables system operators to make reliable unit commitment and power dispatching decisions. With the advent of big data, a number of artificial…

Signal Processing · Electrical Eng. & Systems 2018-09-27 Tiantian Li , Bo Wang , Min Zhou , Junzo Watada

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Time series forecasting is vital across many domains, yet existing models struggle with fixed-length inputs and inadequate multi-scale modeling. We propose MR-CDM, a framework combining hierarchical multi-resolution trend decomposition, an…

Machine Learning · Computer Science 2026-04-09 Xianyong Xu , Yuanjun Zuo , Zhihong Huang , Yihan Qin , Haoxian Xu , Leilei Du , Haotian Wang

Predictive business process monitoring methods exploit logs of completed cases of a process in order to make predictions about running cases thereof. Existing methods in this space are tailor-made for specific prediction tasks. Moreover,…

Applications · Statistics 2017-12-20 Niek Tax , Ilya Verenich , Marcello La Rosa , Marlon Dumas

In order to support the advancement of machine learning methods for predicting time-series data, we present a comprehensive dataset designed explicitly for long-term time-series forecasting. We incorporate a collection of datasets obtained…

Machine Learning · Computer Science 2023-09-29 Jacek Cyranka , Szymon Haponiuk

Multivariate time series forecasting is an important yet challenging problem in machine learning. Most existing approaches only forecast the series value of one future moment, ignoring the interactions between predictions of future moments…

Machine Learning · Computer Science 2019-12-12 Jiezhu Cheng , Kaizhu Huang , Zibin Zheng

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

Human-Computer Interaction · Computer Science 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Addressing large-scale planning problems has become one of the central challenges in the planning community, deriving from the state-space explosion caused by growing objects and actions. Recently, researchers have explored the…

Artificial Intelligence · Computer Science 2026-03-31 Wenkai Yu , Jianhang Tang , Yang Zhang , Yixiong Feng , Celimuge Wu , Kebing Jin , Hankz Hankui Zhuo

Long-context modeling is one of the critical capabilities of language AI for digesting and reasoning over complex information pieces. In practice, long-context capabilities are typically built into a pre-trained language model~(LM) through…

Computation and Language · Computer Science 2024-10-15 Luyu Gao , Yunyi Zhang , Jamie Callan

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their…

Machine Learning · Computer Science 2024-12-10 Zhenkai Qin , Baozhong Wei , Caifeng Gao , Jianyuan Ni

Time series forecasting (TSF) is critical across domains such as finance, meteorology, and energy. While extending the lookback window theoretically provides richer historical context, in practice, it often introduces irrelevant noise and…

Machine Learning · Computer Science 2026-04-03 Xiang Ao , Yinyu Tan , Mengru Chen

Time series forecasting serves as an essential tool for many real-world applications, supporting tasks such as resource optimization and decision-making. Despite significant architectural advancements, most modern models still treat…

Machine Learning · Computer Science 2026-05-12 Sheng Pan , Ming Jin , Bo Du , Shirui Pan

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

This research examines the use of Large Language Models (LLMs) in predicting time series, with a specific focus on the LLMTIME model. Despite the established effectiveness of LLMs in tasks such as text generation, language translation, and…

Machine Learning · Computer Science 2024-08-12 Rui Cao , Qiao Wang

Large Language Models (LLMs) can perform zero-shot learning on unseen tasks and few-shot learning on complex reasoning tasks. However, resource-limited mobile edge networks struggle to support long-context LLM serving for LLM agents during…

Networking and Internet Architecture · Computer Science 2025-01-27 Minrui Xu , Dusit Niyato , Christopher G. Brinton

Ever since their conception, Transformers have taken over traditional sequence models in many tasks, such as NLP, image classification, and video/audio processing, for their fast training and superior performance. Much of the merit is…

Machine Learning · Computer Science 2023-02-17 Hongyu Hè , Marko Kabic

In many sequential tasks, a model needs to remember relevant events from the distant past to make correct predictions. Unfortunately, a straightforward application of gradient based training requires intermediate computations to be stored…

Machine Learning · Computer Science 2023-08-14 Artyom Sorokin , Nazar Buzun , Leonid Pugachev , Mikhail Burtsev

Time series forecasting has witnessed significant progress with deep learning. While prevailing approaches enhance forecasting performance by modifying architectures or introducing novel enhancement strategies, they often fail to…

Machine Learning · Computer Science 2026-03-31 Haonan Yang , Jianchao Tang , Zhuo Li