English
Related papers

Related papers: MemCast: Memory-Driven Time Series Forecasting wit…

200 papers

Urban flow forecasting is a challenging task, given the inherent periodic characteristics of urban flow patterns. To capture the periodicity, existing urban flow prediction approaches are often designed with closeness, period, and trend…

Artificial Intelligence · Computer Science 2022-03-04 Hao Xue , Flora D Salim

Reasoning ability is crucial for solving challenging tasks. With the advancement of foundation models, such as the emergence of large language models (LLMs), a wide range of reasoning strategies has been proposed, including test-time…

Machine Learning · Computer Science 2025-03-17 Haoxin Liu , Zhiyuan Zhao , Shiduo Li , B. Aditya Prakash

In the burgeoning ecosystem of Internet of Things, multivariate time series (MTS) data has become ubiquitous, highlighting the fundamental role of time series forecasting across numerous applications. The crucial challenge of long-term MTS…

Machine Learning · Computer Science 2024-11-06 Zhenwei Zhang , Linghang Meng , Yuantao Gu

Real-world time-series datasets often violate the assumptions of standard supervised learning for forecasting -- their distributions evolve over time, rendering the conventional training and model selection procedures suboptimal. In this…

Machine Learning · Computer Science 2022-09-27 Sercan O. Arik , Nathanael C. Yoder , Tomas Pfister

The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language…

Computation and Language · Computer Science 2025-08-05 Taibiao Zhao , Xiaobing Chen , Mingxuan Sun

Flow Matching (FM) has recently emerged as a powerful approach for high-quality visual generation. However, their prohibitively slow inference due to a large number of denoising steps limits their potential use in real-time or interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Divya Jyoti Bajpai , Shubham Agarwal , Apoorv Saxena , Kuldeep Kulkarni , Subrata Mitra , Manjesh Kumar Hanawal

Catastrophic forgetting (CF) poses a persistent challenge in continual learning (CL), especially within federated learning (FL) environments characterized by non-i.i.d. time series data. While existing research has largely focused on…

Machine Learning · Computer Science 2026-02-24 Khaled Hallak , Oudom Kem

Large language models often expose their brittleness in reasoning tasks, especially while executing long chains of reasoning over context. We propose MemReasoner, a new and simple memory-augmented LLM architecture, in which the memory…

Computation and Language · Computer Science 2025-03-12 Payel Das , Ching-Yun Ko , Sihui Dai , Georgios Kollias , Subhajit Chaudhury , Aurelie Lozano

Recently, large language models (LLMs) have shown great promise in time series forecasting. However, most existing LLM-based forecasting methods still follow a static generative paradigm that directly maps historical observations to future…

Machine Learning · Computer Science 2026-05-05 Bokai Pan , Mingyue Cheng , Zhiding Liu , Shuo Yu , Xiaoyu Tao , Yuchong Wu , Qi Liu , Defu Lian , Enhong Chen

Accurate weather forecasting across time scales is critical for anticipating and mitigating the impacts of climate change. Recent data-driven methods based on deep learning have achieved significant success in the medium range, but struggle…

Machine Learning · Computer Science 2025-10-22 Tung Nguyen , Tuan Pham , Troy Arcomano , Veerabhadra Kotamarthi , Ian Foster , Sandeep Madireddy , Aditya Grover

Text analysis of tabular data relies on two core operations: \emph{summarization} for corpus-level theme extraction and \emph{tagging} for row-level labeling. A critical limitation of employing large language models (LLMs) for these tasks…

Computation and Language · Computer Science 2026-04-23 Jinxiang Xie , Zihao Li , Wei He , Rui Ding , Shi Han , Dongmei Zhang

Multivariate time-series forecasting is vital in various domains, e.g., economic planning and weather prediction. Deep train-from-scratch models have exhibited effective performance yet require large amounts of data, which limits real-world…

Machine Learning · Computer Science 2025-02-21 Ching Chang , Wei-Yao Wang , Wen-Chih Peng , Tien-Fu Chen

Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but cannot directly use…

AI systems are notorious for their fragility; minor input changes can potentially cause major output swings. When such systems are deployed in critical areas like finance, the consequences of their uncertain behavior could be severe. In…

Machine Learning · Computer Science 2024-06-21 Kausik Lakkaraju , Rachneet Kaur , Zhen Zeng , Parisa Zehtabi , Sunandita Patra , Biplav Srivastava , Marco Valtorta

Recently, large language models (LLMs) have demonstrated powerful capabilities in performing various tasks and thus are applied by recent studies to time series forecasting (TSF) tasks, which predict future values with the given historical…

Computation and Language · Computer Science 2025-07-15 Chen Su , Yuanhe Tian , Qinyu Liu , Jun Zhang , Yan Song

Forming accurate memory of sequential stimuli is a fundamental function of biological agents. However, the computational mechanism underlying sequential memory in the brain remains unclear. Inspired by neuroscience theories and recent…

Neurons and Cognition · Quantitative Biology 2023-10-27 Mufeng Tang , Helen Barron , Rafal Bogacz

Time Series Foundation Models (TSFMs) represent a new paradigm for time-series forecasting, promising zero-shot predictions without the need for task-specific training or fine-tuning. However, similar to Large Language Models (LLMs), the…

Machine Learning · Computer Science 2026-02-26 Marcel Meyer , Sascha Kaltenpoth , Kevin Zalipski , Oliver Müller

Time series forecasting is not just numerical extrapolation, but often requires reasoning with unstructured contextual data such as news or events. While specialized Time Series Foundation Models (TSFMs) excel at forecasting based on…

Trajectory prediction is a pivotal component of autonomous driving systems, enabling the application of accumulated movement experience to current scenarios. Although most existing methods concentrate on learning continuous representations…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Hang Guo , Yuzhen Zhang , Tianci Gao , Junning Su , Pei Lv , Mingliang Xu

Time series reasoning tasks often start with a natural language question and require targeted analysis of a time series. Evidence may span the full series or appear in a few short intervals, so the model must decide what to inspect. Most…

Machine Learning · Computer Science 2026-02-24 Shvat Messica , Jiawen Zhang , Kevin Li , Theodoros Tsiligkaridis , Marinka Zitnik