English
Related papers

Related papers: Reasoning-Aware Training for Time Series Forecasti…

200 papers

Time-series diagnostic reasoning is essential for many applications, yet existing solutions face a persistent gap: general reasoning large language models (GRLMs) possess strong reasoning skills but lack the domain-specific knowledge to…

Transformer-based models such as BERT and E5 have significantly advanced text embedding by capturing rich contextual representations. However, many complex real-world queries require sophisticated reasoning to retrieve relevant documents…

Computation and Language · Computer Science 2025-09-03 Yuxiang Liu , Tian Wang , Gourab Kundu , Tianyu Cao , Guang Cheng , Zhen Ge , Jianshu Chen , Qingjun Cui , Trishul Chilimbi

Although Large Language Models have advanced Automated Heuristic Design, treating algorithm evolution as a monolithic text generation task overlooks the coupling between discrete algorithmic structures and continuous numerical parameters.…

Artificial Intelligence · Computer Science 2026-02-10 Chentong Chen , Mengyuan Zhong , Ye Fan , Jialong Shi , Jianyong Sun

Modeling stochastic and irregularly sampled time series is a challenging problem found in a wide range of applications, especially in medicine. Neural stochastic differential equations (Neural SDEs) are an attractive modeling technique for…

Machine Learning · Computer Science 2025-02-05 Xi Zhang , Yuan Pu , Yuki Kawamura , Andrew Loza , Yoshua Bengio , Dennis L. Shung , Alexander Tong

Time-Series Foundation Models (TSFMs) excel at zero-shot unimodal forecasting using numerical data, but unlike LLMs they cannot consume multimodal, non-numerical context that often shape real-world trajectories. In this work, we bridge this…

Machine Learning · Computer Science 2026-05-29 Haoxin Liu , Yichen Zhou , Rajat Sen , B. Aditya Prakash , Abhimanyu Das

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

Machine Learning · Computer Science 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

Large reasoning models (LRMs) excel at complex reasoning tasks but typically generate lengthy sequential chains-of-thought, resulting in long inference times before arriving at the final answer. To address this challenge, we introduce…

Artificial Intelligence · Computer Science 2025-12-04 Emil Biju , Shayan Talaei , Zhemin Huang , Mohammadreza Pourreza , Azalia Mirhoseini , Amin Saberi

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and…

Time series forecasting, while vital in various applications, often employs complex models that are difficult for humans to understand. Effective explainable AI techniques are crucial to bridging the gap between model predictions and user…

Artificial Intelligence · Computer Science 2024-09-25 Hongnan Ma , Kevin McAreavey , Weiru Liu

The internalization of chain-of-thought processes into hidden states has emerged as a highly efficient paradigm for scaling test-time compute. However, existing activation steering methods rely on static control vectors that fail to adapt…

Machine Learning · Computer Science 2026-02-06 Zhenning Shi , Yijia Zhu , Junhan Shi , Xun Zhang , Lei Wang , Congcong Miao

Conventional forecasting methods rely on unimodal time series data, limiting their ability to exploit rich textual information. Recently, large language models (LLMs) and time series foundation models (TSFMs) have demonstrated powerful…

Machine Learning · Computer Science 2025-05-16 Chengsen Wang , Qi Qi , Zhongwen Rao , Lujia Pan , Jingyu Wang , Jianxin Liao

Time series foundation models (TSFMs) promise to be powerful tools for a wide range of applications. However, their internal representations and learned concepts are still not well understood. In this study, we investigate the structure and…

Machine Learning · Computer Science 2025-06-09 Michał Wiliński , Mononito Goswami , Willa Potosnak , Nina Żukowska , Artur Dubrawski

Recent advances in multimodal time series learning underscore a paradigm shift from analytics centered on basic patterns toward advanced time series understanding and reasoning. However, existing multimodal time series datasets mostly…

Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs) and Large Language Model-based Time Series Models (TSLLMs),…

Machine Learning · Computer Science 2025-03-17 Xu Liu , Taha Aksu , Juncheng Liu , Qingsong Wen , Yuxuan Liang , Caiming Xiong , Silvio Savarese , Doyen Sahoo , Junnan Li , Chenghao Liu

Time series forecasting plays a critical role in decision-making across many real-world applications. Unlike data in vision and language domains, time series data is inherently tied to the evolution of underlying processes and can only…

Machine Learning · Computer Science 2026-02-03 Suhan Guo , Bingxu Wang , Shaodan Zhang , Furao Shen

Direct preference optimization methods have emerged as a computationally efficient alternative to Reinforcement Learning from Human Feedback (RLHF) for aligning Large Language Models (LLMs). Latest approaches have streamlined the alignment…

Machine Learning · Computer Science 2026-02-04 Maksim Afanasyev , Illarion Iov

Process Model Forecasting (PMF) aims to predict how the control-flow structure of a process evolves over time by modeling the temporal dynamics of directly-follows (DF) relations, complementing predictive process monitoring that focuses on…

Machine Learning · Computer Science 2025-12-09 Yongbo Yu , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

This work summarizes two ways to accomplish Time-Series (TS) tasks in today's Large Language Model (LLM) context: LLM-for-TS (model-centric) designs and trains a fundamental large model, or fine-tunes a pre-trained LLM for TS data;…

Computation and Language · Computer Science 2024-02-23 Chenxi Sun , Hongyan Li , Yaliang Li , Shenda Hong

Time series forecasting (TSF) plays a critical role in decision-making for many real-world applications. Recently, LLM-based forecasters have made promising advancements. Despite their effectiveness, existing methods often lack explicit…

Machine Learning · Computer Science 2026-02-04 Xiaoyu Tao , Mingyue Cheng , Ze Guo , Shuo Yu , Yaguo Liu , Qi Liu , Shijin Wang

Time series is a pervasive data type across various application domains, rendering the reasonable solving of diverse time series tasks a long-standing goal. Recent advances in large language models (LLMs), especially their reasoning…

Artificial Intelligence · Computer Science 2026-05-08 Jiahui Zhou , Dan Li , Boxin Li , Xiao Zhang , Erli Meng , Lin Li , Zhuomin Chen , Jian Lou , See-Kiong Ng