English
Related papers

Related papers: Rationale-Grounded In-Context Learning for Time Se…

200 papers

Multimodal reasoning is a challenging task that requires models to reason across multiple modalities to answer questions. Existing approaches have made progress by incorporating language and visual modalities into a two-stage reasoning…

Artificial Intelligence · Computer Science 2024-07-04 Cheng Tan , Jingxuan Wei , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Ruifeng Guo , Bihui Yu , Stan Z. Li

Reinforcement learning has advanced video reasoning in large multi-modal models, yet dominant pipelines either rely on on-policy self-exploration, which plateaus at the model's knowledge boundary, or hybrid replay that mixes policies and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Haojian Huang , Chuanyu Qin , Yinchuan Li , Yingcong Chen

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

Computation and Language · Computer Science 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Recent language models exhibit strong reasoning capabilities, yet the influence of long-context capacity on reasoning remains underexplored. In this work, we hypothesize that current limitations in reasoning stem, in part, from insufficient…

Artificial Intelligence · Computer Science 2025-05-26 Wang Yang , Zirui Liu , Hongye Jin , Qingyu Yin , Vipin Chaudhary , Xiaotian Han

Time series reasoning treats time as a first-class axis and incorporates intermediate evidence directly into the answer. This survey defines the problem and organizes the literature by reasoning topology with three families: direct…

Artificial Intelligence · Computer Science 2025-11-04 Ching Chang , Yidan Shi , Defu Cao , Wei Yang , Jeehyun Hwang , Haixin Wang , Jiacheng Pang , Wei Wang , Yan Liu , Wen-Chih Peng , Tien-Fu Chen

Reinforcement learning (RL) has become a key technique for enhancing the reasoning abilities of large language models (LLMs), with policy-gradient algorithms dominating the post-training stage because of their efficiency and effectiveness.…

Artificial Intelligence · Computer Science 2025-08-08 Chang Tian , Matthew B. Blaschko , Mingzhe Xing , Xiuxing Li , Yinliang Yue , Marie-Francine Moens

Large audio-language models (LALMs) can generate reasoning chains for their predictions, but it remains unclear whether these reasoning chains remain grounded in the input audio. In this paper, we propose an RL-based strategy that grounds…

Sound · Computer Science 2026-03-23 Jihoon Jeong , Pooneh Mousavi , Mirco Ravanelli , Cem Subakan

Large language models have recently shown promising progress in mathematical reasoning when fine-tuned with human-generated sequences walking through a sequence of solution steps. However, the solution sequences are not formally structured…

Machine Learning · Computer Science 2022-12-07 Andrew J. Nam , Mengye Ren , Chelsea Finn , James L. McClelland

Multi-modal language model has made advanced progress in vision and audio, but still faces significant challenges in dealing with complex reasoning tasks in the time series domain. The reasons are twofold. First, labels for multi-modal time…

Machine Learning · Computer Science 2025-03-10 Haochuan Zhang , Chunhua Yang , Jie Han , Liyang Qin , Xiaoli Wang

Understanding time series is crucial for its application in real-world scenarios. Recently, large language models (LLMs) have been increasingly applied to time series tasks, leveraging their strong language capabilities to enhance various…

Artificial Intelligence · Computer Science 2026-01-06 Zhe Xie , Zeyan Li , Xiao He , Longlong Xu , Xidao Wen , Tieying Zhang , Jianjun Chen , Rui Shi , Dan Pei

The black-box nature of neural models has motivated a line of research that aims to generate natural language rationales to explain why a model made certain predictions. Such rationale generation models, to date, have been trained on…

Computation and Language · Computer Science 2020-12-16 Faeze Brahman , Vered Shwartz , Rachel Rudinger , Yejin Choi

Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation…

Machine Learning · Computer Science 2024-11-01 Abhimanyu Das , Matthew Faw , Rajat Sen , Yichen Zhou

Reasoning-oriented language models typically expose explicit reasoning as a long, front-loaded chain of "thinking" tokens before the main output, either always enabled or externally toggled at inference time. Although this can help on…

Machine Learning · Computer Science 2026-05-05 Susmit Das

We propose a large language model explainability technique for obtaining faithful natural language explanations by grounding the explanations in a reasoning process. When converted to a sequence of tokens, the outputs of the reasoning…

Machine Learning · Computer Science 2026-03-17 Vojtech Cahlik , Rodrigo Alves , Pavel Kordik

We propose RecaLLM, a set of reasoning language models post-trained to make effective use of long-context information. In-context retrieval, which identifies relevant evidence from context, and reasoning are deeply intertwined: retrieval…

Computation and Language · Computer Science 2026-04-13 Kyle Whitecross , Negin Rahimi

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Causal inference remains a fundamental challenge for large language models. Recent advances in internal reasoning with large language models have sparked interest in whether state-of-the-art reasoning models can robustly perform causal…

Artificial Intelligence · Computer Science 2025-08-01 Kacper Kadziolka , Saber Salehkaleybar

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

The emergent few-shot reasoning capabilities of Large Language Models (LLMs) have excited the natural language and machine learning community over recent years. Despite of numerous successful applications, the underlying mechanism of such…

Computation and Language · Computer Science 2023-06-09 Xiaojuan Tang , Zilong Zheng , Jiaqi Li , Fanxu Meng , Song-Chun Zhu , Yitao Liang , Muhan Zhang

Conceptual reasoning, the ability to reason in abstract and high-level perspectives, is key to generalization in human cognition. However, limited study has been done on large language models' capability to perform conceptual reasoning. In…

Computation and Language · Computer Science 2024-04-02 Ben Zhou , Hongming Zhang , Sihao Chen , Dian Yu , Hongwei Wang , Baolin Peng , Dan Roth , Dong Yu