English
Related papers

Related papers: TEMPO: Temporal Enforcement via Mode-Separated Pol…

200 papers

Test-time training (TTT) adapts model parameters on unlabeled test instances during inference time, which continuously extends capabilities beyond the reach of offline training. Despite initial gains, existing TTT methods for LRMs plateau…

Machine Learning · Computer Science 2026-04-22 Qingyang Zhang , Xinke Kong , Haitao Wu , Qinghua Hu , Minghao Wu , Baosong Yang , Yu Cheng , Yun Luo , Ganqu Cui , Changqing Zhang

Large language models (LLMs) often fail to reason under temporal cutoffs: when prompted to answer from the standpoint of an earlier time, they exploit knowledge that became available only later. We study this failure through the lens of…

Artificial Intelligence · Computer Science 2026-05-15 Chenlu Ding , Jiancan Wu , Yanchen Luo , Zheyuan Liu , Yancheng Yuan , Xiang Wang

Large language models (LLMs) face significant challenges in ex-ante reasoning, where analysis, inference, or predictions must be made without access to information from future events. Even with explicit prompts enforcing temporal cutoffs,…

Machine Learning · Computer Science 2025-05-27 Yachuan Liu , Xiaochun Wei , Lin Shi , Xinnuo Li , Bohan Zhang , Paramveer Dhillon , Qiaozhu Mei

Backtesting LLMs on resolved events assumes models reason only from pre-cutoff knowledge, yet pretrained models inevitably leak post-cutoff knowledge. We introduce a claim-level evaluation framework that decomposes prediction rationales…

Artificial Intelligence · Computer Science 2026-05-26 Zeyu Zhang , Ryan Chen , Bradly C. Stadie

Post-cutoff performance decay of LLMs has been widely interpreted as a temporal signal for benchmark contamination, where public information released before the training cutoff may have been included into training corpora and inflated model…

Fine-tuning large language models (LLMs) is intended to improve their reasoning capabilities, yet we uncover a counterintuitive effect: models often forget how to solve problems they previously answered correctly during training. We term…

Artificial Intelligence · Computer Science 2025-05-27 Yuetai Li , Zhangchen Xu , Fengqing Jiang , Bhaskar Ramasubramanian , Luyao Niu , Bill Yuchen Lin , Xiang Yue , Radha Poovendran

Released Large Language Models (LLMs) are often paired with a claimed knowledge cutoff date, or the dates at which training data was gathered. Such information is crucial for applications where the LLM must provide up to date information.…

Computation and Language · Computer Science 2024-09-18 Jeffrey Cheng , Marc Marone , Orion Weller , Dawn Lawrie , Daniel Khashabi , Benjamin Van Durme

Large Language Models (LLMs) are widely used for temporal prediction, but their reliance on pretraining data raises contamination concerns, as accurate predictions on pre-cutoff test data may reflect memorization rather than reasoning,…

Computation and Language · Computer Science 2025-10-16 Xin Gao , Ruiyi Zhang , Daniel Du , Saurabh Mahindre , Sai Ashish Somayajula , Pengtao Xie

Existing temporal QA benchmarks focus on simple fact-seeking queries from news corpora, while reasoning-intensive retrieval benchmarks lack temporal grounding. However, real-world information needs often require reasoning about temporal…

Information Retrieval · Computer Science 2026-01-15 Abdelrahman Abdallah , Mohammed Ali , Muhammad Abdul-Mageed , Adam Jatowt

Temporal predictive models have the potential to improve decisions in health care, public services, and other domains, yet they often fail to effectively support decision-makers. Prior literature shows that many misalignments between model…

Human-Computer Interaction · Computer Science 2025-02-21 Venkatesh Sivaraman , Anika Vaishampayan , Xiaotong Li , Brian R Buck , Ziyong Ma , Richard D Boyce , Adam Perer

Early-warning models built from Learning Management System (LMS) logs aim to predict end-of-course outcomes early enough to enable timely learner support. However, reported "early" performance is often inflated by temporal leakage. This…

Artificial Intelligence · Computer Science 2026-05-26 Ngoc Luyen Le , Marie-Hélène Abel , Bertrand Laforge

The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary highly across applications and domains. Meanwhile, for natural…

Machine Learning · Computer Science 2024-04-03 Defu Cao , Furong Jia , Sercan O Arik , Tomas Pfister , Yixiang Zheng , Wen Ye , Yan Liu

Many facts come with an expiration date, from the name of the President to the basketball team Lebron James plays for. But language models (LMs) are trained on snapshots of data collected at a specific moment in time, and this can limit…

Computation and Language · Computer Science 2022-04-26 Bhuwan Dhingra , Jeremy R. Cole , Julian Martin Eisenschlos , Daniel Gillick , Jacob Eisenstein , William W. Cohen

Reasoning about time is of fundamental importance. Many facts are time-dependent. For example, athletes change teams from time to time, and different government officials are elected periodically. Previous time-dependent question answering…

Computation and Language · Computer Science 2023-06-28 Qingyu Tan , Hwee Tou Ng , Lidong Bing

Temporal reasoning over long, multi-session dialogues is a critical capability for conversational agents. However, existing works and our pilot study have shown that as dialogue histories grow in length and accumulate noise, current…

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

Computation and Language · Computer Science 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks such as temporal localization, action detection, and time-sensitive question answering.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tao Wu , Li Yang , Gen Zhan , Yabin Zhang , Yiting Liao , Junlin Li , Deliang Fu , Li Zhang , Limin Wang

While scaling the length of responses at test-time has been shown to markedly improve the reasoning abilities and performance of large language models (LLMs), it often results in verbose outputs and increases inference cost. Prior…

Computation and Language · Computer Science 2025-11-18 Chengyu Huang , Zhengxin Zhang , Claire Cardie

Reasoning-oriented language models typically expose explicit reasoning as a long, front-loaded chain of "thinking" tokens before the main output, either always enabled or externally toggled at inference time. Although this can help on…

Machine Learning · Computer Science 2026-05-05 Susmit Das
‹ Prev 1 2 3 10 Next ›