English
Related papers

Related papers: Empirical Characterization of Temporal Constraint …

200 papers

Large Language Models (LLMs) have demonstrated impressive performance in time series analysis and seems to understand the time temporal relationship well than traditional transformer-based approaches. However, since LLMs are not designed…

Machine Learning · Computer Science 2025-05-27 Liangwei Nathan Zheng , Chang George Dong , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Large Language Models (LLMs) have transformed code auto-completion by generating context-aware suggestions. Yet, deciding when to present these suggestions remains underexplored, often leading to interruptions or wasted inference calls. We…

Software Engineering · Computer Science 2026-02-10 Mohammad Nour Al Awad , Sergey Ivanov , Olga Tikhonova

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

Artificial Intelligence · Computer Science 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

Agentic memory systems enable large language model (LLM) agents to maintain state across long interactions, supporting long-horizon reasoning and personalization beyond fixed context windows. Despite rapid architectural development, the…

Computation and Language · Computer Science 2026-05-21 Dongming Jiang , Yi Li , Songtao Wei , Jinxin Yang , Ayushi Kishore , Alysa Zhao , Dingyi Kang , Xu Hu , Feng Chen , Qiannan Li , Bingzhe Li

Large language models (LLMs) achieve impressive results on many benchmarks, yet their capacity for planning and stateful reasoning remains unclear. We study these abilities directly, without code execution or other tools, using the…

Artificial Intelligence · Computer Science 2025-11-27 Charles Schepanowski , Charles Ling

Recent attempts to support high-level scene interpretation and planning in Autonomous Vehicles (AVs) using ensembles of Large Language Models (LLMs) and Large Multimodal Models (LMMs) continue to treat time as a secondary property. This…

Artificial Intelligence · Computer Science 2026-05-20 Ahmed Y. Gado , Omar Y. Goba , Alaa Hassanein , Catherine M. Elias , Ahmed Hussein

Temporal reasoning and planning are essential capabilities for large language models (LLMs), yet most existing benchmarks evaluate them in isolation and under limited forms of complexity. To address this gap, we introduce the Temporal…

Artificial Intelligence · Computer Science 2025-10-14 Zifeng Ding , Sikuan Yan , Zhangdie Yuan , Xianglong Hu , Fangru Lin , Andreas Vlachos

While large language models (LLMs) augmented with agentic search capabilities show promise for legal reasoning, they overlook a fundamental constraint that applicable law must match the temporal context of each case, as retroactive…

Computation and Language · Computer Science 2026-05-26 Wei Fan , Yining Zhou , Mufan Zhang , Yanbing Weng , Yiran HU , Tianshi Zheng , Baixuan Xu , Chunyang Li , Jianhui Yang , Haoran Li , Yangqiu Song

LLM agents do not act on raw interaction history; they act on a bounded decision state assembled by truncation, summarization, reordering, and rewriting. If directive-bearing state is dropped, weakened, or rebound during that step, an agent…

Cryptography and Security · Computer Science 2026-05-20 Igor Santos-Grueiro

The applicability of Large Language Models (LLMs) in temporal reasoning tasks over data that is not present during training is still a field that remains to be explored. In this paper we work on this topic, focusing on structured and…

Computation and Language · Computer Science 2025-12-03 Alfredo Garrachón Ruiz , Tomás de la Rosa , Daniel Borrajo

Large Language Models (LLMs) demonstrate impressive capabilities but lack robust temporal intelligence, struggling to integrate reasoning about the past with predictions and plausible generations of the future. Meanwhile, existing methods…

Computation and Language · Computer Science 2025-06-04 Zijia Liu , Peixuan Han , Haofei Yu , Haoru Li , Jiaxuan You

Large language models (LLMs) are increasingly used in daily applications, from content generation to code writing, where each interaction treats the model as stateless, generating responses independently without memory. Yet human writing is…

Computation and Language · Computer Science 2026-04-15 Zhanwei Cao , YeoJin Go , Yifan Hu , Shanu Sushmita

Conversational Spoken Language Models (SLMs) are emerging as a promising paradigm for real-time speech interaction. However, their capacity of temporal dynamics, including the ability to manage timing, tempo and simultaneous speaking,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-04 Kai-Wei Chang , En-Pei Hu , Chun-Yi Kuan , Wenze Ren , Wei-Chih Chen , Guan-Ting Lin , Yu Tsao , Shao-Hua Sun , Hung-yi Lee , James Glass

As large language models (LLMs) increasingly tackle complex reasoning tasks, test-time scaling has become critical for enhancing capabilities. However, in agentic scenarios with frequent tool calls, the traditional generation-length-based…

Computation and Language · Computer Science 2026-01-26 Yichuan Ma , Linyang Li , Yongkang chen , Peiji Li , Xiaozhe Li , Qipeng Guo , Dahua Lin , Kai Chen

Large Language Model (LLM) agents demonstrate strong performance in autonomous code generation under loose specifications. However, production-grade software requires strict adherence to structural constraints, such as architectural…

Software Engineering · Computer Science 2026-05-08 Francesco Dente , Dario Satriani , Paolo Papotti

The impact of large language models (LLMs) on critical thinking has provoked growing attention, yet this impact on actual performance may not be uniformly negative or positive. Particularly, the role of time -- the temporal context under…

Human-Computer Interaction · Computer Science 2026-03-11 Jiayin Zhi , Harsh Kumar , Mina Lee

This paper presents a temporal expression language for monitoring AI agent behavior, enabling systematic error-detection of LLM-based agentic systems that exhibit variable outputs due to stochastic generation processes. Drawing from…

Artificial Intelligence · Computer Science 2025-09-26 Thomas J Sheffler

Large language models are increasingly applied to operational decision-making where the underlying structure is constrained optimization. Existing benchmarks evaluate whether LLMs can formulate optimization problems as solver code, but…

Artificial Intelligence · Computer Science 2026-03-02 Joseph Tso , Preston Schmittou , Quan Huynh , Jibran Hutchins

Large language models (LLMs) excel across diverse natural language processing tasks but face resource demands and limited context windows. Although techniques like pruning, quantization, and token dropping can mitigate these issues, their…

Computation and Language · Computer Science 2025-08-04 Ammar Ahmed , Sheng Di , Franck Cappello , Zirui Liu , Jingoo Han , Ali Anwar