English
Related papers

Related papers: Temporal Consistency for LLM Reasoning Process Err…

200 papers

Sequential deep learning models such as RNN, causal CNN and attention mechanism do not readily consume continuous-time information. Discretizing the temporal data, as we show, causes inconsistency even for simple continuous-time processes.…

Machine Learning · Computer Science 2021-03-30 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Large Language Models (LLMs) have demonstrated strong reasoning capabilities in solving complex problems. However, current approaches primarily enhance reasoning through the elaboration of thoughts while neglecting the diversity of…

Computation and Language · Computer Science 2025-04-25 Danqing Wang , Jianxin Ma , Fei Fang , Lei Li

LLMs are highly sensitive to prompt phrasing, yet standard benchmarks typically report performance using a single prompt, raising concerns about the reliability of such evaluations. In this work, we argue for a stochastic method of moments…

Computation and Language · Computer Science 2025-09-16 Gili Lior , Eliya Habba , Shahar Levy , Avi Caciularu , Gabriel Stanovsky

We present a method for systematically evaluating the correctness and robustness of instruction-tuned large language models (LLMs) for code generation via a new benchmark, Turbulence. Turbulence consists of a large set of natural language…

Software Engineering · Computer Science 2025-01-28 Shahin Honarvar , Mark van der Wilk , Alastair Donaldson

When deploying LLMs in agentic architectures requiring real-time decisions under temporal constraints, we assume they reliably determine whether action windows remain open or have closed. This assumption is untested. We characterize…

Computation and Language · Computer Science 2025-11-17 Javier Marín

As LLM-based judges become integral to industry applications, obtaining well-calibrated uncertainty estimates efficiently has become critical for production deployment. However, existing techniques, such as verbalized confidence and…

Machine Learning · Computer Science 2025-12-30 Bhaktipriya Radharapu , Eshika Saxena , Kenneth Li , Chenxi Whitehouse , Adina Williams , Nicola Cancedda

Recent advances such as Chain-of-Thought prompting have significantly improved large language models (LLMs) in zero-shot medical reasoning. However, prompting-based methods often remain shallow and unstable, while fine-tuned medical LLMs…

Computation and Language · Computer Science 2025-05-27 Jianghao Wu , Feilong Tang , Yulong Li , Ming Hu , Haochen Xue , Shoaib Jameel , Yutong Xie , Imran Razzak

Test-time compute has emerged as a powerful paradigm for improving the performance of large language models (LLMs), where generating multiple outputs or refining individual chains can significantly boost answer accuracy. However, existing…

Machine Learning · Computer Science 2025-09-26 Sheng Liu , Tianlang Chen , Pan Lu , Haotian Ye , Yizheng Chen , Lei Xing , James Zou

Reasoning models improve their problem-solving ability through inference-time scaling, allocating more compute via longer token budgets. Identifying which reasoning traces are likely to succeed remains a key opportunity: reliably predicting…

Artificial Intelligence · Computer Science 2025-10-14 Martina G. Vilas , Safoora Yousefi , Besmira Nushi , Eric Horvitz , Vidhisha Balachandran

Advances in training, post-training, and inference-time methods have enabled frontier reasoning models to win gold medals in math competitions and settle challenging open problems. Gaining trust in the responses of these models requires…

Machine Learning · Computer Science 2026-04-06 Aaditya Naik , Guruprerana Shabadi , Rajeev Alur , Mayur Naik

Large Language Models (LLMs) have recently improved mathematical reasoning through Reinforcement Learning with Verifiable Reward (RLVR). However, existing RLVR algorithms require large query budgets, making annotation costly. We investigate…

Artificial Intelligence · Computer Science 2026-02-02 Hao Yi , Yulan Hu , Xin Li , Sheng Ouyang , Lizhong Ding , Yong Liu

With the rapid advancement of Artificial Intelligence (AI), Large Language Models (LLMs) have significantly impacted a wide array of domains, including healthcare, engineering, science, education, and mathematical reasoning. Among these,…

Machine Learning · Computer Science 2025-05-20 Afrar Jahin , Arif Hassan Zidan , Wei Zhang , Yu Bao , Tianming Liu

The rapid advancement of large language models (LLMs) has shown remarkable progress in complex reasoning tasks. However, a significant disparity exists between benchmark performances and real-world applications. We attribute this gap…

Artificial Intelligence · Computer Science 2025-08-11 Junnan Liu , Hongwei Liu , Linchen Xiao , Ziyi Wang , Kuikun Liu , Songyang Gao , Wenwei Zhang , Songyang Zhang , Kai Chen

Reachable set computation is an important tool for analyzing control systems. Simulating a control system can show general trends, but a formal tool like reachability analysis can provide guarantees of correctness. Reachability analysis for…

Systems and Control · Electrical Eng. & Systems 2025-05-07 Chelsea Sidrane , Jana Tumova

Vision-Language Models (VLMs) have achieved impressive performance across a wide range of multimodal tasks, yet they often exhibit inconsistent behavior when faced with semantically equivalent inputs, undermining their reliability and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Shih-Han Chou , Shivam Chandhok , James J. Little , Leonid Sigal

While enjoying the great achievements brought by deep learning (DL), people are also worried about the decision made by DL models, since the high degree of non-linearity of DL models makes the decision extremely difficult to understand.…

Machine Learning · Computer Science 2023-09-13 Jinwen He , Kai Chen , Guozhu Meng , Jiangshan Zhang , Congyi Li

Recent advancements in Large Language Models (LLMs) have created new opportunities to enhance performance on complex reasoning tasks by leveraging test-time computation. However, existing scaling methods have key limitations: parallel…

Artificial Intelligence · Computer Science 2025-12-04 Jiefeng Chen , Jie Ren , Xinyun Chen , Chengrun Yang , Ruoxi Sun , Jinsung Yoon , Sercan Ö Arık

Runtime verification enables checking temporal logic specifications over individual execution traces and offers a scalable alternative to exhaustive formal verification. In practice, systems must satisfy dozens to hundreds of temporal…

Logic in Computer Science · Computer Science 2026-05-14 Arınç Demir , Dogan Ulus

Large language models (LLMs) have transformed sentiment analysis, yet balancing accuracy, efficiency, and explainability remains a critical challenge. This study presents the first comprehensive evaluation of DeepSeek-R1--an open-source…

Computation and Language · Computer Science 2026-02-05 Donghao Huang , Zhaoxia Wang

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin