English
Related papers

Related papers: Measuring AI Reasoning: A Guide for Researchers

200 papers

If AI models can detect when they are being evaluated, the effectiveness of evaluations might be compromised. For example, models could have systematically different behavior during evaluations, leading to less reliable benchmarks for…

Computation and Language · Computer Science 2025-07-17 Joe Needham , Giles Edkins , Govind Pimpale , Henning Bartsch , Marius Hobbhahn

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

We identify a fundamental incompatibility between the goals of accuracy, trust, and human-level reasoning in artificial intelligence (AI) systems, for strict mathematical definitions of these notions. We define accuracy of a system as the…

Machine Learning · Computer Science 2026-05-11 Rina Panigrahy , Vatsal Sharan

Chain of thought reasoning has demonstrated remarkable success in large language models, yet its adaptation to vision-language reasoning remains an open challenge with unclear best practices. Existing attempts typically employ reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Honghao Chen , Xingzhou Lou , Xiaokun Feng , Kaiqi Huang , Xinlong Wang

Many applications of large language models (LLMs) require deductive reasoning, yet models frequently produce incorrect or redundant inference steps. We frame natural language inference as a search problem where the final answer is the valid…

Artificial Intelligence · Computer Science 2026-05-26 Andreas Opedal , Francesco Ignazio Re , Abulhair Saparov , Mrinmaya Sachan , Bernhard Schölkopf , Ryan Cotterell

As AI systems advance and integrate into society, well-designed and transparent evaluations are becoming essential tools in AI governance, informing decisions by providing evidence about system capabilities and risks. Yet there remains a…

This study empirically examines the "Evaluative AI" framework, which aims to enhance the decision-making process for AI users by transitioning from a recommendation-based approach to a hypothesis-driven one. Rather than offering direct…

Human-Computer Interaction · Computer Science 2024-11-14 Jaroslaw Kornowicz

This paper asks whether a bounded neural architecture can exhibit a meaningful division of labor between intuition and deliberation on a classic 64-item syllogistic reasoning benchmark. More broadly, the benchmark is relevant to ongoing…

Artificial Intelligence · Computer Science 2026-03-25 Laurence Anthony

Artificial intelligence (AI) tools are being incorporated into scientific research workflows with the potential to enhance efficiency in tasks such as document analysis, question answering (Q&A), and literature search. However, system…

Artificial Intelligence · Computer Science 2026-05-13 Anthea Dathe , Kiran Hoffmann , Aline Mangold

As large-scale language models increasingly impact safety-critical domains, ensuring their reliable adherence to well-defined principles remains a fundamental challenge. We introduce Deliberative Alignment, a new paradigm that directly…

Generating accurate step-by-step reasoning is essential for Large Language Models (LLMs) to address complex problems and enhance robustness and interpretability. Despite the flux of research on developing advanced reasoning approaches,…

Computation and Language · Computer Science 2024-08-13 Shibo Hao , Yi Gu , Haotian Luo , Tianyang Liu , Xiyan Shao , Xinyuan Wang , Shuhua Xie , Haodi Ma , Adithya Samavedhi , Qiyue Gao , Zhen Wang , Zhiting Hu

We introduce modeLing, a novel benchmark of Linguistics Olympiad-style puzzles which tests few-shot reasoning in AI systems. Solving these puzzles necessitates inferring aspects of a language's grammatical structure from a small number of…

Computation and Language · Computer Science 2024-06-26 Nathan A. Chi , Teodor Malchev , Riley Kong , Ryan A. Chi , Lucas Huang , Ethan A. Chi , R. Thomas McCoy , Dragomir Radev

Large language models (LLMs) with Chain-of-Thought (CoT) prompting achieve strong reasoning but often produce unnecessarily long explanations, increasing cost and sometimes reducing accuracy. Fair comparison of efficiency-oriented…

Computation and Language · Computer Science 2025-11-14 Junquan Huang , Haotian Wu , Yubo Gao , Yibo Yan , Junyan Zhang , Yonghua Hei , Song Dai , Jie Zhang , Puay Siew Tan , Xuming Hu

The recent advancements in Deep Learning models and techniques have led to significant strides in performance across diverse tasks and modalities. However, while the overall capabilities of models show promising growth, our understanding of…

Artificial Intelligence · Computer Science 2025-04-04 Erik Arakelyan

With the growing success of reasoning models across complex natural language tasks, researchers in the Information Retrieval (IR) community have begun exploring how similar reasoning capabilities can be integrated into passage rerankers…

Information Retrieval · Computer Science 2025-05-23 Nour Jedidi , Yung-Sung Chuang , James Glass , Jimmy Lin

Explainable artificial intelligence techniques are developed at breakneck speed, but suitable evaluation approaches lag behind. With explainers becoming increasingly complex and a lack of consensus on how to assess their utility, it is…

Human-Computer Interaction · Computer Science 2023-04-18 Edward Small , Yueqing Xuan , Danula Hettiachchi , Kacper Sokol

During the first step of practical reasoning, i.e. deliberation or goals selection, an intelligent agent generates a set of pursuable goals and then selects which of them he commits to achieve. Explainable Artificial Intelligence (XAI)…

Artificial Intelligence · Computer Science 2020-09-15 Mariela Morveli-Espinoza , Cesar Augusto Tacla , Henrique Jasinski

Test-time compute scaling allocates inference computation uniformly, uses fixed sampling strategies, and applies verification only for reranking. In contrast, we propose a verifier-guided adaptive framework treating reasoning as iterative…

Computation and Language · Computer Science 2026-04-08 Ahsan Bilal , Ahmed Mohsin , Muhammad Umer , Ali Subhan , Hassan Rizwan , Ayesha Mohsin , Dean Hougen

Intelligent coding systems are transforming software development by enabling users to specify code behavior in natural language. However, the opaque decision-making of AI-driven coders raises trust and usability concerns, particularly for…

Software Engineering · Computer Science 2025-08-11 Xiangzhe Xu , Shiwei Feng , Zian Su , Chengpeng Wang , Xiangyu Zhang

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu