English
Related papers

Related papers: Beyond Scalars: Evaluating and Understanding LLM R…

200 papers

Terrain geometry is, in general, non-smooth, non-linear, non-convex, and, if perceived through a robot-centric visual unit, appears partially occluded and noisy. This work presents the complete control pipeline capable of handling the…

Robotics · Computer Science 2022-07-06 Fabian Jenelten , Ruben Grandia , Farbod Farshidian , Marco Hutter

The inherent capabilities of a language model (LM) and the reasoning strategies it employs jointly determine its performance in reasoning tasks. While test-time scaling is regarded as an effective approach to tackling complex reasoning…

Computation and Language · Computer Science 2025-05-27 Zhihong Pan , Kai Zhang , Yuze Zhao , Yupeng Han

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Reasoning-trained language models often spend more tokens on harder problems, but longer chains of thought do not show whether a model is merely computing for more steps or following a different internal trajectory. We study this…

Computation and Language · Computer Science 2026-05-18 Anders Gjølbye , Lars Kai Hansen , Sanmi Koyejo

Large Language Models (LLMs) have demonstrated promising capabilities in solving mathematical reasoning tasks, leveraging Chain-of-Thought (CoT) data as a vital component in guiding answer generation. Current paradigms typically generate…

Computation and Language · Computer Science 2025-03-20 Honglin Lin , Zhuoshi Pan , Yu Li , Qizhi Pei , Xin Gao , Mengzhang Cai , Conghui He , Lijun Wu

Inspired by human behavior when traveling over unknown terrain, this study proposes the use of probing strategies and integrates them into a traversability analysis framework to address safe navigation on unknown rough terrain. Our…

Large Language Model interfaces are increasingly verbose, exposing intermediate reasoning traces alongside final answers. Traces are framed as transparency mechanisms, yet it is unclear how people use them to solve problems. We report a…

Human-Computer Interaction · Computer Science 2026-05-26 Daniela Fernandes , Daniel Buschek , Lev Tankelevitch , Thomas Kosch , Robin Welsch

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Chain-of-thought (CoT) reasoning enables large language models (LLMs) to break down complex problems into interpretable intermediate steps, significantly enhancing model transparency and performance in reasoning tasks. However, conventional…

Machine Learning · Computer Science 2026-01-30 Junda Wu , Yuxin Xiong , Xintong Li , Sheldon Yu , Zhengmian Hu , Tong Yu , Rui Wang , Xiang Chen , Jingbo Shang , Julian McAuley

Branched structures that evolve over time critically determine the function of various natural and engineered systems, including growing vasculature, neural arborization, pulmonary networks such as lungs, river basins, power distribution…

Statistical Mechanics · Physics 2026-03-04 Fabian H. Kreten , Ludger Santen , Reza Shaebani

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

Computation and Language · Computer Science 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

LLMs have made significant progress in the field of mathematical reasoning, but whether they have true the mathematical understanding ability is still controversial. To explore this issue, we propose a new perturbation framework to evaluate…

Artificial Intelligence · Computer Science 2025-11-12 Zhishen Sun , Guang Dai , Ivor Tsang , Haishan Ye

Traversals are commonly seen in tree data structures, and performance-enhancing transformations between tree traversals are critical for many applications. Existing approaches to reasoning about tree traversals and their transformations are…

Programming Languages · Computer Science 2019-10-28 Yanjun Wang , Jinwei Liu , Dalin Zhang , Xiaokang Qiu

This paper presents GRASP, a novel benchmark to evaluate the language grounding and physical understanding capabilities of video-based multimodal large language models (LLMs). This evaluation is accomplished via a two-tier approach…

Computation and Language · Computer Science 2024-06-07 Serwan Jassim , Mario Holubar , Annika Richter , Cornelius Wolff , Xenia Ohmer , Elia Bruni

LLMs have achieved remarkable success in complex reasoning tasks, yet current evaluation approaches predominantly rely on final-answer correctness, offering limited insight into the underlying reasoning processes that produce those answers.…

Artificial Intelligence · Computer Science 2026-05-26 Ali Şenol , Garima Agrawal , Huan Liu

As LLMs are increasingly used as judges in code applications, they should be evaluated in realistic interactive settings that capture partial context and ambiguous intent. We present TRACE (Tool for Rubric Analysis in Code Evaluation), a…

Software Engineering · Computer Science 2026-05-15 Aditya Mittal , Ryan Shar , Zichu Wu , Shyam Agarwal , Tongshuang Wu , Chris Donahue , Ameet Talwalkar , Wayne Chi , Valerie Chen

Test-time scaling, which leverages additional computation during inference to improve model accuracy, has enabled a new class of Large Language Models (LLMs) that are able to reason through complex problems by understanding the goal,…

Computation and Language · Computer Science 2025-11-25 Shaltiel Shmidman , Asher Fredman , Oleg Sudakov , Meriem Bendris

Vision-language models (VLMs) are powerful but remain opaque black boxes. We introduce the first framework for transparent circuit tracing in VLMs to systematically analyze multimodal reasoning. By utilizing transcoders, attribution graphs,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Jingcheng Yang , Tianhu Xiong , Shengyi Qian , Klara Nahrstedt , Mingyuan Wu

While Vision-Language Models (VLMs) excel in many areas, they struggle with complex spatial reasoning, which requires problem decomposition and strategic tool use. Fine-tuning smaller, more deployable models offers an efficient path to…

Machine Learning · Computer Science 2025-11-04 Gio Huh , Dhruv Sheth , Rayhan Zirvi , Frank Xiao

Vision-Language Models (VLMs) have achieved strong performance on general multimodal reasoning, yet remain challenged in integrating nonlocal visual information to support semantically underdetermined visual reasoning. We describe this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Tengda Guo , Jie Leng , Hanlei Li , Yaoyuan Liang , Qingyue Zhang , Dian Yang , Mingyu Zhang , Yuhua Fu , Shao-Lun Huang