English
Related papers

Related papers: Strategy Executability in Mathematical Reasoning: …

200 papers

Tasks requiring deductive reasoning, especially those involving multiple steps, often demand adaptive strategies such as intermediate generation of rationales or programs, as no single approach is universally optimal. While Language Models…

Artificial Intelligence · Computer Science 2024-10-22 Rongxing Liu , Kumar Shridhar , Manish Prajapat , Patrick Xia , Mrinmaya Sachan

Large language models (LLMs) have achieved impressive results on multi-step mathematical reasoning, yet at the cost of high computational overhead. This challenge is particularly acute for test-time scaling methods such as parallel…

Machine Learning · Computer Science 2026-03-24 Yuanlin Chu , Bo Wang , Xiang Liu , Hong Chen , Aiwei Liu , Xuming Hu

Reinforcement learning (RL) has become the dominant paradigm for improving the performance of language models on complex reasoning tasks. Despite the substantial empirical gains demonstrated by RL-based training methods like GRPO, a…

Artificial Intelligence · Computer Science 2025-10-27 Jiayu Wang , Yifei Ming , Zixuan Ke , Caiming Xiong , Shafiq Joty , Aws Albarghouthi , Frederic Sala

Hybrid reasoning systems that combine learned components with model-based inference are increasingly deployed in tool-augmented decision loops, yet their runtime behavior under partial observability and sustained evidence mismatch remains…

Machine Learning · Computer Science 2026-02-19 Barak Or

Small language models (SLMs) enable low-cost, private, on-device inference, but they often fail on problems that require specialized domain knowledge or multi-step reasoning. Existing approaches for improving reasoning either rely on scale…

Computation and Language · Computer Science 2026-01-08 Kenan Alkiek , David Jurgens , Vinod Vydiswaran

Large Language Models (LLMs) have demonstrated remarkable reasoning abilities, yet existing test-time frameworks often rely on coarse self-verification and self-correction, limiting their effectiveness on complex tasks. In this paper, we…

Computation and Language · Computer Science 2025-11-14 Haizhou Shi , Ye Liu , Bo Pang , Zeyu Leo Liu , Hao Wang , Silvio Savarese , Caiming Xiong , Yingbo Zhou , Semih Yavuz

Mathematical reasoning---a core ability within human intelligence---presents some unique challenges as a domain: we do not come to understand and solve mathematical problems primarily on the back of experience and evidence, but on the basis…

Machine Learning · Computer Science 2019-04-03 David Saxton , Edward Grefenstette , Felix Hill , Pushmeet Kohli

Reproducibility remains a central challenge in computational social science, where complex workflows, evolving software ecosystems, and inconsistent documentation hinder researchers ability to re-execute published methods. This study…

Human-Computer Interaction · Computer Science 2026-03-04 Fakhri Momeni , Sarah Sajid , Johannes Kiesel

Strategic recommendations (SR) refer to the problem where an intelligent agent observes the sequential behaviors and activities of users and decides when and how to interact with them to optimize some long-term objectives, both for the user…

Machine Learning · Computer Science 2020-09-17 Georgios Theocharous , Yash Chandak , Philip S. Thomas , Frits de Nijs

Structured reasoning can improve the inference performance of large language models (LLMs), but it also introduces computational cost and control constraints. When additional reasoning structure helps, and when it instead reduces efficiency…

Machine Learning · Computer Science 2026-04-14 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Large language models excel on static benchmarks, but their ability as self-learning agents in dynamic environments remains unclear. We evaluate three prompting strategies: self-reflection, heuristic mutation, and planning across dynamic…

Artificial Intelligence · Computer Science 2025-08-12 Annie Wong , Thomas Bäck , Aske Plaat , Niki van Stein , Anna V. Kononova

Human reasoning is shaped by resource rationality -- optimizing performance under constraints. Recently, inference-time scaling has emerged as a powerful paradigm to improve the reasoning performance of Large Language Models by expanding…

Computation and Language · Computer Science 2026-02-12 Zhimin Hu , Riya Roshan , Sashank Varma

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

In settings where Machine Learning (ML) algorithms automate or inform consequential decisions about people, individual decision subjects are often incentivized to strategically modify their observable attributes to receive more favorable…

Machine Learning · Computer Science 2022-06-10 Keegan Harris , Daniel Ngo , Logan Stapleton , Hoda Heidari , Zhiwei Steven Wu

Tabular data remains prevalent in high-stakes domains such as healthcare and finance, where predictive models are expected to provide both high accuracy and faithful, human-understandable reasoning. While symbolic models offer verifiable…

Artificial Intelligence · Computer Science 2026-05-20 Chenlang Yi , Gang Li , Zizhan Xiong , Tue Minh Cao , Yanmin Gong , My T. Thai , Tianbao Yang

Human-annotated textual explanations are becoming increasingly important in Explainable Natural Language Processing. Rationale extraction aims to provide faithful (i.e., reflective of the behavior of the model) and plausible (i.e.,…

Computation and Language · Computer Science 2023-10-24 Mohammad Reza Ghasemi Madani , Pasquale Minervini

Human reasoning involves different strategies, each suited to specific problems. Prior work shows that large language model (LLMs) tend to favor a single reasoning strategy, potentially limiting their effectiveness in diverse reasoning…

Computation and Language · Computer Science 2025-07-17 Yanjian Zhang , Guillaume Wisniewski , Nadi Tomeh , Thierry Charnois

In multi-agent IR pipelines for tasks such as search and ranking, LLM-based agents exchange intermediate reasoning in terms of Chain-of-Thought (CoT) with each other. Current CoT evaluation narrowly focuses on target task accuracy. However,…

Artificial Intelligence · Computer Science 2026-02-20 Shashank Aggarwal , Ram Vikas Mishra , Amit Awekar

Reinforcement learning (RL) has been widely applied to sequential decision making, where interpretability and performance are both critical for practical adoption. Current approaches typically focus on performance and rely on post hoc…

Machine Learning · Computer Science 2025-10-07 Qianxin Yi , Shao-Bo Lin , Jun Fan , Yao Wang

Replication of experimental results has been a challenge faced by many scientific disciplines, including the field of machine learning. Recent work on the theory of machine learning has formalized replicability as the demand that an…

Machine Learning · Computer Science 2026-04-15 Eric Eaton , Marcel Hussing , Michael Kearns , Aaron Roth , Sikata Bela Sengupta , Jessica Sorrell