中文
相关论文

相关论文: Step-by-Step Reasoning to Solve Grid Puzzles: Wher…

200 篇论文

Large Language Models (LLMs) exhibit impressive reasoning abilities, yet their reliance on structured step-by-step processing reveals a critical limitation. In contrast, human cognition fluidly adapts between intuitive, heuristic (System 1)…

Large language models (LLMs) achieve impressive performance on complex mathematical benchmarks yet sometimes fail on basic math reasoning while generating unnecessarily verbose responses. In this paper, we present LLMThinkBench, a…

计算与语言 · 计算机科学 2026-04-24 Gaurav Srivastava , Aafiya Hussain , Sriram Srinivasan , Xuan Wang

In this paper, we present an investigative study on how Mental Sets influence the reasoning capabilities of LLMs. LLMs have excelled in diverse natural language processing (NLP) tasks, driven by advancements in parameter-efficient…

计算与语言 · 计算机科学 2025-01-22 Saiful Haq , Niyati Chhaya , Piyush Pandey , Pushpak Bhattacharya

Large Language Models (LLMs) have achieved remarkable performance across a wide range of mathematical benchmarks. However, concerns remain as to whether these successes reflect genuine reasoning or superficial pattern recognition. Existing…

人工智能 · 计算机科学 2026-04-21 Yujie Hou , Mei Wang , Yaoyao Zhong , Ting Zhang , Xuetao Ma , Hua Huang

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

计算与语言 · 计算机科学 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

Recent advances in large language models (LLMs) have shown that they can answer questions requiring complex reasoning. However, their ability to identify and respond to text containing logical fallacies or deliberately misleading premises…

计算与语言 · 计算机科学 2025-02-19 Zenan Zhai , Hao Li , Xudong Han , Zhenxuan Zhang , Yixuan Zhang , Timothy Baldwin , Haonan Li

How far are Large Language Models (LLMs) in performing deep relational reasoning? In this paper, we evaluate and compare the reasoning capabilities of three cutting-edge LLMs, namely, DeepSeek-R1, DeepSeek-V3 and GPT-4o, through a suite of…

人工智能 · 计算机科学 2025-07-01 Chi Chiu So , Yueyue Sun , Jun-Min Wang , Siu Pang Yung , Anthony Wai Keung Loh , Chun Pong Chau

Large Language Models (LLMs) show strong reasoning ability in open-domain question answering, yet their reasoning processes are typically linear and often logically inconsistent. In contrast, real-world reasoning requires integrating…

An impediment to using Large Language Models (LLMs) for reasoning output verification is that LLMs struggle to reliably identify errors in thinking traces, particularly in long outputs, domains requiring expert knowledge, and problems…

计算与语言 · 计算机科学 2026-02-09 Kate Sanders , Nathaniel Weir , Sapana Chaudhary , Kaj Bostrom , Huzefa Rangwala

Large Language Models (LLMs) have demonstrated strong reasoning capabilities in solving complex problems. However, current approaches primarily enhance reasoning through the elaboration of thoughts while neglecting the diversity of…

计算与语言 · 计算机科学 2025-04-25 Danqing Wang , Jianxin Ma , Fei Fang , Lei Li

LLMs have made significant progress in the field of mathematical reasoning, but whether they have true the mathematical understanding ability is still controversial. To explore this issue, we propose a new perturbation framework to evaluate…

人工智能 · 计算机科学 2025-11-12 Zhishen Sun , Guang Dai , Ivor Tsang , Haishan Ye

We present in this paper our solver for logic grid puzzles. The approach used by our algorithm mimics the way a human would try to solve the same problem. Every progress made during the solving process is accompanied by a detailed…

人工智能 · 计算机科学 2019-10-16 Guillaume Escamocher , Barry O'Sullivan

Despite their remarkable reasoning capabilities across diverse domains, large language models (LLMs) face fundamental challenges in natively functioning as generative reasoning recommendation models (GRRMs), where the intrinsic modeling gap…

信息检索 · 计算机科学 2025-10-24 Minjie Hong , Zetong Zhou , Zirun Guo , Ziang Zhang , Ruofan Hu , Weinan Gan , Jieming Zhu , Zhou Zhao

This paper presents a novel framework for enhancing reasoning capabilities in large language models (LLMs) by leveraging iterative reasoning and feedback-driven methodologies. Building on the limitations identified in the SimpleBench…

计算与语言 · 计算机科学 2024-12-18 Soham Sane , Angus McLean

As large language models (LLMs) are increasingly deployed to perform tasks with minimal human oversight, it is crucial that these models operate robustly. In particular, a model that can solve a given problem should not fail simply because…

机器学习 · 计算机科学 2026-05-18 Philipp Mondorf , Samuel J. Bell , Jesse Dodge , Dieuwke Hupkes

Large Multimodal Models (LMMs) are increasingly applied to scientific research, yet it remains unclear whether they can reliably understand and reason over the multimodal complexity of papers. A central challenge lies in detecting and…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Lukas Selch , Yufang Hou , M. Jehanzeb Mirza , Sivan Doveh , James Glass , Rogerio Feris , Wei Lin

Large language models (LLMs) have achieved remarkable results on tasks framed as reasoning problems, yet their true ability to perform procedural reasoning, executing multi-step, rule-based computations remains unclear. Unlike algorithmic…

人工智能 · 计算机科学 2025-11-20 Mahdi Samiei , Mahdi Mansouri , Mahdieh Soleymani Baghshah

Large Language Models (LLMs) demonstrate ever-increasing abilities in mathematical and algorithmic tasks, yet their geometric reasoning skills are underexplored. We investigate LLMs' abilities in constructive geometric problem-solving one…

计算与语言 · 计算机科学 2024-09-23 Spyridon Mouselinos , Henryk Michalewski , Mateusz Malinowski

In this thesis, I evaluate the performance of Large Language Models (LLMs) on the Law School Admissions Test (LSAT), specifically the Logic Games section of the test. I focus on this section because it presents a complex logical reasoning…

计算与语言 · 计算机科学 2024-10-01 Saumya Malik

The rapid advancements in large Language models (LLMs) have significantly enhanced their reasoning capabilities, driven by various strategies such as multi-agent collaboration. However, unlike the well-established performance improvements…

人工智能 · 计算机科学 2026-04-23 Zihan Chen , Song Wang , Zhen Tan , Xingbo Fu , Zhenyu Lei , Peng Wang , Huan Liu , Cong Shen , Jundong Li