中文
相关论文

相关论文: RULEBREAKERS: Challenging LLMs at the Crossroads b…

200 篇论文

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

计算与语言 · 计算机科学 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

Transformer-based large language models (LLMs) have demonstrated significant potential in addressing logic problems. capitalizing on the great capabilities of LLMs for code-related activities, several frameworks leveraging logical solvers…

人工智能 · 计算机科学 2024-03-29 Minyu Chen , Guoqiang Li , Ling-I Wu , Ruibang Liu , Yuxin Su , Xi Chang , Jianxin Xue

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models…

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

计算与语言 · 计算机科学 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri

Over the past few years, the abilities of large language models (LLMs) have received extensive attention, which have performed exceptionally well in complicated scenarios such as logical reasoning and symbolic inference. A significant…

计算与语言 · 计算机科学 2024-02-20 Junbing Yan , Chengyu Wang , Jun Huang , Wei Zhang

A central goal of cognitive science is to provide a computationally explicit account of both the structure of the mind and its development: what are the primitive representational building blocks of cognition, what are the rules via which…

人工智能 · 计算机科学 2025-07-08 Alyssa Loo , Ellie Pavlick , Roman Feiman

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

计算与语言 · 计算机科学 2024-08-07 Philipp Mondorf , Barbara Plank

While large language models (LLMs), such as GPT-3, appear to be robust and general, their reasoning ability is not at a level to compete with the best models trained for specific natural language reasoning problems. In this study, we…

计算与语言 · 计算机科学 2023-07-18 Zhun Yang , Adam Ishay , Joohyung Lee

Large language models (LLMs) have shown remarkable reasoning capabilities given chain-of-thought prompts (examples with intermediate reasoning steps). Existing benchmarks measure reasoning ability indirectly, by evaluating accuracy on…

计算与语言 · 计算机科学 2023-03-03 Abulhair Saparov , He He

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

人工智能 · 计算机科学 2025-02-24 Johan Boye , Birger Moell

Large Language Models (LLMs) have lately been on the spotlight of researchers, businesses, and consumers alike. While the linguistic capabilities of such models have been studied extensively, there is growing interest in investigating them…

计算与语言 · 计算机科学 2023-08-17 Sotiris Lamprinidis

Recent work shows superior performance when using large language models (LLMs) as formalizers instead of as end-to-end solvers for symbolic reasoning problems. Given the problem description, the LLM generates a formal program that derives a…

计算与语言 · 计算机科学 2026-04-01 Rikhil Amonkar , Ceyhun Efe Kayan , Qimei Lai , Ronan Le Bras , Li Zhang

Recently, Large Language Models (LLMs) have drawn significant attention due to their outstanding reasoning capabilities and extensive knowledge repository, positioning them as superior in handling various natural language processing tasks…

计算与语言 · 计算机科学 2023-11-30 Han Cao , Lingwei Wei , Mengyang Chen , Wei Zhou , Songlin Hu

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

计算与语言 · 计算机科学 2024-10-30 Rob Sullivan , Nelly Elsayed

Recent generations of language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their…

人工智能 · 计算机科学 2025-11-21 Parshin Shojaee , Iman Mirzadeh , Keivan Alizadeh , Maxwell Horton , Samy Bengio , Mehrdad Farajtabar

Large Language Models (LLMs) have been touted as AI models possessing advanced reasoning abilities. However, recent works have shown that LLMs often bypass true reasoning using shortcuts, sparking skepticism. To study the reasoning…

人工智能 · 计算机科学 2024-10-24 Rishi Hazra , Gabriele Venturato , Pedro Zuidberg Dos Martires , Luc De Raedt

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

计算与语言 · 计算机科学 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

计算与语言 · 计算机科学 2024-12-23 Zhisheng Tang , Mayank Kejriwal

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

计算与语言 · 计算机科学 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

With the increasing interest in using large language models (LLMs) for planning in natural language, understanding their behaviors becomes an important research question. This work conducts a systematic investigation of LLMs' ability to…

计算与语言 · 计算机科学 2025-02-18 Yixuan Wang , Freda Shi