中文
相关论文

相关论文: Evaluating the Meta- and Object-Level Reasoning of…

200 篇论文

We introduce Meta-Reasoning Prompting (MRP), a novel and efficient system prompting method for large language models (LLMs) inspired by human meta-reasoning. Traditional in-context learning-based reasoning techniques, such as…

计算与语言 · 计算机科学 2024-06-18 Peizhong Gao , Ao Xie , Shaoguang Mao , Wenshan Wu , Yan Xia , Haipeng Mi , Furu Wei

Mathematical reasoning serves as a cornerstone for assessing the fundamental cognitive capabilities of human intelligence. In recent times, there has been a notable surge in the development of Large Language Models (LLMs) geared towards the…

计算与语言 · 计算机科学 2024-09-18 Janice Ahn , Rishu Verma , Renze Lou , Di Liu , Rui Zhang , Wenpeng Yin

The rapid advancements in large Language models (LLMs) have significantly enhanced their reasoning capabilities, driven by various strategies such as multi-agent collaboration. However, unlike the well-established performance improvements…

人工智能 · 计算机科学 2026-04-23 Zihan Chen , Song Wang , Zhen Tan , Xingbo Fu , Zhenyu Lei , Peng Wang , Huan Liu , Cong Shen , Jundong Li

Large Language Models (LLMs) have demonstrated amazing capabilities in language generation, text comprehension, and knowledge reasoning. While a single powerful model can already handle multiple tasks, relying on a single perspective can…

计算与语言 · 计算机科学 2024-06-12 Zining Qin , Chenhao Wang , Huiling Qin , Weijia Jia

Large Language Models (LLMs) excel in generating personalized content and facilitating interactive dialogues, showcasing their remarkable aptitude for a myriad of applications. However, their capabilities in reasoning and providing…

计算与语言 · 计算机科学 2024-02-16 Min Zhang , Sato Takumi , Jack Zhang , Jun Wang

Large language models (LLMs) have shown to be valuable tools for tackling process mining tasks. Existing studies report on their capability to support various data-driven process analyses and even, to some extent, that they are able to…

数据库 · 计算机科学 2025-05-01 Adrian Rebmann , Fabian David Schmidt , Goran Glavaš , Han van der Aa

Case-based reasoning is a cornerstone of U.S. legal practice, requiring professionals to argue about a current case by drawing analogies to and distinguishing from past precedents. While Large Language Models (LLMs) have shown remarkable…

计算与语言 · 计算机科学 2026-01-21 Li Zhang , Matthias Grabmair , Morgan Gray , Kevin Ashley

Large Language Models (LLMs) have been shown to achieve breakthrough performance on complex logical reasoning tasks. Nevertheless, most existing research focuses on employing formal language to guide LLMs to derive reliable reasoning paths,…

计算与语言 · 计算机科学 2025-05-23 Jin Jiang , Jianing Wang , Yuchen Yan , Yang Liu , Jianhua Zhu , Mengdi Zhang , Xunliang Cai , Liangcai Gao

Although contemporary large language models (LMs) demonstrate impressive question-answering capabilities, their answers are typically the product of a single call to the model. This entails an unwelcome degree of opacity and compromises…

人工智能 · 计算机科学 2022-08-31 Antonia Creswell , Murray Shanahan

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

人工智能 · 计算机科学 2025-02-24 Johan Boye , Birger Moell

Structured reasoning over natural language inputs remains a core challenge in artificial intelligence, as it requires bridging the gap between unstructured linguistic expressions and formal logical representations. In this paper, we propose…

人工智能 · 计算机科学 2025-07-14 Keying Yang , Hao Wang , Kai Yang

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

计算与语言 · 计算机科学 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

机器学习 · 计算机科学 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

The ability of Large Language Models (LLMs) to perform reasoning tasks such as deduction has been widely investigated in recent years. Yet, their capacity to generate proofs-faithful, human-readable explanations of why conclusions…

人工智能 · 计算机科学 2026-01-21 Hui Yang , Jiaoyan Chen , Uli Sattler

Large Language Models (LLMs) have demonstrated promising capabilities in solving mathematical reasoning tasks, leveraging Chain-of-Thought (CoT) data as a vital component in guiding answer generation. Current paradigms typically generate…

计算与语言 · 计算机科学 2025-03-20 Honglin Lin , Zhuoshi Pan , Yu Li , Qizhi Pei , Xin Gao , Mengzhang Cai , Conghui He , Lijun Wu

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

机器学习 · 计算机科学 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

This paper presents an in-depth analysis of Large Language Models (LLMs), focusing on LLaMA, a prominent open-source foundational model in natural language processing. Instead of assessing LLaMA through its generative output, we design…

计算与语言 · 计算机科学 2024-01-10 Nuo Chen , Ning Wu , Shining Liang , Ming Gong , Linjun Shou , Dongmei Zhang , Jia Li

Large language models (LLMs) have shown increasing capability in problem-solving and decision-making, largely based on the step-by-step chain-of-thought reasoning processes. However, evaluating these reasoning abilities has become…

This paper investigates the effectiveness of large language models (LLMs) in answering questions over datasets. We examine their performance in two scenarios: (a) directly answering questions given a dataset file as input, and (b)…

计算与语言 · 计算机科学 2026-05-12 Andreas Xenofontos , Pavlos Fafalios

Large language models (LLMs) have shown remarkable reasoning capabilities given chain-of-thought prompts (examples with intermediate reasoning steps). Existing benchmarks measure reasoning ability indirectly, by evaluating accuracy on…

计算与语言 · 计算机科学 2023-03-03 Abulhair Saparov , He He