中文
相关论文

相关论文: Evaluating the Meta- and Object-Level Reasoning of…

200 篇论文

Large Language Models (LLMs), through their contextualized representations, have been empirically proven to encapsulate syntactic, semantic, word sense, and common-sense knowledge. However, there has been limited exploration of their…

计算与语言 · 计算机科学 2023-10-12 Yi Ru Wang , Jiafei Duan , Dieter Fox , Siddhartha Srinivasa

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in natural language understanding and generation. While these models excel in general complex reasoning tasks, they still face challenges in…

Large Reasoning Models (LRMs) demonstrate remarkable capabilities on complex tasks, exhibiting emergent, human-like thinking patterns. Despite their advances, we identify a fundamental limitation: current LRMs lack a dedicated meta-level…

人工智能 · 计算机科学 2025-08-26 Haonan Dong , Haoran Ye , Wenhao Zhu , Kehan Jiang , Guojie Song

The rise of Large Reasoning Models (LRMs) signifies a paradigm shift toward advanced computational reasoning. Yet, this progress disrupts traditional agent frameworks, traditionally anchored by execution-oriented Large Language Models…

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

机器学习 · 计算机科学 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

Large language models (LLMs) excel in speed and adaptability across various reasoning tasks, but they often struggle when strict logic or constraint enforcement is required. In contrast, Large Reasoning Models (LRMs) are specifically…

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

计算与语言 · 计算机科学 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Large Language Models (LLMs) have made significant strides in various intelligent tasks but still struggle with complex action reasoning tasks that require systematic search. To address this limitation, we propose a method that bridges the…

计算与语言 · 计算机科学 2025-02-05 Adam Ishay , Joohyung Lee

Recent literature has shown that large language models (LLMs) are generally excellent few-shot reasoners to solve text reasoning tasks. However, the capability of LLMs on table reasoning tasks is yet to be explored. In this paper, we aim at…

计算与语言 · 计算机科学 2023-01-24 Wenhu Chen

Existing long-context benchmarks for Large Language Models (LLMs) focus on evaluating comprehension of long inputs, while overlooking the evaluation of long reasoning abilities. To address this gap, we introduce LongReasonArena, a benchmark…

计算与语言 · 计算机科学 2025-08-28 Jiayu Ding , Shuming Ma , Lei Cui , Nanning Zheng , Furu Wei

Large language models (LLMs) have shown nearly saturated performance on many natural language processing (NLP) tasks. As a result, it is natural for people to believe that LLMs have also mastered abilities such as time understanding and…

计算与语言 · 计算机科学 2023-10-10 Yifan Wei , Yisong Su , Huanhuan Ma , Xiaoyan Yu , Fangyu Lei , Yuanzhe Zhang , Jun Zhao , Kang Liu

While state-of-the-art large language models (LLMs) demonstrate advanced reasoning capabilities-achieving remarkable performance on challenging competitive math and coding benchmarks-they also frequently fail on tasks that are easy for…

计算与语言 · 计算机科学 2025-07-11 Alan Malek , Jiawei Ge , Nevena Lazic , Chi Jin , András György , Csaba Szepesvári

Exploring the capabilities of Large Language Models (LLMs) in puzzle solving unveils critical insights into their potential and challenges in AI, marking a significant step towards understanding their applicability in complex reasoning…

计算与语言 · 计算机科学 2025-08-04 Panagiotis Giadikiaroglou , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Large language models (LLMs) have demonstrated remarkable progress in understanding long-context inputs. However, benchmarks for evaluating the long-context reasoning abilities of LLMs fall behind the pace. Existing benchmarks often focus…

计算与语言 · 计算机科学 2025-11-19 Zhan Ling , Kang Liu , Kai Yan , Yifan Yang , Weijian Lin , Ting-Han Fan , Lingfeng Shen , Zhengyin Du , Jiecao Chen

Recent advancements in large language models (LLMs), such as DeepSeek-R1 and OpenAI-o1, have demonstrated the significant effectiveness of test-time scaling, achieving substantial performance gains across various benchmarks. These advanced…

计算与语言 · 计算机科学 2025-04-15 Haotian Wang , Han Zhao , Shuaiting Chen , Xiaoyu Tian , Sitong Zhao , Yunjie Ji , Yiping Peng , Xiangang Li

The use of Large Language Models (LLMs) in mathematical reasoning has become a cornerstone of related research, demonstrating the intelligence of these models and enabling potential practical applications through their advanced performance,…

计算与语言 · 计算机科学 2024-12-20 Kathrin Seßler , Yao Rong , Emek Gözlüklü , Enkelejda Kasneci

Large Language Models (LLMs) have made significant progress in assisting users to query databases in natural language. While LLM-based techniques provide state-of-the-art results on many standard benchmarks, their performance significantly…

人工智能 · 计算机科学 2024-07-09 Nina Narodytska , Shay Vargaftik

Scientific reasoning, the process through which humans apply logic, evidence, and critical thinking to explore and interpret scientific phenomena, is essential in advancing knowledge reasoning across diverse fields. However, despite…

计算与语言 · 计算机科学 2026-04-21 Yibo Yan , Shen Wang , Jiahao Huo , Jingheng Ye , Zhendong Chu , Xuming Hu , Philip S. Yu , Carla Gomes , Bart Selman , Qingsong Wen

Recent advances in reasoning with large language models (LLMs) have demonstrated strong performance on complex mathematical tasks, including combinatorial optimization. Techniques such as Chain-of-Thought and In-Context Learning have…

人工智能 · 计算机科学 2025-09-17 Marylou Fauchard , Florian Carichon , Margarida Carvalho , Golnoosh Farnadi

Large language models (LLMs) have demonstrated remarkable proficiency in understanding and generating responses to complex queries through large-scale pre-training. However, the efficacy of these models in memorizing and reasoning among…

计算与语言 · 计算机科学 2024-02-23 Qiyuan He , Yizhong Wang , Wenya Wang