English
Related papers

Related papers: Human-Level Reasoning: A Comparative Study of Larg…

200 papers

Large Language Models (LLMs) have lately been on the spotlight of researchers, businesses, and consumers alike. While the linguistic capabilities of such models have been studied extensively, there is growing interest in investigating them…

Computation and Language · Computer Science 2023-08-17 Sotiris Lamprinidis

Logical reasoning is fundamental for humans yet presents a substantial challenge in the domain of Artificial Intelligence. Initially, researchers used Knowledge Representation and Reasoning (KR) systems that did not scale and required…

Computation and Language · Computer Science 2024-04-02 Man Luo , Shrinidhi Kumbhar , Ming shen , Mihir Parmar , Neeraj Varshney , Pratyay Banerjee , Somak Aditya , Chitta Baral

This paper assesses the ability of large language models (LLMs) to translate texts that include inter-sentential dependencies. We use the English-French DiscEvalMT benchmark (Bawden et al., 2018) with pairs of sentences containing…

Computation and Language · Computer Science 2026-03-09 Shabnam Ataee , Hugo Huart , Andrei Popescu-Belis

Large language models (LLMs) have developed impressive performance and strong explainability across various reasoning scenarios, marking a significant stride towards mimicking human-like intelligence. Despite this, when tasked with several…

Computation and Language · Computer Science 2024-11-12 Kai Xiong , Xiao Ding , Ting Liu , Bing Qin , Dongliang Xu , Qing Yang , Hongtao Liu , Yixin Cao

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models…

Artificial Intelligence · Computer Science 2024-05-24 Guilherme F. C. F. Almeida , José Luiz Nunes , Neele Engelmann , Alex Wiegmann , Marcelo de Araújo

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Commonsense reasoning is a difficult task for a computer, but a critical skill for an artificial intelligence (AI). It can enhance the explainability of AI models by enabling them to provide intuitive and human-like explanations for their…

Artificial Intelligence · Computer Science 2024-07-08 Stefanie Krause , Frieder Stolzenburg

Large language models (LLMs) are advanced artificial intelligence (AI) systems that can perform a variety of tasks commonly found in human intelligence tests, such as defining words, performing calculations, and engaging in verbal…

Computation and Language · Computer Science 2024-09-12 David Ilić , Gilles E. Gignac

Recent advancements in Large Language Models (LLMs) have brought them closer to matching human cognition across a variety of tasks. How well do these models align with human performance in detecting and mapping analogies? Prior research has…

Computation and Language · Computer Science 2025-07-16 Kalit Inani , Keshav Kabra , Vijay Marupudi , Sashank Varma

Case-based reasoning is a cornerstone of U.S. legal practice, requiring professionals to argue about a current case by drawing analogies to and distinguishing from past precedents. While Large Language Models (LLMs) have shown remarkable…

Computation and Language · Computer Science 2026-01-21 Li Zhang , Matthias Grabmair , Morgan Gray , Kevin Ashley

Mathematical reasoning serves as a cornerstone for assessing the fundamental cognitive capabilities of human intelligence. In recent times, there has been a notable surge in the development of Large Language Models (LLMs) geared towards the…

Computation and Language · Computer Science 2024-09-18 Janice Ahn , Rishu Verma , Renze Lou , Di Liu , Rui Zhang , Wenpeng Yin

Large Language Models (LLMs) excel in generating personalized content and facilitating interactive dialogues, showcasing their remarkable aptitude for a myriad of applications. However, their capabilities in reasoning and providing…

Computation and Language · Computer Science 2024-02-16 Min Zhang , Sato Takumi , Jack Zhang , Jun Wang

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

Computation and Language · Computer Science 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

Recently developed large language models (LLMs) have been shown to perform remarkably well on a wide range of language understanding tasks. But, can they really "reason" over the natural language? This question has been receiving…

Computation and Language · Computer Science 2024-06-07 Mihir Parmar , Nisarg Patel , Neeraj Varshney , Mutsumi Nakamura , Man Luo , Santosh Mashetty , Arindam Mitra , Chitta Baral

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed

Large language models (LLMs) have revolutionized many areas (e.g. natural language processing, software engineering, etc.) by achieving state-of-the-art performance on extensive downstream tasks. Aiming to achieve robust and general…

Artificial Intelligence · Computer Science 2024-01-18 Zhiming Li , Yushi Cao , Xiufeng Xu , Junzhe Jiang , Xu Liu , Yon Shin Teo , Shang-wei Lin , Yang Liu

Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but they still struggle with some complicated reasoning tasks including logical reasoning. One non-negligible reason for LLMs' suboptimal performance…

Computation and Language · Computer Science 2024-04-09 Yanda Li , Dixuan Wang , Jiaqing Liang , Guochao Jiang , Qianyu He , Yanghua Xiao , Deqing Yang

Exploring the capabilities of Large Language Models (LLMs) in puzzle solving unveils critical insights into their potential and challenges in AI, marking a significant step towards understanding their applicability in complex reasoning…

Computation and Language · Computer Science 2025-08-04 Panagiotis Giadikiaroglou , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Large language models (LLMs) have demonstrated their remarkable performance across various language understanding tasks. While emerging benchmarks have been proposed to evaluate LLMs in various domains such as mathematics and computer…

Artificial Intelligence · Computer Science 2024-10-28 Junnan Dong , Zijin Hong , Yuanchen Bei , Feiran Huang , Xinrun Wang , Xiao Huang

Recent advances in large language models (LLMs) have demonstrated impressive reasoning capacities that mirror human-like thinking. However, whether LLMs possess genuine fluid intelligence (i.e., the ability to reason abstractly and…

Artificial Intelligence · Computer Science 2025-09-30 Yue Yang , MingKang Chen , Qihua Liu , Mengkang Hu , Qiguang Chen , Gengrui Zhang , Shuyue Hu , Guangtao Zhai , Yu Qiao , Yu Wang , Wenqi Shao , Ping Luo