English

Human-Level Reasoning: A Comparative Study of Large Language Models on Logical and Abstract Reasoning

Artificial Intelligence 2025-10-29 v1

Abstract

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information, perform inferences, and are able to draw conclusions in a logical and valid way. This study compare logical and abstract reasoning skills of several LLMs - including GPT, Claude, DeepSeek, Gemini, Grok, Llama, Mistral, Perplexity, and Sabi\'a - using a set of eight custom-designed reasoning questions. The LLM results are benchmarked against human performance on the same tasks, revealing significant differences and indicating areas where LLMs struggle with deduction.

Keywords

Cite

@article{arxiv.2510.24435,
  title  = {Human-Level Reasoning: A Comparative Study of Large Language Models on Logical and Abstract Reasoning},
  author = {Benjamin Grando Moreira},
  journal= {arXiv preprint arXiv:2510.24435},
  year   = {2025}
}

Comments

12 pages

R2 v1 2026-07-01T07:09:37.479Z