English
Related papers

Related papers: ARC-NCA: Towards Developmental Solutions to the Ab…

200 papers

The recent work of Clark et al. introduces the AI2 Reasoning Challenge (ARC) and the associated ARC dataset that partitions open domain, complex science questions into an Easy Set and a Challenge Set. That paper includes an analysis of 100…

Can a Large Language Model (LLM) solve simple abstract reasoning problems? We explore this broad question through a systematic analysis of GPT on the Abstraction and Reasoning Corpus (ARC), a representative benchmark of abstract reasoning…

Computation and Language · Computer Science 2024-02-16 Yudong Xu , Wenhao Li , Pashootan Vaezipoor , Scott Sanner , Elias B. Khalil

A key feature of intelligent behaviour is the ability to learn abstract strategies that scale and transfer to unfamiliar problems. An abstract strategy solves every sample from a problem class, no matter its representation or complexity --…

Neural and Evolutionary Computing · Computer Science 2021-05-18 Daniel Tanneberg , Elmar Rueckert , Jan Peters

The ARC-AGI benchmark series serves as a critical measure of few-shot generalization on novel tasks, a core aspect of intelligence. The ARC Prize 2025 global competition targeted the newly released ARC-AGI-2 dataset, which features greater…

Artificial Intelligence · Computer Science 2026-01-19 François Chollet , Mike Knoop , Gregory Kamradt , Bryan Landers

In this project, we test the effectiveness of Large Language Models (LLMs) on the Abstraction and Reasoning Corpus (ARC) dataset. This dataset serves as a representative benchmark for testing abstract reasoning abilities, requiring a…

Artificial Intelligence · Computer Science 2024-07-30 Liane Galanti , Ethan Baron

The Abstraction and Reasoning Corpus (ARC) tests AI systems' ability to perform human-like inductive reasoning from a few demonstration pairs. Existing Gymnasium-based RL environments severely limit experimental scale due to computational…

Artificial Intelligence · Computer Science 2026-01-27 Aadam , Monu Verma , Mohamed Abdel-Mottaleb

This paper introduces an interdisciplinary framework called Machine Psychology, which merges principles from operant learning psychology with a specific Artificial Intelligence model, the Non-Axiomatic Reasoning System (NARS), to enhance…

Artificial Intelligence · Computer Science 2024-05-31 Robert Johansson

The integration of generative Artificial Intelligence (genAI) into everyday life raises questions about the competencies required to critically engage with these technologies. Unlike visual errors in genAI, textual mistakes are often harder…

Human-Computer Interaction · Computer Science 2025-05-26 Aayushi Dangol , Runhua Zhao , Robert Wolfe , Trushaa Ramanan , Julie A. Kientz , Jason Yip

The rapid progress in large language models (LLMs) has paved the way for novel approaches in knowledge-intensive tasks. Among these, Cache-Augmented Generation (CAG) has emerged as a promising alternative to Retrieval-Augmented Generation…

Computation and Language · Computer Science 2025-05-14 Rishabh Agrawal , Himanshu Kumar

As of December 2024, the ARC-AGI benchmark is five years old and remains unbeaten. We believe it is currently the most important unsolved AI benchmark in the world because it seeks to measure generalization on novel tasks -- the essence of…

Artificial Intelligence · Computer Science 2025-01-09 Francois Chollet , Mike Knoop , Gregory Kamradt , Bryan Landers

We introduce Gradual Abstract Argumentation for Case-Based Reasoning (Gradual AA-CBR), a data-driven, neurosymbolic classification model in which the outcome is determined by an argumentation debate structure that is learned simultaneously…

Artificial Intelligence · Computer Science 2025-05-22 Adam Gould , Francesca Toni

Large language models (LLMs) have demonstrated the world with the sparks of artificial general intelligence (AGI). One opinion, especially from some startups working on LLMs, argues that an LLM with nearly unlimited context length can…

Computation and Language · Computer Science 2024-08-29 Jingbo Shang , Zai Zheng , Jiale Wei , Xiang Ying , Felix Tao , Mindverse Team

The Abstraction and Reasoning Corpus (ARC) poses a significant challenge to artificial intelligence, demanding broad generalization and few-shot learning capabilities that remain elusive for current deep learning methods, including large…

Machine Learning · Computer Science 2024-12-12 Kartik Singhal , Gautam Shroff

The lack of a concrete definition for Artificial General Intelligence (AGI) obscures the gap between today's specialized AI and human-level cognition. This paper introduces a quantifiable framework to address this, defining AGI as matching…

Abstract Visual Reasoning (AVR) problems are commonly used to approximate human intelligence. They test the ability of applying previously gained knowledge, experience and skills in a completely new setting, which makes them particularly…

Artificial Intelligence · Computer Science 2023-02-27 Mikołaj Małkiński , Jacek Mańdziuk

Understanding, predicting, and generating object motions and transformations is a core problem in artificial intelligence. Modeling sequences of evolving images may provide better representations and models of motion and may ultimately be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Arnab Ghosh , Viveka Kulharia , Amitabha Mukerjee , Vinay Namboodiri , Mohit Bansal

We present the ARC-DA dataset, a direct-answer ("open response", "freeform") version of the ARC (AI2 Reasoning Challenge) multiple-choice dataset. While ARC has been influential in the community, its multiple-choice format is…

The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive…

Artificial Intelligence · Computer Science 2025-09-24 Yu Wang , Shiwan Zhao , Zhihu Wang , Ming Fan , Xicheng Zhang , Yubo Zhang , Zhengfan Wang , Heyuan Huang , Ting Liu

The vastness of the design space created by the combination of a large number of computational mechanisms, including machine learning, is an obstacle to creating an artificial general intelligence (AGI). Brain-inspired AGI development, in…

Artificial Intelligence · Computer Science 2022-08-16 Hiroshi Yamakawa

While inference-time scaling enables LLMs to carry out increasingly long and capable reasoning traces, the patterns and insights uncovered during these traces are immediately discarded once the context window is reset for a new query.…

Artificial Intelligence · Computer Science 2025-10-07 Matthew Ho , Chen Si , Zhaoxiang Feng , Fangxu Yu , Yichi Yang , Zhijian Liu , Zhiting Hu , Lianhui Qin