English
Related papers

Related papers: Abstract Visual Reasoning Enabled by Language

200 papers

The Abstraction and Reasoning Corpus (ARC) is designed to promote research on abstract reasoning, a fundamental aspect of human intelligence. Common approaches to ARC treat it as a language-oriented problem, addressed by large language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Keya Hu , Ali Cy , Linlu Qiu , Xiaoman Delores Ding , Runqian Wang , Yeyin Eva Zhu , Jacob Andreas , Kaiming He

The abilities to form and abstract concepts is key to human intelligence, but such abilities remain lacking in state-of-the-art AI systems. There has been substantial research on conceptual abstraction in AI, particularly using idealized…

Machine Learning · Computer Science 2023-08-09 Arseny Moskvichev , Victor Vikram Odouard , Melanie Mitchell

Abstract reasoning from minimal examples remains a core unsolved problem for frontier foundation models such as GPT-5 and Grok 4. These models still fail to infer structured transformation rules from a handful of examples, which is a key…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Beichen Zhang , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

For half a century, artificial intelligence research has attempted to reproduce the human qualities of abstraction and reasoning - creating computer systems that can learn new concepts from a minimal set of examples, in settings where…

Artificial Intelligence · Computer Science 2024-02-07 Mikel Bober-Irizar , Soumya Banerjee

The Abstraction and Reasoning Corpus (ARC) is a popular benchmark focused on visual reasoning in the evaluation of Artificial Intelligence systems. In its original framing, an ARC task requires solving a program synthesis problem over small…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Wenhao Li , Yudong Xu , Scott Sanner , Elias Boutros Khalil

The Abstraction and Reasoning Corpus (ARC) provides a compact laboratory for studying abstract reasoning, an ability central to human intelligence. Modern AI systems, including LLMs and ViTs, largely operate as sequence-of-behavior…

Artificial Intelligence · Computer Science 2026-01-21 Zhiguang Liu , Yi Shang

The Abstraction and Reasoning Corpus (ARC) is a challenging program induction dataset that was recently proposed by Chollet (2019). Here, we report the first set of results collected from a behavioral study of humans solving a subset of…

Human-Computer Interaction · Computer Science 2021-03-11 Aysja Johnson , Wai Keen Vong , Brenden M. Lake , Todd M. Gureckis

The Abstraction and Reasoning Corpus (ARC) is a set of procedural tasks that tests an agent's ability to flexibly solve novel problems. While most ARC tasks are easy for humans, they are challenging for state-of-the-art AI. What makes…

One of the challenges facing artificial intelligence research today is designing systems capable of utilizing systematic reasoning to generalize to new tasks. The Abstraction and Reasoning Corpus (ARC) measures such a capability through a…

Artificial Intelligence · Computer Science 2021-10-27 Simon Alford , Anshula Gandhi , Akshay Rangamani , Andrzej Banburski , Tony Wang , Sylee Dandekar , John Chin , Tomaso Poggio , Peter Chin

Core knowledge about physical objects -- e.g., their permanency, spatial transformations, and interactions -- is one of the most fundamental building blocks of biological intelligence across humans and non-human animals. While AI techniques…

Artificial Intelligence · Computer Science 2023-11-02 James Ainooson , Deepayan Sanyal , Joel P. Michelson , Yuan Yang , Maithilee Kunda

The Abstraction and Reasoning Corpus (ARC) is a challenging benchmark, introduced to foster AI research towards human-level intelligence. It is a collection of unique tasks about generating colored grids, specified by a few examples only.…

Artificial Intelligence · Computer Science 2023-11-02 Sébastien Ferré

This paper addresses the challenge of enhancing artificial intelligence reasoning capabilities, focusing on logicality within the Abstraction and Reasoning Corpus (ARC). Humans solve such visual reasoning tasks based on their observations…

Artificial Intelligence · Computer Science 2024-11-28 Mintaek Lim , Seokki Lee , Liyew Woletemaryam Abitew , Sundong Kim

The Abstraction Reasoning Corpus (ARC) is a visual analogical reasoning test designed for humans and machines (Chollet, 2019). We compared human and large language model (LLM) performance on a new child-friendly set of ARC items. Results…

Computation and Language · Computer Science 2024-05-14 Gustaw Opiełka , Hannes Rosenbusch , Veerle Vijverberg , Claire E. Stevenson

The Abstraction and Reasoning Corpus (ARC) poses a stringent test of general AI capabilities, requiring solvers to infer abstract patterns from only a handful of examples. Despite substantial progress in deep learning, state-of-the-art…

Artificial Intelligence · Computer Science 2025-05-28 Woochang Sim , Hyunseok Ryu , Kyungmin Choi , Sungwon Han , Sundong Kim

The Abstraction and Reasoning Corpus (ARC) aims at benchmarking the performance of general artificial intelligence algorithms. The ARC's focus on broad generalization and few-shot learning has made it difficult to solve using pure machine…

Artificial Intelligence · Computer Science 2022-12-05 Yudong Xu , Elias B. Khalil , Scott Sanner

The Abstraction and Reasoning Corpus (ARC) is a general artificial intelligence benchmark that poses difficulties for pure machine learning methods due to its requirement for fluid intelligence with a focus on reasoning and abstraction. In…

Artificial Intelligence · Computer Science 2024-01-17 Chao Lei , Nir Lipovetzky , Krista A. Ehinger

The Abstraction and Reasoning Corpus (ARC) is a visual program synthesis benchmark designed to test challenging out-of-distribution generalization in humans and machines. Since 2019, limited progress has been observed on the challenge using…

Artificial Intelligence · Computer Science 2024-09-04 Solim LeGris , Wai Keen Vong , Brenden M. Lake , Todd M. Gureckis

In this project, we test the effectiveness of Large Language Models (LLMs) on the Abstraction and Reasoning Corpus (ARC) dataset. This dataset serves as a representative benchmark for testing abstract reasoning abilities, requiring a…

Artificial Intelligence · Computer Science 2024-07-30 Liane Galanti , Ethan Baron

Analogical reasoning derives information from known relations and generalizes this information to similar yet unfamiliar situations. One of the first generalized ways in which deep learning models were able to solve verbal analogies was…

Artificial Intelligence · Computer Science 2023-11-15 Luca H. Thoms , Karel A. Veldkamp , Hannes Rosenbusch , Claire E. Stevenson

The Abstraction and Reasoning Corpus (ARC) is designed to assess generalization beyond pattern matching, requiring models to infer symbolic rules from very few examples. In this work, we present a transformer-based system that advances ARC…

‹ Prev 1 2 3 10 Next ›