English
Related papers

Related papers: Multi-Perspective Transformers in ARC-AGI-2 Challe…

200 papers

The Abstraction and Reasoning Corpus (ARC) is designed to assess generalization beyond pattern matching, requiring models to infer symbolic rules from very few examples. In this work, we present a transformer-based system that advances ARC…

In the pursuit of artificial general intelligence (AGI), we tackle Abstraction and Reasoning Corpus (ARC) tasks using a novel two-pronged approach. We employ the Decision Transformer in an imitation learning paradigm to model human…

Artificial Intelligence · Computer Science 2023-06-16 Jaehyun Park , Jaegyun Im , Sanha Hwang , Mintaek Lim , Sabina Ualibekova , Sejin Kim , Sundong Kim

The Abstraction and Reasoning Corpus (ARC-AGI) poses a significant challenge for large language models (LLMs), exposing limitations in their abstract reasoning abilities. In this work, we leverage task-specific data augmentations throughout…

Computation and Language · Computer Science 2025-06-12 Daniel Franzen , Jan Disselhoff , David Hartmann

Despite their broad applicability, transformer-based models still fall short in System~2 reasoning, lacking the generality and adaptivity needed for human--AI alignment. We examine weaknesses on ARC-AGI tasks, revealing gaps in…

Artificial Intelligence · Computer Science 2025-08-14 Sejin Kim , Sundong Kim

The Abstraction and Reasoning Corpus (ARC-AGI) probes few-shot abstraction and rule induction on small visual grids, but progress is difficult to measure on static collections of hand-authored puzzles due to overfitting, dataset leakage,…

Computation and Language · Computer Science 2026-03-06 Jens Lehmann , Syeda Khushbakht , Nikoo Salehfard , Nur A Zarin Nishat , Dhananjay Bhandiwad , Andrei Aioanei , Sahar Vahdati

Tiny Recursive Models (TRM) were proposed as a parameter-efficient alternative to large language models for solving Abstraction and Reasoning Corpus (ARC) style tasks. The original work reports strong performance and suggests that recursive…

Machine Learning · Computer Science 2026-01-12 Antonio Roye-Azar , Santiago Vargas-Naranjo , Dhruv Ghai , Nithin Balamurugan , Rayan Amir

Abstract reasoning from minimal examples remains a core unsolved problem for frontier foundation models such as GPT-5 and Grok 4. These models still fail to infer structured transformation rules from a handful of examples, which is a key…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Beichen Zhang , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI), introduced in 2019, established a challenging benchmark for evaluating the general fluid intelligence of artificial systems via a set of unique, novel tasks…

Artificial Intelligence · Computer Science 2026-01-19 Francois Chollet , Mike Knoop , Gregory Kamradt , Bryan Landers , Henry Pinkard

Prior to the close of the 2025 ARC Prize competition, the leading open source approach - known as TRM, or Tiny Recursive Models - involved training a 7M parameter recursive neural network on augmented variants of ARC tasks. That approach…

Machine Learning · Computer Science 2025-11-06 Ronan Killian McGovern

OpenAI's o3 achieves a high score of 87.5 % on ARC-AGI, a benchmark proposed to measure intelligence. This raises the question whether systems based on Large Language Models (LLMs), particularly o3, demonstrate intelligence and progress…

Artificial Intelligence · Computer Science 2025-01-14 Rolf Pfister , Hansueli Jud

Hierarchical Reasoning Model (HRM) is a novel approach using two small neural networks recursing at different frequencies. This biologically inspired method beats Large Language models (LLMs) on hard puzzle tasks such as Sudoku, Maze, and…

Machine Learning · Computer Science 2025-10-07 Alexia Jolicoeur-Martineau

Multimodal Large Language Models (MLLMs) are widely regarded as crucial in the exploration of Artificial General Intelligence (AGI). The core of MLLMs lies in their capability to achieve cross-modal alignment. To attain this goal, current…

Computation and Language · Computer Science 2024-11-26 Fei Zhao , Taotian Pang , Chunhui Li , Zhen Wu , Junjie Guo , Shangyu Xing , Xinyu Dai

Tiny Recursive Models (TRMs) have recently demonstrated remarkable performance on ARC-AGI, showing that very small models can compete against large foundation models through a two-step refinement mechanism that updates an internal reasoning…

Machine Learning · Computer Science 2026-03-10 Paulius Rauba , Claudio Fanconi , Mihaela van der Schaar

The Abstraction and Reasoning Corpus (ARC) poses a stringent test of general AI capabilities, requiring solvers to infer abstract patterns from only a handful of examples. Despite substantial progress in deep learning, state-of-the-art…

Artificial Intelligence · Computer Science 2025-05-28 Woochang Sim , Hyunseok Ryu , Kyungmin Choi , Sungwon Han , Sundong Kim

The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) is a generative, few-shot fluid intelligence benchmark. Although humans effortlessly solve ARC-AGI, it remains extremely difficult for even the most advanced…

Artificial Intelligence · Computer Science 2025-11-13 Isaac Joffe , Chris Eliasmith

The Abstraction Reasoning Corpus (ARC) is a visual analogical reasoning test designed for humans and machines (Chollet, 2019). We compared human and large language model (LLM) performance on a new child-friendly set of ARC items. Results…

Computation and Language · Computer Science 2024-05-14 Gustaw Opiełka , Hannes Rosenbusch , Veerle Vijverberg , Claire E. Stevenson

We attempt to solve the Abstraction and Reasoning Corpus (ARC) Challenge using Large Language Models (LLMs) as a system of multiple expert agents. Using the flexibility of LLMs to be prompted to do various novel tasks using zero-shot,…

Artificial Intelligence · Computer Science 2023-10-10 John Chong Min Tan , Mehul Motani

The Abstraction and Reasoning Corpus remains one of the most compelling and challenging benchmarks for tracking progress toward achieving Artificial General Intelligence. In contrast to other evaluation datasets designed to assess an…

Artificial Intelligence · Computer Science 2025-11-05 Michael D. Moffitt

The ARC-AGI benchmark series serves as a critical measure of few-shot generalization on novel tasks, a core aspect of intelligence. The ARC Prize 2025 global competition targeted the newly released ARC-AGI-2 dataset, which features greater…

Artificial Intelligence · Computer Science 2026-01-19 François Chollet , Mike Knoop , Gregory Kamradt , Bryan Landers

Universal transformers (UTs) have been widely used for complex reasoning tasks such as ARC-AGI and Sudoku, yet the specific sources of their performance gains remain underexplored. In this work, we systematically analyze UTs variants and…

Artificial Intelligence · Computer Science 2025-12-29 Zitian Gao , Lynx Chen , Yihao Xiao , He Xing , Ran Tao , Haoming Luo , Joey Zhou , Bryan Dai
‹ Prev 1 2 3 10 Next ›