English
Related papers

Related papers: Learning Abstract Visual Reasoning via Task Decomp…

200 papers

Visual reasoning models (VRMs) have recently shown strong cross-modal reasoning capabilities by integrating visual perception with language reasoning. However, they often suffer from overthinking, producing unnecessarily long reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yixu Huang , Tinghui Zhu , Muhao Chen

Raven's Progressive Matrices is a family of classical intelligence tests that have been widely used in both research and clinical settings. There have been many exciting efforts in AI communities to computationally model various aspects of…

Artificial Intelligence · Computer Science 2022-08-31 Yuan Yang , Keith McGreggor , Maithilee Kunda

One of the primary challenges faced by deep learning is the degree to which current methods exploit superficial statistics and dataset bias, rather than learning to generalise over the specific representations they have experienced. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Damien Teney , Peng Wang , Jiewei Cao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Abstract reasoning refers to the ability to analyze information, discover rules at an intangible level, and solve problems in innovative ways. Raven's Progressive Matrices (RPM) test is typically used to examine the capability of abstract…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Sheng Hu , Yuqing Ma , Xianglong Liu , Yanlu Wei , Shihao Bai

Analogical reasoning is a fundamental capacity of human cognition that allows us to reason abstractly about novel situations by relating them to past experiences. While it is thought to be essential for robust reasoning in AI systems,…

Artificial Intelligence · Computer Science 2023-06-06 Xiaoyang Hu , Shane Storks , Richard L. Lewis , Joyce Chai

We introduce a new neural architecture for solving visual abstract reasoning tasks inspired by human cognition, specifically by observations that human abstract reasoning often interleaves perceptual and conceptual processing as part of a…

Artificial Intelligence · Computer Science 2023-10-23 Yuan Yang , Deepayan Sanyal , James Ainooson , Joel Michelson , Effat Farhana , Maithilee Kunda

As a step towards improving the abstract reasoning capability of machines, we aim to solve Raven's Progressive Matrices (RPM) with neural networks, since solving RPM puzzles is highly correlated with human intelligence. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Tao Zhuo , Mohan Kankanhalli

Raven's Progressive Matrices (RPM) have been widely used for Intelligence Quotient (IQ) test of humans. In this paper, we aim to solve RPM with neural networks in both supervised and unsupervised manners. First, we investigate strategies to…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Tao Zhuo , Mohan Kankanhalli

In this paper, we propose using deep neural architectures (i.e., vision transformers and ResNet) as heuristics for sequential decision-making in robotic manipulation problems. This formulation enables predicting the subset of objects that…

Robotics · Computer Science 2023-08-02 Hongyou Zhou , Ingmar Schubert , Marc Toussaint , Ozgur S. Oguz

In this work we explore the generalization characteristics of unsupervised representation learning by leveraging disentangled VAE's to learn a useful latent space on a set of relational reasoning problems derived from Raven Progressive…

Machine Learning · Computer Science 2018-11-13 Xander Steenbrugge , Sam Leroux , Tim Verbelen , Bart Dhoedt

For a long time the ability to solve abstract reasoning tasks was considered one of the hallmarks of human intelligence. Recent advances in application of deep learning (DL) methods led, as in many other domains, to surpassing human…

Artificial Intelligence · Computer Science 2025-01-22 Mikołaj Małkiński , Jacek Mańdziuk

We introduce the Abductive Rule Learner with Context-awareness (ARLC), a model that solves abstract reasoning tasks based on Learn-VRF. ARLC features a novel and more broadly applicable training objective for abductive reasoning, resulting…

Machine Learning · Computer Science 2024-09-02 Giacomo Camposampiero , Michael Hersche , Aleksandar Terzić , Roger Wattenhofer , Abu Sebastian , Abbas Rahimi

In continual learning, a system learns from non-stationary data streams or batches without catastrophic forgetting. While this problem has been heavily studied in supervised image classification and reinforcement learning, continual…

Artificial Intelligence · Computer Science 2021-04-20 Tyler L. Hayes , Christopher Kanan

"Thinking in pictures," [1] i.e., spatial-temporal reasoning, effortless and instantaneous for humans, is believed to be a significant ability to perform logical induction and a crucial factor in the intellectual history of technology…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Chi Zhang , Baoxiong Jia , Feng Gao , Yixin Zhu , Hongjing Lu , Song-Chun Zhu

The Abstraction and Reasoning Corpus (ARC) is designed to promote research on abstract reasoning, a fundamental aspect of human intelligence. Common approaches to ARC treat it as a language-oriented problem, addressed by large language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Keya Hu , Ali Cy , Linlu Qiu , Xiaoman Delores Ding , Runqian Wang , Yeyin Eva Zhu , Jacob Andreas , Kaiming He

The Abstraction and Reasoning Corpus (ARC) is a popular benchmark focused on visual reasoning in the evaluation of Artificial Intelligence systems. In its original framing, an ARC task requires solving a program synthesis problem over small…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Wenhao Li , Yudong Xu , Scott Sanner , Elias Boutros Khalil

Spatial reasoning -- the ability to perceive and reason about relationships in space -- advances vision-language models (VLMs) from visual perception toward spatial semantic understanding. Existing approaches either revisit local image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Weijian Ma , Shizhao Sun , Tianyu Yu , Ruiyu Wang , Tat-Seng Chua , Jiang Bian

While Large Multimodal Models (LMMs) have made significant progress, they remain largely text-centric, relying on language as their core reasoning modality. As a result, they are limited in their ability to handle reasoning tasks that are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Kelvin Li , Chuyi Shang , Leonid Karlinsky , Rogerio Feris , Trevor Darrell , Roei Herzig

Visual reasoning is essential for building intelligent agents that understand the world and perform problem-solving beyond perception. Differentiable forward reasoning has been developed to integrate reasoning with gradient-based machine…

Machine Learning · Computer Science 2025-07-08 Hikaru Shindo , Viktor Pfanschilling , Devendra Singh Dhami , Kristian Kersting

With the continuous expansion of Large Language Models (LLMs) and advances in reinforcement learning, LLMs have demonstrated exceptional reasoning capabilities, enabling them to address a wide range of complex problems. Inspired by these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Hongrui Jia , Chaoya Jiang , Shikun Zhang , Wei Ye