English
Related papers

Related papers: Compositional diversity in visual concept learning

200 papers

Despite ample evidence that our concepts, our cognitive architecture, and mathematics itself are all deeply compositional, few models take advantage of this structure. We therefore propose a radically compositional approach to computational…

Neurons and Cognition · Quantitative Biology 2019-11-18 Toby B. St Clere Smithe

Findings in recent years on the sensitivity of convolutional neural networks to additive noise, light conditions and to the wholeness of the training dataset, indicate that this technology still lacks the robustness needed for the…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Dan Malowany , Hugo Guterman

Compositionality is believed to be fundamental to intelligence. In humans, it underlies the structure of thought, language, and higher-level reasoning. In AI, compositional representations can enable a powerful form of out-of-distribution…

Computation and Language · Computer Science 2025-06-04 Eric Elmoznino , Thomas Jiralerspong , Yoshua Bengio , Guillaume Lajoie

Machine learning algorithms have achieved superhuman performance in specific complex domains. However, learning online from few examples and compositional learning for efficient generalization across domains remain elusive. In humans, such…

Neurons and Cognition · Quantitative Biology 2024-11-11 V. A. Aksyuk

How do we imagine visual objects and combine them to create new forms? To answer this question, we need to explore the cognitive, computational and neural mechanisms underlying imagery and creativity. The body of research on deep learning…

Neurons and Cognition · Quantitative Biology 2021-12-14 Shekoofeh Hedayati , Roger Beaty , Brad Wyble

The ability to compose learned concepts and apply them in novel settings is key to human intelligence, but remains a persistent limitation in state-of-the-art machine learning models. To address this issue, we introduce COGITAO, a modular…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yassine Taoudi-Benchekroun , Klim Troyan , Pascal Sager , Stefan Gerber , Lukas Tuggener , Benjamin Grewe

It is very attractive to formulate vision in terms of pattern theory \cite{Mumford2010pattern}, where patterns are defined hierarchically by compositions of elementary building blocks. But applying pattern theory to real world images is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Jianyu Wang , Zhishuai Zhang , Cihang Xie , Yuyin Zhou , Vittal Premachandran , Jun Zhu , Lingxi Xie , Alan Yuille

We consider learning and compositionality as the key mechanisms towards simulating human-like intelligence. While each mechanism is successfully achieved by neural networks and symbolic AIs, respectively, it is the combination of the two…

Artificial Intelligence · Computer Science 2022-08-29 Ximing Qiao , Hai Li

A remarkable feature of human beings is their capacity for creative behaviour, referring to their ability to react to problems in ways that are novel, surprising, and useful. Transformational creativity is a form of creativity where the…

Machine Learning · Computer Science 2019-06-26 Maarten Grachten , Carlos Eduardo Cancino Chacón

Integration between biology and information science benefits both fields. Many related models have been proposed, such as computational visual cognition models, computational motor control models, integrations of both and so on. In general,…

Computer Vision and Pattern Recognition · Computer Science 2016-03-28 Peijie Yin , Hong Qiao , Wei Wu , Lu Qi , YinLin Li , Shanlin Zhong , Bo Zhang

Inferring objects and their relationships from an image in the form of a scene graph is useful in many applications at the intersection of vision and language. We consider a challenging problem of compositional generalization that emerges…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Boris Knyazev , Harm de Vries , Cătălina Cangea , Graham W. Taylor , Aaron Courville , Eugene Belilovsky

Lexical Semantics is concerned with how words encode mental representations of the world, i.e., concepts . We call this type of concepts, classification concepts . In this paper, we focus on Visual Semantics , namely on how humans build…

Artificial Intelligence · Computer Science 2021-09-15 Fausto Giunchiglia , Luca Erculiani , Andrea Passerini

It has been hypothesized that human-level visual perception requires a generative approach in which internal representations result from inverting a decoder. Yet today's most successful vision models are non-generative, relying on an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Jack Brady , Bernhard Schölkopf , Thomas Kipf , Simon Buchholz , Wieland Brendel

Recurrent feedback connections in the mammalian visual system have been hypothesized to play a role in synthesizing input in the theoretical framework of analysis by synthesis. The comparison of internally synthesized representation with…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Hao Wang , Xingyu Lin , Yimeng Zhang , Tai Sing Lee

Autonomous agents need large repertoires of skills to act reasonably on new tasks that they have not seen before. However, acquiring these skills using only a stream of high-dimensional, unstructured, and unlabeled observations is a tricky…

Machine Learning · Computer Science 2021-02-09 Andrii Zadaianchuk , Maximilian Seitzer , Georg Martius

Compositional generalization is the ability to generalize systematically to a new data distribution by combining known components. Although humans seem to have a great ability to generalize compositionally, state-of-the-art neural models…

Machine Learning · Computer Science 2021-06-22 Juyong Kim , Pradeep Ravikumar , Joshua Ainslie , Santiago Ontañón

We describe a procedure for explaining neurons in deep representations by identifying compositional logical concepts that closely approximate neuron behavior. Compared to prior work that uses atomic labels as explanations, analyzing neurons…

Machine Learning · Computer Science 2021-02-04 Jesse Mu , Jacob Andreas

Segmenting visual stimuli into distinct groups of features and visual objects is central to visual function. Classical psychophysical methods have helped uncover many rules of human perceptual segmentation, and recent progress in machine…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Jonathan Vacher , Claire Launay , Pascal Mamassian , Ruben Coen-Cagli

Compositional Zero-Shot Learning (CZSL) aims to recognize novel compositions using knowledge learned from seen attribute-object compositions in the training set. Previous works mainly project an image and a composition into a common…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tian Zhang , Kongming Liang , Ruoyi Du , Xian Sun , Zhanyu Ma , Jun Guo

Each year, thousands of people learn new visual categorization tasks -- radiologists learn to recognize tumors, birdwatchers learn to distinguish similar species, and crowd workers learn how to annotate valuable data for applications like…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Neehar Kondapaneni , Pietro Perona , Oisin Mac Aodha