English
Related papers

Related papers: CtD: Composition through Decomposition in Emergent…

200 papers

We propose Recognition as Part Composition (RPC), an image encoding approach inspired by human cognition. It is based on the cognitive theory that humans recognize complex objects by components, and that they build a small compact…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Samarth Mishra , Pengkai Zhu , Venkatesh Saligrama

Compositionality is a hallmark of human language that not only enables linguistic generalization, but also potentially facilitates acquisition. When simulating language emergence with neural networks, compositionality has been shown to…

Computation and Language · Computer Science 2023-05-23 Emily Cheng , Mathieu Rita , Thierry Poibeau

The principle of compositionality, which enables natural language to represent complex concepts via a structured combination of simpler ones, allows us to convey an open-ended set of messages using a limited vocabulary. If compositionality…

Computation and Language · Computer Science 2020-02-18 Yi Ren , Shangmin Guo , Matthieu Labeau , Shay B. Cohen , Simon Kirby

Compositionality of semantic concepts in image synthesis and analysis is appealing as it can help in decomposing known and generatively recomposing unknown data. For instance, we may learn concepts of changing illumination, geometry or…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Yunye Gong , Srikrishna Karanam , Ziyan Wu , Kuan-Chuan Peng , Jan Ernst , Peter C. Doerschuk

People easily recognize new visual categories that are new combinations of known components. This compositional generalization capacity is critical for learning in real-world domains like vision and language because the long tail of new…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yuval Atzmon , Felix Kreuk , Uri Shalit , Gal Chechik

Compositionality is believed to be fundamental to intelligence. In humans, it underlies the structure of thought, language, and higher-level reasoning. In AI, compositional representations can enable a powerful form of out-of-distribution…

Computation and Language · Computer Science 2025-06-04 Eric Elmoznino , Thomas Jiralerspong , Yoshua Bengio , Guillaume Lajoie

Children can rapidly generalize compositionally-constructed rules to unseen test sets. On the other hand, deep reinforcement learning (RL) agents need to be trained over millions of episodes, and their ability to generalize to unseen…

Machine Learning · Computer Science 2024-05-06 Zijun Lin , Haidi Azaman , M Ganesh Kumar , Cheston Tan

Compositionality in knowledge and language--the ability to represent complex concepts as a combination of simpler ones--is a hallmark of human cognition and communication. Despite recent advances, deep neural networks still struggle to…

Machine Learning · Computer Science 2025-12-01 Rafael Elberg , Felipe del Rio , Mircea Petrache , Denis Parra

A longstanding question in cognitive science concerns the learning mechanisms underlying compositionality in human cognition. Humans can infer the structured relationships (e.g., grammatical rules) implicit in their sensory observations…

Machine Learning · Computer Science 2021-05-20 Jacob Russin , Roland Fernandez , Hamid Palangi , Eric Rosen , Nebojsa Jojic , Paul Smolensky , Jianfeng Gao

Compositional learning, mastering the ability to combine basic concepts and construct more intricate ones, is crucial for human cognition, especially in human language comprehension and visual perception. This notion is tightly connected to…

Artificial Intelligence · Computer Science 2024-11-22 Sania Sinha , Tanawan Premsri , Parisa Kordjamshidi

Recent large-scale generative models learned on big data are capable of synthesizing incredible images yet suffer from limited controllability. This work offers a new generation paradigm that allows flexible control of the output image,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Lianghua Huang , Di Chen , Yu Liu , Yujun Shen , Deli Zhao , Jingren Zhou

One of the key factors in language productivity and human cognition is the ability of systematic compositionality, which refers to understanding composed unseen examples of seen primitives. However, recent evidence reveals that the…

Computation and Language · Computer Science 2023-12-13 Chen Huang , Peixin Qin , Wenqiang Lei , Jiancheng Lv

Systematic compositionality is the ability to recombine meaningful units with regular and predictable outcomes, and it's seen as key to humans' capacity for generalization in language. Recent work has studied systematic compositionality in…

Computation and Language · Computer Science 2018-07-20 João Loula , Marco Baroni , Brenden M. Lake

Composing simple elements into complex concepts is crucial yet challenging, especially for 3D action generation. Existing methods largely rely on extensive neural language annotations to discern composable latent semantics, a process that…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Xiao Liu , Guangyi Chen , Yansong Tang , Guangrun Wang , Xiao-Ping Zhang , Ser-Nam Lim

Human cognition has compositionality. We understand a scene by decomposing the scene into different concepts (e.g., shape and position of an object) and learning the respective laws of these concepts, which may be either natural (e.g., laws…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Fan Shi , Bin Li , Xiangyang Xue

Systematic generalization refers to the capacity to understand and generate novel combinations from known components. Despite recent progress by large language models (LLMs) across various domains, these models often fail to extend their…

Artificial Intelligence · Computer Science 2026-02-27 Philipp Mondorf , Shijia Zhou , Monica Riedler , Barbara Plank

Compositionality has long been considered a key explanatory property underlying human intelligence: arbitrary concepts can be composed into novel complex combinations, permitting the acquisition of an open ended, potentially infinite…

Neural and Evolutionary Computing · Computer Science 2025-09-08 Jacob Russin , Sam Whitman McGrath , Danielle J. Williams

A fundamental characteristic common to both human vision and natural language is their compositional nature. Yet, despite the performance gains contributed by large vision and language pretraining, recent investigations find that most-if…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Chenhao Zheng , Jieyu Zhang , Aniruddha Kembhavi , Ranjay Krishna

Compositional zero-shot learning aims to recognize unseen compositions of seen visual primitives of object classes and their states. While all primitives (states and objects) are observable during training in some combination, their complex…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Muhammad Gul Zain Ali Khan , Muhammad Ferjad Naeem , Luc Van Gool , Alain Pagani , Didier Stricker , Muhammad Zeshan Afzal

When writing programs, people have the ability to tackle a new complex task by decomposing it into smaller and more familiar subtasks. While it is difficult to measure whether neural program synthesis methods have similar capabilities, what…

Machine Learning · Computer Science 2023-10-31 Kensen Shi , Joey Hong , Manzil Zaheer , Pengcheng Yin , Charles Sutton