English
Related papers

Related papers: Towards Understanding the Relationship between In-…

200 papers

Generalization of models to out-of-distribution (OOD) data has captured tremendous attention recently. Specifically, compositional generalization, i.e., whether a model generalizes to new structures built of components observed during…

Computation and Language · Computer Science 2020-10-13 Inbar Oren , Jonathan Herzig , Nitish Gupta , Matt Gardner , Jonathan Berant

The neural architectures of language models are becoming increasingly complex, especially that of Transformers, based on the attention mechanism. Although their application to numerous natural language processing tasks has proven to be very…

Computation and Language · Computer Science 2023-12-04 Pablo Gamallo

Humans can systematically generalize to novel compositions of existing concepts. Recent studies argue that neural networks appear inherently ineffective in such cognitive capacity, leading to a pessimistic view and a lack of attention to…

Computation and Language · Computer Science 2022-10-19 Ning Shi , Boxin Wang , Wei Wang , Xiangyu Liu , Zhouhan Lin

Compositional generalization-the systematic combination of known components into novel structures-remains a core challenge in cognitive science and machine learning. Although transformer-based large language models can exhibit strong…

Machine Learning · Computer Science 2025-02-25 Cheng Tang , Brenden Lake , Mehrdad Jazayeri

The ability to learn and compose functions is foundational to efficient learning and reasoning in humans, enabling flexible generalizations such as creating new dishes from known cooking processes. Beyond sequential chaining of functions,…

Artificial Intelligence · Computer Science 2024-03-20 Yanli Zhou , Brenden M. Lake , Adina Williams

Grounded language models use external sources of information, such as knowledge graphs, to meet some of the general challenges associated with pre-training. By extending previous work on compositional generalization in semantic parsing, we…

Computation and Language · Computer Science 2024-06-10 Sondre Wold , Étienne Simon , Lucas Georges Gabriel Charpentier , Egor V. Kostylev , Erik Velldal , Lilja Øvrelid

Humans excel at applying learned behavior to unlearned situations. A crucial component of this generalization behavior is our ability to compose/decompose a whole into reusable parts, an attribute known as compositionality. One of the…

Artificial Intelligence · Computer Science 2024-07-24 Prasanna Vijayaraghavan , Jeffrey Frederic Queisser , Sergio Verduzco Flores , Jun Tani

Composing basic skills from simple tasks to accomplish composite tasks is crucial for modern intelligent systems. We investigate the in-context composition ability of language models to perform composite tasks that combine basic skills…

Machine Learning · Computer Science 2025-10-28 Zidong Liu , Zhuoyan Xu , Zhenmei Shi , Yingyu Liang

Systematic compositionality is an essential mechanism in human language, allowing the recombination of known parts to create novel expressions. However, existing neural models have been shown to lack this basic ability in learning symbolic…

Computation and Language · Computer Science 2021-10-01 Yichen Jiang , Mohit Bansal

To understand and infer meaning in language, neural models have to learn complicated nuances. Discovering distinctive linguistic phenomena from data is not an easy task. For instance, lexical ambiguity is a fundamental feature of language…

Computation and Language · Computer Science 2021-02-23 Marzieh Fadaee

Humans are highly efficient learners, with the ability to grasp the meaning of a new concept from just a few examples. Unlike popular computer vision systems, humans can flexibly leverage the compositional structure of the visual world,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Yanli Zhou , Brenden M. Lake

Transformers have demonstrated impressive capabilities across various tasks, yet their performance on compositional problems remains a subject of debate. In this study, we investigate the internal mechanisms underlying Transformers'…

Computation and Language · Computer Science 2025-01-16 Zhongwang Zhang , Pengxiao Lin , Zhiwei Wang , Yaoyu Zhang , Zhi-Qin John Xu

Modern machine learning requires system designers to specify aspects of the learning pipeline, such as losses, architectures, and optimizers. Meta-learning, or learning-to-learn, instead aims to learn those aspects, and promises to unlock…

Machine Learning · Computer Science 2024-01-10 Louis Kirsch , James Harrison , Jascha Sohl-Dickstein , Luke Metz

Compositionality is thought to be a key component of language, and various compositional benchmarks have been developed to empirically probe the compositional generalization of existing sequence processing models. These benchmarks often…

Machine Learning · Computer Science 2024-05-07 Parikshit Ram , Tim Klinger , Alexander G. Gray

Obtaining human-like performance in NLP is often argued to require compositional generalisation. Whether neural networks exhibit this ability is usually studied by training models on highly compositional synthetic data. However,…

Computation and Language · Computer Science 2022-04-01 Verna Dankers , Elia Bruni , Dieuwke Hupkes

Despite the recent progress in deep learning and reinforcement learning, transfer and generalization of skills learned on specific tasks is very limited compared to human (or animal) intelligence. The lifelong, incremental building of…

Artificial Intelligence · Computer Science 2022-08-10 Louis Annabi

Many complex tasks can be decomposed into simpler, independent parts. Discovering such underlying compositional structure has the potential to enable compositional generalization. Despite progress, our most powerful systems struggle to…

The DisCoCirc framework for natural language processing allows the construction of compositional models of text, by combining units for individual words together according to the grammatical structure of the text. The compositional nature…

Computation and Language · Computer Science 2025-07-08 Tiffany Duneau

Modern neural machine translation (NMT) models have achieved competitive performance in standard benchmarks. However, they have recently been shown to suffer limitation in compositional generalization, failing to effectively learn the…

Computation and Language · Computer Science 2022-10-14 Yongjing Yin , Yafu Li , Fandong Meng , Jie Zhou , Yue Zhang

Prior work has shown that text-conditioned diffusion models can learn to identify and manipulate primitive concepts underlying a compositional data-generating process, enabling generalization to entirely novel, out-of-distribution…

Machine Learning · Computer Science 2025-11-03 Yongyi Yang , Core Francisco Park , Ekdeep Singh Lubana , Maya Okawa , Wei Hu , Hidenori Tanaka