English
Related papers

Related papers: Local Mechanisms of Compositional Generalization i…

200 papers

Compositionality -- the ability to combine familiar units like words into novel phrases and sentences -- has been the focus of intense interest in artificial intelligence in recent years. To test compositional generalization in semantic…

Computation and Language · Computer Science 2022-03-17 Emily Goodwin , Siva Reddy , Timothy J. O'Donnell , Dzmitry Bahdanau

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

Domain generalization (DG) is essentially an out-of-distribution problem, aiming to generalize the knowledge learned from multiple source domains to an unseen target domain. The mainstream is to leverage statistical models to model the…

Machine Learning · Computer Science 2022-03-29 Fangrui Lv , Jian Liang , Shuang Li , Bin Zang , Chi Harold Liu , Ziteng Wang , Di Liu

Diffusion models are a class of generative models that serve to establish a stochastic transport map between an empirically observed, yet unknown, target distribution and a known prior. Despite their remarkable success in real-world…

Machine Learning · Computer Science 2025-03-13 Puheng Li , Zhong Li , Huishuai Zhang , Jiang Bian

A hallmark of human intelligence is the ability to construct self-contained chunks of knowledge and reuse them in novel combinations for solving different problems. Learning such compositional structures has been a challenge for artificial…

Machine Learning · Computer Science 2022-07-26 Jorge A. Mendez

Synthetic data generation is increasingly used in machine learning for training and data augmentation. Yet, current strategies often rely on external foundation models or datasets, whose usage is restricted in many scenarios due to policy…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Parsa Rahimi , Sebastien Marcel

Learning the causal structure behind data is invaluable for improving generalization and obtaining high-quality explanations. We propose a novel framework, Invariant Structure Learning (ISL), that is designed to improve causal structure…

Machine Learning · Computer Science 2022-06-15 Yunhao Ge , Sercan Ö. Arik , Jinsung Yoon , Ao Xu , Laurent Itti , Tomas Pfister

Addressing the limitations of text as a source of accurate layout representation in text-conditional diffusion models, many works incorporate additional signals to condition certain attributes within a generated image. Although successful,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Jonghyun Lee , Hansam Cho , Youngjoon Yoo , Seoung Bum Kim , Yonghyun Jeong

It has become increasingly common nowadays to collect observations of feature and response pairs from different environments. As a consequence, one has to apply learned predictors to data with a different distribution due to distribution…

Methodology · Statistics 2023-10-31 Kang Du , Yu Xiang

Complex visual scenes that are composed of multiple objects, each with attributes, such as object name, location, pose, color, etc., are challenging to describe in order to train neural networks. Usually,deep learning networks are trained…

Neural and Evolutionary Computing · Computer Science 2023-03-27 E. Paxon Frady , Spencer Kent , Quinn Tran , Pentti Kanerva , Bruno A. Olshausen , Friedrich T. Sommer

Spatio-temporal forecasting is challenging attributing to the high nonlinearity in temporal dynamics as well as complex location-characterized patterns in spatial domains, especially in fields like weather forecasting. Graph convolutions…

Machine Learning · Computer Science 2021-12-14 Haitao Lin , Zhangyang Gao , Yongjie Xu , Lirong Wu , Ling Li , Stan. Z. Li

Compositional generalization, representing the model's ability to generate text with new attribute combinations obtained by recombining single attributes from the training data, is a crucial property for multi-aspect controllable text…

Computation and Language · Computer Science 2024-06-04 Tianqi Zhong , Zhaoyi Li , Quan Wang , Linqi Song , Ying Wei , Defu Lian , Zhendong Mao

The ability to learn and compose functions is foundational to efficient learning and reasoning in humans, enabling flexible generalizations such as creating new dishes from known cooking processes. Beyond sequential chaining of functions,…

Artificial Intelligence · Computer Science 2024-03-20 Yanli Zhou , Brenden M. Lake , Adina Williams

An important component for generalization in machine learning is to uncover underlying latent factors of variation as well as the mechanism through which each factor acts in the world. In this paper, we test whether 17 unsupervised, weakly…

We propose a new inference framework called localized conformal prediction. It generalizes the framework of conformal prediction by offering a single-test-sample adaptive construction that emphasizes a local region around this test sample,…

Statistics Theory · Mathematics 2022-03-02 Leying Guan

Diffusion models have emerged as the principal paradigm for generative modeling across various domains. During training, they learn the score function, which in turn is used to generate samples at inference. They raise a basic yet unsolved…

Machine Learning · Computer Science 2025-10-03 Kiwhan Song , Jaeyeon Kim , Sitan Chen , Yilun Du , Sham Kakade , Vincent Sitzmann

Human linguistic capacity is often characterized by compositionality and the generalization it enables -- human learners can produce and comprehend novel complex expressions by composing known parts. Several benchmarks exploit…

Computation and Language · Computer Science 2022-12-22 Najoung Kim , Tal Linzen , Paul Smolensky

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

Machine Learning · Computer Science 2025-01-03 Gen Li , Yuling Yan

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

Domain Generalization (DG) aims to learn a model that can generalize well to unseen target domains from a set of source domains. With the idea of invariant causal mechanism, a lot of efforts have been put into learning robust causal effects…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Qiaowei Miao , Junkun Yuan , Kun Kuang