English
Related papers

Related papers: Counterfactual Recipe Generation: Exploring Compos…

200 papers

Large-scale pre-trained language models have demonstrated strong capabilities of generating realistic text. However, it remains challenging to control the generation results. Previous approaches such as prompting are far from sufficient,…

Computation and Language · Computer Science 2021-11-10 Xu Zou , Da Yin , Qingyang Zhong , Ming Ding , Hongxia Yang , Zhilin Yang , Jie Tang

Counterfactual data augmentation has recently emerged as a method to mitigate confounding biases in the training data. These biases, such as spurious correlations, arise due to various observed and unobserved confounding variables in the…

Machine Learning · Computer Science 2023-11-22 Abbavaram Gowtham Reddy , Saketh Bachu , Saloni Dash , Charchit Sharma , Amit Sharma , Vineeth N Balasubramanian

While commonsense knowledge acquisition and reasoning has traditionally been a core research topic in the knowledge representation and reasoning community, recent years have seen a surge of interest in the natural language processing…

Computation and Language · Computer Science 2022-02-01 Prajjwal Bhargava , Vincent Ng

Deep learning models struggle with compositional generalization, i.e. the ability to recognize or generate novel combinations of observed elementary concepts. In hopes of enabling compositional generalization, various unsupervised learning…

Machine Learning · Computer Science 2022-10-07 Zhenlin Xu , Marc Niethammer , Colin Raffel

The recent demand for customized image generation raises a need for techniques that effectively extract the common concept from small sets of images. Existing methods typically rely on additional guidance, such as text prompts or spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Minseo Kim , Minchan Kwon , Dongyeun Lee , Yunho Jeon , Junmo Kim

In this paper, we address the challenge of recipe personalization through ingredient substitution. We make use of Large Language Models (LLMs) to build an ingredient substitution system designed to predict plausible substitute ingredients…

Computation and Language · Computer Science 2024-12-09 Thevin Senath , Kumuthu Athukorala , Ransika Costa , Surangika Ranathunga , Rishemjit Kaur

Counterfactuals can explain classification decisions of neural networks in a human interpretable way. We propose a simple but effective method to generate such counterfactuals. More specifically, we perform a suitable diffeomorphic…

Machine Learning · Computer Science 2022-06-17 Ann-Kathrin Dombrowski , Jan E. Gerken , Klaus-Robert Müller , Pan Kessel

Inferring objects and their relationships from an image in the form of a scene graph is useful in many applications at the intersection of vision and language. We consider a challenging problem of compositional generalization that emerges…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Boris Knyazev , Harm de Vries , Cătălina Cangea , Graham W. Taylor , Aaron Courville , Eugene Belilovsky

Natural data is often organized as a hierarchical composition of features. How many samples do generative models need in order to learn the composition rules, so as to produce a combinatorially large number of novel data? What signal in the…

Machine Learning · Statistics 2025-06-05 Alessandro Favero , Antonio Sclocchi , Francesco Cagnetta , Pascal Frossard , Matthieu Wyart

Counterfactual Data Augmentation (CDA) has been one of the preferred techniques for mitigating gender bias in natural language models. CDA techniques have mostly employed word substitution based on dictionaries. Although such…

Computation and Language · Computer Science 2023-11-07 Ewoenam Kwaku Tokpo , Toon Calders

Counterfactual explanations have been a popular method of post-hoc explainability for a variety of settings in Machine Learning. Such methods focus on explaining classifiers by generating new data points that are similar to a given…

Machine Learning · Computer Science 2024-10-21 Joshua Nathaniel Williams , Anurag Katakkar , Hoda Heidari , J. Zico Kolter

Neural networks are prone to learning shortcuts -- they often model simple correlations, ignoring more complex ones that potentially generalize better. Prior works on image classification show that instead of learning a connection to object…

Machine Learning · Computer Science 2021-01-18 Axel Sauer , Andreas Geiger

Counterfactual explanations are one of the prominent eXplainable Artificial Intelligence (XAI) techniques, and suggest changes to input data that could alter predictions, leading to more favourable outcomes. Existing counterfactual methods…

Artificial Intelligence · Computer Science 2025-05-22 Andrei Buliga , Chiara Di Francescomarino , Chiara Ghidini , Marco Montali , Massimiliano Ronzani

As large language models (LLMs) become increasingly advanced, their ability to exhibit compositional generalization -- the capacity to combine learned skills in novel ways not encountered during training -- has garnered significant…

Computation and Language · Computer Science 2025-01-22 Haoyu Zhao , Simran Kaur , Dingli Yu , Anirudh Goyal , Sanjeev Arora

Developing models that are capable of answering questions of the form "How would x change if y had been z?'" is fundamental to advancing medical image analysis. Training causal generative models that address such counterfactual questions,…

Machine Learning · Computer Science 2024-07-15 Yasin Ibrahim , Hermione Warr , Konstantinos Kamnitsas

Previous literature has proved that Pretrained Language Models (PLMs) can store factual knowledge. However, we find that facts stored in the PLMs are not always correct. It motivates us to explore a fundamental question: How do we calibrate…

Computation and Language · Computer Science 2022-10-19 Qingxiu Dong , Damai Dai , Yifan Song , Jingjing Xu , Zhifang Sui , Lei Li

Machine learning (ML) models play an increasingly prevalent role in many software engineering tasks. However, because most models are now powered by opaque deep neural networks, it can be difficult for developers to understand why the model…

Software Engineering · Computer Science 2021-11-11 Jürgen Cito , Isil Dillig , Vijayaraghavan Murali , Satish Chandra

Compositional generalization requires models to produce novel configurations from familiar parts. In diffusion models, prior compositional generation methods typically assume that the relevant concepts or conditioning signals are already…

Machine Learning · Computer Science 2026-05-11 Zekun Wang , Anant Gupta , Tianyi Zhu , Christopher J. MacLellan

Controllable generative sequence models with the capability to extract and replicate the style of specific examples enable many applications, including narrating audiobooks in different voices, auto-completing and auto-correcting written…

Machine Learning · Computer Science 2022-07-04 Jen-Hao Rick Chang , Ashish Shrivastava , Hema Swetha Koppula , Xiaoshuai Zhang , Oncel Tuzel

Counterfactual explanations suggest what should be different in the input instance to change the outcome of an AI system. When dealing with counterfactual explanations in the field of Predictive Process Monitoring, however, control flow…

Artificial Intelligence · Computer Science 2025-08-26 Andrei Buliga , Chiara Di Francescomarino , Chiara Ghidini , Ivan Donadello , Fabrizio Maria Maggi