English
Related papers

Related papers: Gumbel Counterfactual Generation From Language Mod…

200 papers

Deep generative models have shown tremendous capability in data density estimation and data generation from finite samples. While these models have shown impressive performance by learning correlations among features in the data, some…

Machine Learning · Computer Science 2024-05-24 Aneesh Komanduri , Xintao Wu , Yongkai Wu , Feng Chen

Estimating an individual's counterfactual outcomes under interventions is a challenging task for traditional causal inference and supervised learning approaches when the outcome is high-dimensional (e.g. gene expressions, facial images) and…

Machine Learning · Computer Science 2025-03-19 Yulun Wu , Louie McConnell , Claudia Iriondo

Causal structure discovery methods are commonly applied to structured data where the causal variables are known and where statistical testing can be used to assess the causal relationships. By contrast, recovering a causal structure from…

Computation and Language · Computer Science 2024-10-10 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

In this paper, we propose leveraging causal generative learning as an interpretable tool for explaining image classifiers. Specifically, we present a generative counterfactual inference approach to study the influence of visual features…

Machine Learning · Computer Science 2024-01-23 Will Taylor-Melanson , Zahra Sadeghi , Stan Matwin

Controllable text generation concerns two fundamental tasks of wide applications, namely generating text of given attributes (i.e., attribute-conditional generation), and minimally editing existing text to possess desired attributes (i.e.,…

Computation and Language · Computer Science 2022-01-25 Zhiting Hu , Li Erran Li

Drawing causal conclusions from observational data requires making assumptions about the true data-generating process. Causal inference research typically considers low-dimensional data, such as categorical or numerical fields in structured…

Computation and Language · Computer Science 2021-02-11 Zach Wood-Doughty , Ilya Shpitser , Mark Dredze

Learning to control the structure of sentences is a challenging problem in text generation. Existing work either relies on simple deterministic approaches or RL-based hard structures. We explore the use of structured variational…

Computation and Language · Computer Science 2020-12-01 Yao Fu , Chuanqi Tan , Bin Bi , Mosha Chen , Yansong Feng , Alexander M. Rush

Large language models (LLMs) have made remarkable progress in a wide range of natural language understanding and generation tasks. However, their ability to generate counterfactuals has not been examined systematically. To bridge this gap,…

Computation and Language · Computer Science 2024-02-26 Yongqi Li , Mayi Xu , Xin Miao , Shen Zhou , Tieyun Qian

Machine Learning has seen tremendous growth recently, which has led to larger adoption of ML systems for educational assessments, credit risk, healthcare, employment, criminal justice, to name a few. The trustworthiness of ML and NLP…

Computation and Language · Computer Science 2021-03-19 Nishtha Madaan , Inkit Padhi , Naveen Panwar , Diptikalyan Saha

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

We present a conditional text generation framework that posits sentential expressions of possible causes and effects. This framework depends on two novel resources we develop in the course of this work: a very large-scale collection of…

Computation and Language · Computer Science 2021-07-22 Zhongyang Li , Xiao Ding , Ting Liu , J. Edward Hu , Benjamin Van Durme

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

LLM-based social simulations can generate believable community interactions, enabling ``policy wind tunnels'' where governance interventions are tested before deployment. But believability is not causality. Claims like ``intervention $A$…

Computation and Language · Computer Science 2026-04-17 Agam Goyal , Yian Wang , Eshwar Chandrasekharan , Hari Sundaram

Previous neural machine translation models used some heuristic search algorithms (e.g., beam search) in order to avoid solving the maximum a posteriori problem over translation sentences at test time. In this paper, we propose the…

Computation and Language · Computer Science 2017-06-26 Jiatao Gu , Daniel Jiwoong Im , Victor O. K. Li

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

Counterfactual image editing is an important task in generative AI, which asks how an image would look if certain features were different. The current literature on the topic focuses primarily on changing individual features while remaining…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Yushu Pan , Elias Bareinboim

When language models process syntactically complex sentences, do they use their representations of syntax in a manner that is consistent with the grammar of the language? We propose AlterRep, an intervention-based method to address this…

Computation and Language · Computer Science 2021-09-16 Shauli Ravfogel , Grusha Prasad , Tal Linzen , Yoav Goldberg

Neural language models exhibit impressive performance on a variety of tasks, but their internal reasoning may be difficult to understand. Prior art aims to uncover meaningful properties within model representations via probes, but it is…

Computation and Language · Computer Science 2021-09-21 Mycal Tucker , Peng Qian , Roger Levy

The need for interpretability in deep learning has driven interest in counterfactual explanations, which identify minimal changes to an instance that change a model's prediction. Current counterfactual (CF) generation methods require…

Computation and Language · Computer Science 2025-12-11 Van Bach Nguyen , Christin Seifert , Jörg Schlötterer

Explainability for machine learning models has gained considerable attention within the research community given the importance of deploying more reliable machine-learning systems. In computer vision applications, generative counterfactual…

Machine Learning · Computer Science 2021-11-12 Pau Rodriguez , Massimo Caccia , Alexandre Lacoste , Lee Zamparo , Issam Laradji , Laurent Charlin , David Vazquez