English
Related papers

Related papers: Counterfactual Off-Policy Training for Neural Resp…

200 papers

Evaluating hypothetical statements about how the world would be had a different course of action been taken is arguably one key capability expected from modern AI systems. Counterfactual reasoning underpins discussions in fairness, the…

Machine Learning · Computer Science 2022-10-04 Kevin Xia , Yushu Pan , Elias Bareinboim

Large-scale neural language models exhibit remarkable performance in in-context learning: the ability to learn and reason about the input context on the fly. This work studies in-context counterfactual reasoning in language models, that is,…

Computation and Language · Computer Science 2025-10-22 Moritz Miller , Bernhard Schölkopf , Siyuan Guo

We propose an architecture for training generative models of counterfactual conditionals of the form, 'can we modify event A to cause B instead of C?', motivated by applications in robot control. Using an 'adversarial training' paradigm, an…

Robotics · Computer Science 2020-09-23 Simón C. Smith , Subramanian Ramamoorthy

Although deep learning models have brought tremendous advancements to the field of open-domain dialogue response generation, recent research results have revealed that the trained models have undesirable generation behaviors, such as…

Computation and Language · Computer Science 2020-08-19 Tianxing He , James Glass

Interpreting the inference-time behavior of deep neural networks remains a challenging problem. Existing approaches to counterfactual explanation typically ask: What is the closest alternative input that would alter the model's prediction…

Machine Learning · Computer Science 2026-02-12 Brian Hyeongseok Kim , Jacqueline L. Mitchell , Chao Wang

Recent papers in explainable AI have made a compelling case for counterfactual modes of explanation. While counterfactual explanations appear to be extremely effective in some instances, they are formally equivalent to adversarial examples.…

Artificial Intelligence · Computer Science 2020-12-21 Kieran Browne , Ben Swift

Avoiding the generation of responses that contradict the preceding context is a significant challenge in dialogue response generation. One feasible method is post-processing, such as filtering out contradicting responses from a resulting…

Computation and Language · Computer Science 2022-08-05 Shiki Sato , Reina Akama , Hiroki Ouchi , Ryoko Tokuhisa , Jun Suzuki , Kentaro Inui

As machine learning (ML) models become more widely deployed in high-stakes applications, counterfactual explanations have emerged as key tools for providing actionable model explanations in practice. Despite the growing popularity of…

Machine Learning · Computer Science 2022-12-16 Martin Pawelczyk , Chirag Agarwal , Shalmali Joshi , Sohini Upadhyay , Himabindu Lakkaraju

The natural language generation (NLG) module in a task-oriented dialogue system produces user-facing utterances conveying required information. Thus, it is critical for the generated response to be natural and fluent. We propose to…

Computation and Language · Computer Science 2020-05-07 Chenguang Zhu

Recommender system practitioners are facing increasing pressure to explain recommendations. We explore how to explain recommendations using counterfactual logic, i.e. "Had you not interacted with the following items, we would not recommend…

Artificial Intelligence · Computer Science 2023-02-10 Yuanshun Yao , Chong Wang , Hang Li

Counterfactual explanations are an emerging tool to enhance interpretability of deep learning models. Given a sample, these methods seek to find and display to the user similar samples across the decision boundary. In this paper, we propose…

Machine Learning · Computer Science 2023-08-22 Cassio F. Dantas , Diego Marcos , Dino Ienco

Reinforcement Learning (RL) has shown great promise in domains like healthcare and robotics but often struggles with adoption due to its lack of interpretability. Counterfactual explanations, which address "what if" scenarios, provide a…

Machine Learning · Computer Science 2025-05-20 Shuyang Dong , Shangtong Zhang , Lu Feng

Modern neural language models that are widely used in various NLP tasks risk memorizing sensitive information from their training data. Understanding this memorization is important in real world applications and also from a…

Computation and Language · Computer Science 2023-10-17 Chiyuan Zhang , Daphne Ippolito , Katherine Lee , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

Most existing approaches for goal-oriented dialogue policy learning used reinforcement learning, which focuses on the target agent policy and simply treat the opposite agent policy as part of the environment. While in real-world scenarios,…

Computation and Language · Computer Science 2020-04-22 Zheng Zhang , Lizi Liao , Xiaoyan Zhu , Tat-Seng Chua , Zitao Liu , Yan Huang , Minlie Huang

Although pre-trained language models show good performance on various natural language processing tasks, they often rely on non-causal features and patterns to determine the outcome. For natural language inference tasks, previous results…

Computation and Language · Computer Science 2024-10-29 Heerin Yang , Sseung-won Hwang , Jungmin So

Determining the plausibility of causal relations between clauses is a commonsense reasoning task that requires complex inference ability. The general approach to this task is to train a large pretrained language model on a specific dataset.…

Computation and Language · Computer Science 2021-01-14 Ieva Staliūnaitė , Philip John Gorinski , Ignacio Iacobacci

Open domain neural dialogue models, despite their successes, are known to produce responses that lack relevance, diversity, and in many cases coherence. These shortcomings stem from the limited ability of common training objectives to…

Computation and Language · Computer Science 2019-09-06 Oluwatobi Olabiyi , Erik T. Mueller , Christopher Larson , Tarek Lahlou

In open-domain dialogue systems, generative approaches have attracted much attention for response generation. However, existing methods are heavily plagued by generating safe responses and unnatural responses. To alleviate these two…

Computation and Language · Computer Science 2019-06-25 Shaobo Cui , Rongzhong Lian , Di Jiang , Yuanfeng Song , Siqi Bao , Yong Jiang

Most of the existing works for dialogue generation are data-driven models trained directly on corpora crawled from websites. They mainly focus on improving the model architecture to produce better responses but pay little attention to…

Computation and Language · Computer Science 2021-06-23 Xin Li , Piji Li , Yan Wang , Xiaojiang Liu , Wai Lam

In this work, we present an extensive study on the use of pre-trained language models for the task of automatic Counter Narrative (CN) generation to fight online hate speech in English. We first present a comparative study to determine…

Computation and Language · Computer Science 2022-04-05 Serra Sinem Tekiroglu , Helena Bonaldi , Margherita Fanton , Marco Guerini