中文
相关论文

相关论文: Less is More: Mitigate Spurious Correlations for O…

200 篇论文

While large neural-based conversational models have become increasingly proficient dialogue agents, recent work has highlighted safety issues with these systems. For example, these systems can be goaded into generating toxic content, which…

计算与语言 · 计算机科学 2023-10-24 Nicholas Meade , Spandana Gella , Devamanyu Hazarika , Prakhar Gupta , Di Jin , Siva Reddy , Yang Liu , Dilek Hakkani-Tür

Open-domain conversational systems are assumed to generate equally good responses on multiple domains. Previous work achieved good performance on the single corpus, but training and evaluating on multiple corpora from different domains are…

计算与语言 · 计算机科学 2022-05-06 Yujie Xing , Jinglun Cai , Nils Barlaug , Peng Liu , Jon Atle Gulla

Knowledge-grounded dialogue systems are intended to convey information that is based on evidence provided in a given source text. We discuss the challenges of training a generative neural dialogue model for such systems that is controlled…

计算与语言 · 计算机科学 2021-07-16 Hannah Rashkin , David Reitter , Gaurav Singh Tomar , Dipanjan Das

Dialog models can be greatly strengthened through grounding on various external information, but grounded dialog corpora are usually not naturally accessible. In this work, we focus on the few-shot learning for grounded dialog generation…

计算与语言 · 计算机科学 2022-01-17 Chujie Zheng , Minlie Huang

Recent advances in pre-trained language models have significantly improved neural response generation. However, existing methods usually view the dialogue context as a linear sequence of tokens and learn to generate the next word through…

计算与语言 · 计算机科学 2021-12-14 Xiaodong Gu , Kang Min Yoo , Jung-Woo Ha

The inaccessibility of controlled randomized trials due to inherent constraints in many fields of science has been a fundamental issue in causal inference. In this paper, we focus on distinguishing the cause from effect in the bivariate…

机器学习 · 统计学 2021-02-23 Jean-Francois Ton , Dino Sejdinovic , Kenji Fukumizu

Current works in the generation of personalized dialogue primarily contribute to the agent presenting a consistent personality and driving a more informative response. However, we found that the generated responses from most previous models…

计算与语言 · 计算机科学 2022-08-23 Itsugun Cho , Dongyang Wang , Ryota Takahashi , Hiroaki Saito

Progress in probabilistic generative models has accelerated, developing richer models with neural architectures, implicit densities, and with scalable algorithms for their Bayesian inference. However, there has been limited progress in…

机器学习 · 统计学 2017-10-31 Dustin Tran , David M. Blei

Unsupervised representation learning with variational inference relies heavily on independence assumptions over latent variables. Causal representation learning (CRL), however, argues that factors of variation in a dataset are, in fact,…

机器学习 · 计算机科学 2023-07-13 Avinash Kori , Pedro Sanchez , Konstantinos Vilouras , Ben Glocker , Sotirios A. Tsaftaris

Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario. To enable responses that are more meaningful and context-specific, we propose to improve…

计算与语言 · 计算机科学 2020-10-07 Shaoxiong Feng , Xuancheng Ren , Hongshen Chen , Bin Sun , Kan Li , Xu Sun

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

机器学习 · 计算机科学 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

Neural conversational models learn to generate responses by taking into account the dialog history. These models are typically optimized over the query-response pairs with a maximum likelihood estimation objective. However, the…

计算与语言 · 计算机科学 2020-03-05 Shaoxiong Feng , Hongshen Chen , Kan Li , Dawei Yin

In open-domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that…

人工智能 · 计算机科学 2021-05-06 Cheng Luo , Dayiheng Liu , Chanjuan Li , Li Lu , Jiancheng Lv

Discriminative approaches to classification often learn shortcuts that hold in-distribution but fail even under minor distribution shift. This failure mode stems from an overreliance on features that are spuriously correlated with the…

机器学习 · 计算机科学 2026-01-01 Alexander C. Li , Ananya Kumar , Deepak Pathak

We introduce a framework for learning robust visual representations that generalize to new viewpoints, backgrounds, and scene contexts. Discriminative models often learn naturally occurring spurious correlations, which cause them to fail on…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Chengzhi Mao , Augustine Cha , Amogh Gupta , Hao Wang , Junfeng Yang , Carl Vondrick

Standard language model training employs gold human documents or human-human interaction data, and treats all training data as positive examples. Growing evidence shows that even with very large amounts of positive training data, issues…

计算与语言 · 计算机科学 2022-11-14 Leonard Adolphs , Tianyu Gao , Jing Xu , Kurt Shuster , Sainbayar Sukhbaatar , Jason Weston

Transformer-based pre-trained language models boost the performance of open-domain dialogue systems. Prior works leverage Transformer-based pre-trained language models to generate texts with desired attributes in two general approaches: (1)…

计算与语言 · 计算机科学 2022-09-27 Wanyu Du , Yangfeng Ji

We present a novel natural language generation system for spoken dialogue systems capable of entraining (adapting) to users' way of speaking, providing contextually appropriate responses. The generator is based on recurrent neural networks…

计算与语言 · 计算机科学 2017-09-18 Ondřej Dušek , Filip Jurčíček

Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these…

计算与语言 · 计算机科学 2021-08-06 Jing Xu , Da Ju , Margaret Li , Y-Lan Boureau , Jason Weston , Emily Dinan

The natural language generation (NLG) component of a spoken dialogue system (SDS) usually needs a substantial amount of handcrafting or a well-labeled dataset to be trained on. These limitations add significantly to development costs and…

计算与语言 · 计算机科学 2015-08-10 Tsung-Hsien Wen , Milica Gasic , Dongho Kim , Nikola Mrksic , Pei-Hao Su , David Vandyke , Steve Young