English
Related papers

Related papers: Less is More: Mitigate Spurious Correlations for O…

200 papers

We study multi-turn response generation for open-domain dialogues. The existing state-of-the-art addresses the problem with deep neural architectures. While these models improved response quality, their complexity also hinders the…

Computation and Language · Computer Science 2020-11-10 Yufan Zhao , Can Xu , Wei Wu , Lei Yu

A challenge in training discriminative models like neural networks is obtaining enough labeled training data. Recent approaches use generative models to combine weak supervision sources, like user-defined heuristics or knowledge bases, to…

Machine Learning · Computer Science 2017-09-29 Paroma Varma , Bryan He , Dan Iter , Peng Xu , Rose Yu , Christopher De Sa , Christopher Ré

Using prompts to explore the knowledge contained within pre-trained language models for downstream tasks has now become an active topic. Current prompt tuning methods mostly convert the downstream tasks to masked language modeling problems…

Computation and Language · Computer Science 2022-10-25 Jiale Han , Shuai Zhao , Bo Cheng , Shengkun Ma , Wei Lu

In retrieval-based dialogue systems, a response selection model acts as a ranker to select the most appropriate response among several candidates. However, such selection models tend to rely on context-response content similarity, which…

Computation and Language · Computer Science 2022-11-01 Nyoungwoo Lee , ChaeHun Park , Ho-Jin Choi , Jaegul Choo

Prompt-tuning has become an increasingly popular parameter-efficient method for adapting large pretrained language models to downstream tasks. However, both discrete prompting and continuous prompting assume fixed prompts for all data…

Computation and Language · Computer Science 2023-07-12 Runcheng Liu , Ahmad Rashid , Ivan Kobyzev , Mehdi Rezagholizadeh , Pascal Poupart

Neural conversation models such as encoder-decoder models are easy to generate bland and generic responses. Some researchers propose to use the conditional variational autoencoder(CVAE) which maximizes the lower bound on the conditional…

Computation and Language · Computer Science 2019-11-25 Jun Gao , Wei Bi , Xiaojiang Liu , Junhui Li , Guodong Zhou , Shuming Shi

Deep neural networks have been shown to learn and rely on spurious correlations present in the data that they are trained on. Reliance on such correlations can cause these networks to malfunction when deployed in the real world, where these…

Machine Learning · Computer Science 2025-05-20 Varun Mulchandani , Jung-Eun Kim

Closed-book question answering (QA) requires a model to directly answer an open-domain question without access to any external knowledge. Prior work on closed-book QA either directly finetunes or prompts a pretrained language model (LM) to…

Computation and Language · Computer Science 2023-04-28 Dan Su , Mostofa Patwary , Shrimai Prabhumoye , Peng Xu , Ryan Prenger , Mohammad Shoeybi , Pascale Fung , Anima Anandkumar , Bryan Catanzaro

Despite their widespread adoption, neural conversation models have yet to exhibit natural chat capabilities with humans. In this research, we examine user utterances as causes and generated responses as effects, recognizing that changes in…

Computation and Language · Computer Science 2023-07-11 Yi-Lin Tuan , Alon Albalak , Wenda Xu , Michael Saxon , Connor Pryor , Lise Getoor , William Yang Wang

Using a sequence-to-sequence framework, many neural conversation models for chit-chat succeed in naturalness of the response. Nevertheless, the neural conversation models tend to give generic responses which are not specific to given…

Computation and Language · Computer Science 2018-05-24 Jonggu Kim , Doyeon Kong , Jong-Hyeok Lee

Despite recent advances, goal-directed generation of structured discrete data remains challenging. For problems such as program synthesis (generating source code) and materials design (generating molecules), finding examples which satisfy…

Machine Learning · Computer Science 2020-10-26 Amina Mollaysa , Brooks Paige , Alexandros Kalousis

With the growing use of Retrieval-Augmented Generation (RAG), training large language models (LLMs) for context-sensitive reasoning and faithfulness is increasingly important. Existing RAG-oriented reinforcement learning (RL) methods rely…

Computation and Language · Computer Science 2026-03-06 Zhehao Tan , Yihan Jiao , Dan Yang , Junjie Wang , Duolin Sun , Jie Feng , Xidong Wang , Lei Liu , Yue Shen , Jian Wang , Jinjie Gu

Conversational agents have become an integral part of the general population for simple task enabling situations. However, these systems are yet to have any social impact on the diverse and minority population, for example, helping people…

Computation and Language · Computer Science 2021-12-07 Shachi H Kumar , Hsuan Su , Ramesh Manuvinakurike , Saurav Sahay , Lama Nachman

Recent deep learning models have shown improving results to natural language generation (NLG) irrespective of providing sufficient annotated data. However, a modest training data may harm such models performance. Thus, how to build a…

Computation and Language · Computer Science 2018-11-13 Van-Khanh Tran , Le-Minh Nguyen

The growing number of generative AI-based dialogue systems has made their evaluation a crucial challenge. This paper presents our contribution to this important problem through the Dialogue System Technology Challenge (DSTC-12, Track 1),…

Retrieve-based dialogue response selection aims to find a proper response from a candidate set given a multi-turn context. Pre-trained language models (PLMs) based methods have yielded significant improvements on this task. The sequence…

Computation and Language · Computer Science 2021-11-29 Yuntao Li , Can Xu , Huang Hu , Lei Sha , Yan Zhang , Daxin Jiang

Moving from limited-domain natural language generation (NLG) to open domain is difficult because the number of semantic input combinations grows exponentially with the number of domains. Therefore, it is important to leverage existing…

Computation and Language · Computer Science 2016-03-04 Tsung-Hsien Wen , Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , David Vandyke , Steve Young

Constraint-based causal discovery is brittle in finite-sample regimes because erroneous conditional-independence (CI) decisions can cascade into substantial structural errors. We propose Quantitative Argumentation for Causal Discovery…

Artificial Intelligence · Computer Science 2026-04-28 Sheng Wei , Yulin Chen , Beishui Liao

Over the last two decades, many exciting variable selection methods have been developed for finding a small group of covariates that are associated with the response from a large pool. Can the discoveries from these data mining approaches…

Statistics Theory · Mathematics 2017-07-24 Jianqing Fan , Qi-Man Shao , Wen-Xin Zhou

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…