English
Related papers

Related papers: Why Do Neural Response Generation Models Prefer Un…

200 papers

In our dynamic world where data arrives in a continuous stream, continual learning enables us to incrementally add new tasks/domains without the need to retrain from scratch. A major challenge in continual learning of language model is…

Computation and Language · Computer Science 2024-03-19 Zihan Wang , Jiayu Xiao , Mengxiang Li , Zhongjiang He , Yongxiang Li , Chao Wang , Shuangyong Song

We consider problems of making sequences of decisions to accomplish tasks, interacting via the medium of language. These problems are often tackled with reinforcement learning approaches. We find that these models do not generalize well…

Computation and Language · Computer Science 2020-10-07 Xusen Yin , Ralph Weischedel , Jonathan May

Using neural networks to generate replies in human-computer dialogue systems is attracting increasing attention over the past few years. However, the performance is not satisfactory: the neural network tends to generate safe, universally…

Computation and Language · Computer Science 2016-10-14 Lili Mou , Yiping Song , Rui Yan , Ge Li , Lu Zhang , Zhi Jin

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual…

Computation and Language · Computer Science 2015-06-23 Alessandro Sordoni , Michel Galley , Michael Auli , Chris Brockett , Yangfeng Ji , Margaret Mitchell , Jian-Yun Nie , Jianfeng Gao , Bill Dolan

The well-known generalization problem hinders the application of artificial neural networks in continuous-time prediction tasks with varying latent dynamics. In sharp contrast, biological systems can neatly adapt to evolving environments…

Machine Learning · Computer Science 2025-03-10 Jindou Jia , Zihan Yang , Meng Wang , Kexin Guo , Jianfei Yang , Xiang Yu , Lei Guo

Interpretable Machine Learning faces a recurring challenge of explaining the predictions made by opaque classifiers such as ensemble models, kernel methods, or neural networks in terms that are understandable to humans. When the model is…

Machine Learning · Computer Science 2024-11-14 Frederic Koriche , Jean-Marie Lagniez , Stefan Mengel , Chi Tran

We present a comparison of word-based and character-based sequence-to-sequence models for data-to-text natural language generation, which generate natural language descriptions for structured inputs. On the datasets of two recent generation…

Computation and Language · Computer Science 2018-10-12 Glorianna Jagfeld , Sabrina Jenne , Ngoc Thang Vu

While black-box large language models are widely deployed, they produce generic outputs that overlook individual user preferences. Current personalization methods are fundamentally limited to response-level personalization; they only match…

Computation and Language · Computer Science 2026-03-03 Jieyong Kim , Tongyoung Kim , Soojin Yoon , Jaehyung Kim , Dongha Lee

The advent of black-box deep neural network classification models has sparked the need to explain their decisions. However, in the case of generative AI, such as large language models (LLMs), there is no class prediction to explain. Rather,…

Computation and Language · Computer Science 2025-02-18 Ronny Luss , Erik Miehling , Amit Dhurandhar

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

There is a growing interest in designing autonomous agents that can work alongside humans. Such agents will undoubtedly be expected to explain their behavior and decisions. While generating explanations is an actively researched topic, most…

Artificial Intelligence · Computer Science 2021-06-24 Utkarsh Soni , Sarath Sreedharan , Subbarao Kambhampati

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

In the 1980s a new, extraordinarily productive way of reasoning about algorithms emerged. In this paper, we introduce the term "outcome reasoning" to refer to this form of reasoning. Though outcome reasoning has come to dominate areas of…

Other Statistics · Statistics 2023-02-16 Jordan Rodu , Michael Baiocchi

A class of explainable NLP models for reasoning tasks support their decisions by generating free-form or structured explanations, but what happens when these supporting structures contain errors? Our goal is to allow users to interactively…

Computation and Language · Computer Science 2021-04-20 Aman Madaan , Niket Tandon , Dheeraj Rajagopal , Yiming Yang , Peter Clark , Keisuke Sakaguchi , Ed Hovy

In recent years, neural networks have demonstrated their remarkable ability to discern intricate patterns and relationships from raw data. However, understanding the inner workings of these black box models remains challenging, yet crucial…

Machine Learning · Statistics 2024-04-18 Niklas Koenen , Marvin N. Wright

Neural generative models have become popular and achieved promising performance on short-text conversation tasks. They are generally trained to build a 1-to-1 mapping from the input post to its output response. However, a given post is…

Computation and Language · Computer Science 2019-02-22 Jun Gao , Wei Bi , Xiaojiang Liu , Junhui Li , Shuming Shi

Maximum Mutual information (MMI), which models the bidirectional dependency between responses ($y$) and contexts ($x$), i.e., the forward probability $\log p(y|x)$ and the backward probability $\log p(x|y)$, has been widely used as the…

Computation and Language · Computer Science 2020-02-14 Qinghong Han , Yuxian Meng , Fei Wu , Jiwei Li

We investigate response selection for multi-turn conversation in retrieval-based chatbots. Existing studies pay more attention to the matching between utterances and responses by calculating the matching score based on learned features,…

Computation and Language · Computer Science 2021-01-18 Yongkang Liu , Shi Feng , Daling Wang , Kaisong Song , Feiliang Ren , Yifei Zhang

Recent advancements in cognitive science and multi-round reasoning techniques for Large Language Models (LLMs) suggest that iterative thinking processes improve problem-solving performance in complex tasks. Inspired by this, approaches like…

Artificial Intelligence · Computer Science 2025-03-06 Chenhui Xu , Dancheng Liu , Jiajie Li , Amir Nassereldine , Zhaohui Li , Jinjun Xiong

Humans use commonsense reasoning (CSR) implicitly to produce natural and coherent responses in conversations. Aiming to close the gap between current response generation (RG) models and human communication abilities, we want to understand…

Computation and Language · Computer Science 2021-09-13 Pei Zhou , Pegah Jandaghi , Bill Yuchen Lin , Justin Cho , Jay Pujara , Xiang Ren