English
Related papers

Related papers: Coherent Dialogue with Attention-based Language Mo…

200 papers

Recurrent neural networks (RNNs) are a widely used deep architecture for sequence modeling, generation, and prediction. Despite success in applications such as machine translation and voice recognition, these stateful models have several…

Computation and Language · Computer Science 2020-04-23 Ankur Mali , Alexander Ororbia , Daniel Kifer , Clyde Lee Giles

We propose a novel methodology to address dialog learning in the context of goal-oriented conversational systems. The key idea is to quantize the dialog space into clusters and create a language model across the clusters, thus allowing for…

Computation and Language · Computer Science 2018-12-27 R. Chulaka Gunasekara , David Nahamoo , Lazaros C. Polymenakos , Jatin Ganhotra , Kshitij P. Fadnis

Many natural language processing tasks solely rely on sparse dependencies between a few tokens in a sentence. Soft attention mechanisms show promising performance in modeling local/global dependencies by soft probabilities between every two…

Computation and Language · Computer Science 2018-07-06 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Sen Wang , Chengqi Zhang

Large Language Models demonstrate outstanding performance in many language tasks but still face fundamental challenges in managing the non-linear flow of human conversation. The prevalent approach of treating dialogue history as a flat,…

Computation and Language · Computer Science 2026-04-20 Junan Hu , Shudan Guo , Wenqi Liu , Jianhua Yin , Yinwei Wei

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

Computation and Language · Computer Science 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

Sequence-to-sequence models have been applied to the conversation response generation problem where the source sequence is the conversation history and the target sequence is the response. Unlike translation, conversation responding is…

Computation and Language · Computer Science 2017-08-01 Louis Shao , Stephan Gouws , Denny Britz , Anna Goldie , Brian Strope , Ray Kurzweil

Empathetic response generation aims to comprehend the cognitive and emotional states in dialogue utterances and generate proper responses. Psychological theories posit that comprehending emotional and cognitive states necessitates…

Computation and Language · Computer Science 2024-06-04 Zhou Yang , Zhaochun Ren , Yufeng Wang , Chao Chen , Haizhou Sun , Xiaofei Zhu , Xiangwen Liao

Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some…

Computation and Language · Computer Science 2017-03-24 Youssef Oualil , Clayton Greenberg , Mittul Singh , Dietrich Klakow

Neural processes (NPs) learn stochastic processes and predict the distribution of target output adaptively conditioned on a context set of observed input-output pairs. Furthermore, Attentive Neural Process (ANP) improved the prediction…

Machine Learning · Computer Science 2019-10-22 Shenghao Qin , Jiacheng Zhu , Jimmy Qin , Wenshuo Wang , Ding Zhao

Attention is an increasingly popular mechanism used in a wide range of neural architectures. The mechanism itself has been realized in a variety of formats. However, because of the fast-paced advances in this domain, a systematic overview…

Computation and Language · Computer Science 2021-10-12 Andrea Galassi , Marco Lippi , Paolo Torroni

Nowadays, the current neural network models of dialogue generation(chatbots) show great promise for generating answers for chatty agents. But they are short-sighted in that they predict utterances one at a time while disregarding their…

Computation and Language · Computer Science 2023-01-19 Jabri Ismail , Aboulbichr Ahmed , El ouaazizi Aziza

Current state-of-the-art neural dialogue models learn from human conversations following the data-driven paradigm. As such, a reliable training corpus is the crux of building a robust and well-behaved dialogue model. However, due to the…

Computation and Language · Computer Science 2020-06-12 Hengyi Cai , Hongshen Chen , Yonghao Song , Cheng Zhang , Xiaofang Zhao , Dawei Yin

We have recently shown that deep Long Short-Term Memory (LSTM) recurrent neural networks (RNNs) outperform feed forward deep neural networks (DNNs) as acoustic models for speech recognition. More recently, we have shown that the performance…

Computation and Language · Computer Science 2015-07-27 Haşim Sak , Andrew Senior , Kanishka Rao , Françoise Beaufays

Emotion recognition from speech signal based on deep learning is an active research area. Convolutional neural networks (CNNs) may be the dominant method in this area. In this paper, we implement two neural architectures to address this…

Computation and Language · Computer Science 2020-11-03 Ahmed Ali , Yasser Hifny

Grounding dialogue on external knowledge and interpreting linguistic patterns in dialogue history context, such as ellipsis, anaphora, and co-references is critical for dialogue comprehension and generation. In this paper, we present a…

Computation and Language · Computer Science 2022-05-30 Deeksha Varshney , Akshara Prabhakar , Asif Ekbal

Recurrent Neural Networks (RNN) are known as powerful models for handling sequential data, and especially widely utilized in various natural language processing tasks. In this paper, we propose Contextual Recurrent Units (CRU) for enhancing…

Computation and Language · Computer Science 2019-11-15 Yiming Cui , Wei-Nan Zhang , Wanxiang Che , Ting Liu , Zhipeng Chen , Shijin Wang , Guoping Hu

In real-world dialog systems, the ability to understand the user's emotions and interact anthropomorphically is of great significance. Emotion Recognition in Conversation (ERC) is one of the key ways to accomplish this goal and has…

Computation and Language · Computer Science 2023-11-23 Jiang Li , Xiaoping Wang , Zhigang Zeng

Convolutional neural network (CNN) and recurrent neural network (RNN) models have become the mainstream methods for relation classification. We propose a unified architecture, which exploits the advantages of CNN and RNN simultaneously, to…

Computation and Language · Computer Science 2018-07-31 Bin He , Yi Guan , Rui Dai

To build a satisfying chatbot that has the ability of managing a goal-oriented multi-turn dialogue, accurate modeling of human conversation is crucial. In this paper we concentrate on the task of response selection for multi-turn…

Computation and Language · Computer Science 2018-02-19 Guozhen An , Mehrnoosh Shafiee , Davood Shamsi

Dialogue management (DM) decides the next action of a dialogue system according to the current dialogue state, and thus plays a central role in task-oriented dialogue systems. Since dialogue management requires to have access to not only…

Computation and Language · Computer Science 2018-05-14 Zheng Zhang , Minlie Huang , Zhongzhou Zhao , Feng Ji , Haiqing Chen , Xiaoyan Zhu