English
Related papers

Related papers: Hierarchical Recurrent Attention Network for Respo…

200 papers

Hierarchical multi-label text classification (HMTC) has been gaining popularity in recent years thanks to its applicability to a plethora of real-world applications. The existing HMTC algorithms largely focus on the design of classifiers,…

Computation and Language · Computer Science 2021-04-13 Xinyi Zhang , Jiahao Xu , Charlie Soh , Lihui Chen

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

Sound · Computer Science 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

We propose a multi-explanation graph attention network (MEGAN). Unlike existing graph explainability methods, our network can produce node and edge attributional explanations along multiple channels, the number of which is independent of…

Machine Learning · Computer Science 2024-02-20 Jonas Teufel , Luca Torresi , Patrick Reiser , Pascal Friederich

This paper presents a novel latent variable recurrent neural network architecture for jointly modeling sequences of words and (possibly latent) discourse relations between adjacent sentences. A recurrent neural network generates individual…

Computation and Language · Computer Science 2016-04-06 Yangfeng Ji , Gholamreza Haffari , Jacob Eisenstein

Increased adaptability of RNN language models leads to improved predictions that benefit many applications. However, current methods do not take full advantage of the RNN structure. We show that the most widely-used approach to adaptation…

Computation and Language · Computer Science 2017-04-24 Aaron Jaech , Mari Ostendorf

We introduce the Attentive Unsupervised Text (W)riter (AUTR), which is a word level generative model for natural language. It uses a recurrent neural network with a dynamic attention and canvas memory mechanism to iteratively construct…

Computation and Language · Computer Science 2018-06-15 Harshil Shah , Bowen Zheng , David Barber

The dominant approaches for named entity recognition (NER) mostly adopt complex recurrent neural networks (RNN), e.g., long-short-term-memory (LSTM). However, RNNs are limited by their recurrent nature in terms of computational efficiency.…

Computation and Language · Computer Science 2019-07-22 Hui Chen , Zijia Lin , Guiguang Ding , Jianguang Lou , Yusen Zhang , Borje Karlsson

Existing multi-turn context-response matching methods mainly concentrate on obtaining multi-level and multi-dimension representations and better interactions between context utterances and response. However, in real-place conversation…

Computation and Language · Computer Science 2021-03-18 Juntao Li , Chang Liu , Chongyang Tao , Zhangming Chan , Dongyan Zhao , Min Zhang , Rui Yan

We present an approach that exploits hierarchical Recurrent Neural Networks (RNNs) to tackle the video captioning problem, i.e., generating one or multiple sentences to describe a realistic video. Our hierarchical framework contains a…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Haonan Yu , Jiang Wang , Zhiheng Huang , Yi Yang , Wei Xu

Document classification is a challenging task with important applications. The deep learning approaches to the problem have gained much attention recently. Despite the progress, the proposed models do not incorporate the knowledge of the…

Computation and Language · Computer Science 2019-10-15 Jader Abreu , Luis Fred , David Macêdo , Cleber Zanchettin

Transformers can under some circumstances generalize to novel problem instances whose constituent parts might have been encountered during training, but whose compositions have not. What mechanisms underlie this ability for compositional…

Machine Learning · Computer Science 2025-02-18 Simon Schug , Seijin Kobayashi , Yassir Akram , João Sacramento , Razvan Pascanu

A chatbot that converses like a human should be goal-oriented (i.e., be purposeful in conversation), which is beyond language generation. However, existing dialogue systems often heavily rely on cumbersome hand-crafted rules or costly…

Computation and Language · Computer Science 2020-05-27 Jianfeng Liu , Feiyang Pan , Ling Luo

Large language models have limited context capacity, hindering reasoning over long conversations. We propose the Hierarchical Aggregate Tree memory structure to recursively aggregate relevant dialogue context through conditional tree…

Computation and Language · Computer Science 2024-06-11 Aadharsh Aadhithya A , Sachin Kumar S , Soman K. P

Hierarchical attention networks have recently achieved remarkable performance for document classification in a given language. However, when multilingual document collections are considered, training such models separately for each language…

Computation and Language · Computer Science 2017-09-18 Nikolaos Pappas , Andrei Popescu-Belis

In multi-turn dialogue generation, response is usually related with only a few contexts. Therefore, an ideal model should be able to detect these relevant contexts and produce a suitable response accordingly. However, the widely used…

Computation and Language · Computer Science 2019-07-12 Hainan Zhang , Yanyan Lan , Liang Pang , Jiafeng Guo , Xueqi Cheng

Recent years, the approaches based on neural networks have shown remarkable potential for sentence modeling. There are two main neural network structures: recurrent neural network (RNN) and convolution neural network (CNN). RNN can capture…

Computation and Language · Computer Science 2020-06-30 Zhenyu Liu , Haiwei Huang , Chaohong Lu , Shengfei Lyu

Conversation generation as a challenging task in Natural Language Generation (NLG) has been increasingly attracting attention over the last years. A number of recent works adopted sequence-to-sequence structures along with external…

Computation and Language · Computer Science 2021-08-23 Changzhen Ji , Yating Zhang , Xiaozhong Liu , Adam Jatowt , Changlong Sun , Conghui Zhu , Tiejun Zhao

Speaker change detection (SCD) is an important task in dialog modeling. Our paper addresses the problem of text-based SCD, which differs from existing audio-based studies and is useful in various scenarios, for example, processing dialog…

Computation and Language · Computer Science 2018-10-01 Zhao Meng , Lili Mou , Zhi Jin

Transformers have demonstrated remarkable performance in natural language processing and related domains, as they largely focus on sequential, autoregressive next-token prediction tasks. Yet, they struggle in logical reasoning, not…

Artificial Intelligence · Computer Science 2025-10-08 Renee Ge , Qianli Liao , Tomaso Poggio

Inducing a meaningful structural representation from one or a set of dialogues is a crucial but challenging task in computational linguistics. Advancement made in this area is critical for dialogue system design and discourse analysis. It…

Computation and Language · Computer Science 2021-03-15 Liang Qiu , Yizhou Zhao , Weiyan Shi , Yuan Liang , Feng Shi , Tao Yuan , Zhou Yu , Song-Chun Zhu