English
Related papers

Related papers: Attention-Based Convolutional Neural Network for M…

200 papers

Current end-to-end machine reading and question answering (Q\&A) models are primarily based on recurrent neural networks (RNNs) with attention. Despite their success, these models are often slow for both training and inference due to the…

Computation and Language · Computer Science 2018-04-26 Adams Wei Yu , David Dohan , Minh-Thang Luong , Rui Zhao , Kai Chen , Mohammad Norouzi , Quoc V. Le

Machine Comprehension (MC) is one of the core problems in natural language processing, requiring both understanding of the natural language and knowledge about the world. Rapid progress has been made since the release of several benchmark…

Computation and Language · Computer Science 2019-08-07 Boyuan Pan , Yazheng Yang , Hao Li , Zhou Zhao , Yueting Zhuang , Deng Cai , Xiaofei He

Attention mechanisms in sequence to sequence models have shown great ability and wonderful performance in various natural language processing (NLP) tasks, such as sentence embedding, text generation, machine translation, machine reading…

Computation and Language · Computer Science 2018-08-14 Zehao Dou , Zhihua Zhang

Text classification is a fundamental task in natural language processing (NLP). Several recent studies show the success of deep learning on text processing. Convolutional neural network (CNN), as a popular deep learning model, has shown…

Computation and Language · Computer Science 2023-01-30 Ali Jarrahi , Ramin Mousa , Leila Safari

Conversational question answering (CQA) is a novel QA task that requires understanding of dialogue context. Different from traditional single-turn machine reading comprehension (MRC) tasks, CQA includes passage comprehension, coreference…

Computation and Language · Computer Science 2019-01-04 Chenguang Zhu , Michael Zeng , Xuedong Huang

We study automatic question generation for sentences from text passages in reading comprehension. We introduce an attention-based sequence learning model for the task and investigate the effect of encoding sentence- vs. paragraph-level…

Computation and Language · Computer Science 2017-05-02 Xinya Du , Junru Shao , Claire Cardie

Comprehending meaning from natural language is a primary objective of Natural Language Processing (NLP), and text comprehension is the cornerstone for achieving this objective upon which all other problems like chat bots, language…

Computation and Language · Computer Science 2018-03-06 Long-Huei Chen , Kshitiz Tripathi

Conversational Machine Comprehension (CMC), a research track in conversational AI, expects the machine to understand an open-domain natural language text and thereafter engage in a multi-turn conversation to answer questions related to the…

Computation and Language · Computer Science 2021-02-09 Somil Gupta , Bhanu Pratap Singh Rawat , Hong Yu

This paper explores the use of Deep Learning methods for automatic estimation of quality of human translations. Automatic estimation can provide useful feedback for translation teaching, examination and quality control. Conventional methods…

Computation and Language · Computer Science 2020-03-16 Yu Yuan , Serge Sharoff

Attention Branch Networks (ABNs) have been shown to simultaneously provide visual explanation and improve the performance of deep convolutional neural networks (CNNs). In this work, we introduce Multi-Scale Attention Branch Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Ankit Gupta , Ida-Maria Sintorn

Existing analysis work in machine reading comprehension (MRC) is largely concerned with evaluating the capabilities of systems. However, the capabilities of datasets are not assessed for benchmarking language understanding precisely. We…

Computation and Language · Computer Science 2019-11-22 Saku Sugawara , Pontus Stenetorp , Kentaro Inui , Akiko Aizawa

Machine comprehension(MC) style question answering is a representative problem in natural language processing. Previous methods rarely spend time on the improvement of encoding layer, especially the embedding of syntactic information and…

Artificial Intelligence · Computer Science 2017-07-31 Boyuan Pan , Hao Li , Zhou Zhao , Bin Cao , Deng Cai , Xiaofei He

With the rapid growth of knowledge bases (KBs), question answering over knowledge base, a.k.a. KBQA has drawn huge attention in recent years. Most of the existing KBQA methods follow so called encoder-compare framework. They map the…

Computation and Language · Computer Science 2018-05-29 Yingqi Qu , Jie Liu , Liangyi Kang , Qinfeng Shi , Dan Ye

Recently, end-to-end memory networks have shown promising results on Question Answering task, which encode the past facts into an explicit memory and perform reasoning ability by making multiple computational steps on the memory. However,…

Information Retrieval · Computer Science 2016-09-29 Jiaming Xu , Jing Shi , Yiqun Yao , Suncong Zheng , Bo Xu , Bo Xu

MAC Net is a compositional attention network designed for Visual Question Answering. We propose a modified MAC net architecture for Natural Language Question Answering. Question Answering typically requires Language Understanding and…

Machine Learning · Computer Science 2018-10-31 Muru Selvakumar , Suriyadeepan Ramamoorthy , Vaidheeswaran Archana , Malaikannan Sankarasubbu

The Hierarchical Attention Network (HAN) has made great strides, but it suffers a major limitation: at level 1, each sentence is encoded in complete isolation. In this work, we propose and compare several modifications of HAN in which the…

Computation and Language · Computer Science 2019-08-19 Jean-Baptiste Remy , Antoine Jean-Pierre Tixier , Michalis Vazirgiannis

Machine reading comprehension (MRC), which requires a machine to answer questions based on a given context, has attracted increasing attention with the incorporation of various deep-learning techniques over the past few years. Although…

Computation and Language · Computer Science 2019-11-06 Shanshan Liu , Xin Zhang , Sheng Zhang , Hui Wang , Weiming Zhang

Natural Questions is a new challenging machine reading comprehension benchmark with two-grained answers, which are a long answer (typically a paragraph) and a short answer (one or more entities inside the long answer). Despite the…

Computation and Language · Computer Science 2020-05-14 Bo Zheng , Haoyang Wen , Yaobo Liang , Nan Duan , Wanxiang Che , Daxin Jiang , Ming Zhou , Ting Liu

Audio classification is considered as a challenging problem in pattern recognition. Recently, many algorithms have been proposed using deep neural networks. In this paper, we introduce a new attention-based neural network architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Haoye Lu , Haolong Zhang , Amit Nayak

In recent years, there have been amazing advances in deep learning methods for machine reading. In machine reading, the machine reader has to extract the answer from the given ground truth paragraph. Recently, the state-of-the-art machine…

Computation and Language · Computer Science 2018-04-13 Phu Mon Htut , Samuel R. Bowman , Kyunghyun Cho