中文
相关论文

相关论文: Evaluating the Robustness of Machine Reading Compr…

200 篇论文

We focus on Multimodal Machine Reading Comprehension (M3C) where a model is expected to answer questions based on given passage (or context), and the context and the questions can be in different modalities. Previous works such as RecipeQA…

计算机视觉与模式识别 · 计算机科学 2021-10-25 Pritish Sahu , Karan Sikka , Ajay Divakaran

Machine reading comprehension (MRC) is a crucial task in natural language processing and has achieved remarkable advancements. However, most of the neural MRC models are still far from robust and fail to generalize well in real-world…

计算与语言 · 计算机科学 2021-07-22 Hongxuan Tang , Hongyu Li , Jing Liu , Yu Hong , Hua Wu , Haifeng Wang

Named Entity Recognition systems achieve remarkable performance on domains such as English news. It is natural to ask: What are these models actually learning to achieve this? Are they merely memorizing the names themselves? Or are they…

计算与语言 · 计算机科学 2021-01-05 Oshin Agarwal , Yinfei Yang , Byron C. Wallace , Ani Nenkova

While large language models (LMs) demonstrate remarkable performance, they encounter challenges in providing accurate responses when queried for information beyond their pre-trained memorization. Although augmenting them with relevant…

计算与语言 · 计算机科学 2024-03-29 Seiji Maekawa , Hayate Iso , Sairam Gurajada , Nikita Bhutani

This paper proposes a novel training method to improve the robustness of Extractive Question Answering (EQA) models. Previous research has shown that existing models, when trained on EQA datasets that include unanswerable questions,…

计算与语言 · 计算机科学 2024-10-01 Son Quoc Tran , Matt Kretchmar

Named-entity recognition (NER) detects texts with predefined semantic labels and is an essential building block for natural language processing (NLP). Notably, recent NER research focuses on utilizing massive extra data, including…

计算与语言 · 计算机科学 2023-05-09 Yuxiang Zhang , Junjie Wang , Xinyu Zhu , Tetsuya Sakai , Hayato Yamana

The task of named entity recognition (NER) is normally divided into nested NER and flat NER depending on whether named entities are nested or not. Models are usually separately developed for the two tasks, since sequence labeling models,…

计算与语言 · 计算机科学 2022-11-23 Xiaoya Li , Jingrong Feng , Yuxian Meng , Qinghong Han , Fei Wu , Jiwei Li

Recent models have achieved human level performance on the Stanford Question Answering Dataset when using F1 scores to evaluate the reading comprehension task. Yet, teaching machines to comprehend text has not been solved in the general…

计算与语言 · 计算机科学 2024-01-19 Ariel Marcus

Current state-of-the-art reading comprehension models rely heavily on recurrent neural networks. We explored an entirely different approach to question answering: a convolutional model. By their nature, these convolutional models are fast…

计算与语言 · 计算机科学 2018-10-23 Tobin Bell , Benjamin Penchas

Innovations in annotation methodology have been a catalyst for Reading Comprehension (RC) datasets and models. One recent trend to challenge current RC models is to involve a model in the annotation process: humans create questions…

计算与语言 · 计算机科学 2020-11-18 Max Bartolo , Alastair Roberts , Johannes Welbl , Sebastian Riedel , Pontus Stenetorp

Web question answering (QA) has become an indispensable component in modern search systems, which can significantly improve users' search experience by providing a direct answer to users' information need. This could be achieved by applying…

信息检索 · 计算机科学 2019-07-12 Lixin Su , Jiafeng Guo , Yixing Fan , Yanyan Lan , Xueqi Cheng

Question answering (QA) can only make progress if we know if an answer is correct, but current answer correctness (AC) metrics struggle with verbose, free-form answers from large language models (LLMs). There are two challenges with current…

计算与语言 · 计算机科学 2024-10-15 Zongxia Li , Ishani Mondal , Yijun Liang , Huy Nghiem , Jordan Lee Boyd-Graber

Textual Question Answering (QA) aims to provide precise answers to user's questions in natural language using unstructured data. One of the most popular approaches to this goal is machine reading comprehension(MRC). In recent years, many…

计算与语言 · 计算机科学 2022-02-07 Yang Bai , Daisy Zhe Wang

Entity linking (EL) for the rapidly growing short text (e.g. search queries and news titles) is critical to industrial applications. Most existing approaches relying on adequate context for long text EL are not effective for the concise and…

计算与语言 · 计算机科学 2021-01-08 Yingjie Gu , Xiaoye Qu , Zhefeng Wang , Baoxing Huai , Nicholas Jing Yuan , Xiaolin Gui

We present a large-scale dataset, ReCoRD, for machine reading comprehension requiring commonsense reasoning. Experiments on this dataset demonstrate that the performance of state-of-the-art MRC systems fall far behind human performance.…

计算与语言 · 计算机科学 2018-10-31 Sheng Zhang , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Kevin Duh , Benjamin Van Durme

This paper introduces a novel neural network model for question answering, the \emph{entity-based memory network}. It enhances neural networks' ability of representing and calculating information over a long period by keeping records of…

计算与语言 · 计算机科学 2024-02-23 Xun Wang , Katsuhito Sudoh , Masaaki Nagata , Tomohide Shibata , Daisuke Kawahara , Sadao Kurohashi

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Advances in NLP have yielded impressive results for the task of machine reading comprehension (MRC), with approaches having been reported to achieve performance comparable to that of humans. In this paper, we investigate whether…

计算与语言 · 计算机科学 2021-06-16 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

Although modern named entity recognition (NER) systems show impressive performance on standard datasets, they perform poorly when presented with noisy data. In particular, capitalization is a strong signal for entities in many languages,…

计算与语言 · 计算机科学 2019-12-17 Stephen Mayhew , Nitish Gupta , Dan Roth

For languages with no annotated resources, transferring knowledge from rich-resource languages is an effective solution for named entity recognition (NER). While all existing methods directly transfer from source-learned model to a target…

计算与语言 · 计算机科学 2020-07-16 Qianhui Wu , Zijia Lin , Guoxin Wang , Hui Chen , Börje F. Karlsson , Biqing Huang , Chin-Yew Lin