中文
相关论文

相关论文: Evaluating the Robustness of Machine Reading Compr…

200 篇论文

Reading comprehension systems for low-resource languages face significant challenges in handling unanswerable questions. These systems tend to produce unreliable responses when correct answers are absent from context. To solve this problem,…

计算与语言 · 计算机科学 2026-03-06 Abrar Eyasir , Tahsin Ahmed , Muhammad Ibrahim

For several purposes in Natural Language Processing (NLP), such as Information Extraction, Sentiment Analysis or Chatbot, Named Entity Recognition (NER) holds an important role as it helps to determine and categorize entities in text into…

计算与语言 · 计算机科学 2020-03-24 Thong Nguyen , Duy Nguyen , Pramod Rao

Knowledge in the real world is being updated constantly. However, it is costly to frequently update large language models (LLMs). Therefore, it is crucial for LLMs to understand the concept of temporal knowledge. However, prior works on…

计算与语言 · 计算机科学 2024-07-15 Qingyu Tan , Hwee Tou Ng , Lidong Bing

We propose a lightly-supervised approach for information extraction, in particular named entity classification, which combines the benefits of traditional bootstrapping, i.e., use of limited annotations and interpretability of extraction…

计算与语言 · 计算机科学 2018-05-30 Marco A. Valenzuela-Escárcega , Ajay Nagesh , Mihai Surdeanu

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

机器学习 · 计算机科学 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

In recent years, Large Language Models (LLMs) have demonstrated an impressive ability to encode knowledge during pre-training on large text corpora. They can leverage this knowledge for downstream tasks like question answering (QA), even in…

计算与语言 · 计算机科学 2024-06-11 Juraj Vladika , Phillip Schneider , Florian Matthes

In this paper, we have shown a method of improving the quality of neural machine translation by translating/transliterating name entities as a preprocessing step. Through experiments we have shown the performance gain of our system. For…

计算与语言 · 计算机科学 2023-05-15 Radhika Sharma , Pragya Katyayan , Nisheeth Joshi

Entity Matching is the task of deciding if two entity descriptions refer to the same real-world entity. State-of-the-art entity matching methods often rely on fine-tuning Transformer models such as BERT or RoBERTa. Two major drawbacks of…

计算与语言 · 计算机科学 2023-06-23 Ralph Peeters , Christian Bizer

In this paper, we study machine reading comprehension (MRC) on long texts, where a model takes as inputs a lengthy document and a question and then extracts a text span from the document as an answer. State-of-the-art models tend to use a…

计算与语言 · 计算机科学 2020-05-20 Hongyu Gong , Yelong Shen , Dian Yu , Jianshu Chen , Dong Yu

Table Question Answering (TQA) aims at composing an answer to a question based on tabular data. While prior research has shown that TQA models lack robustness, understanding the underlying cause and nature of this issue remains…

计算与语言 · 计算机科学 2024-04-30 Wei Zhou , Mohsen Mesgar , Heike Adel , Annemarie Friedrich

Recent studies report that many machine reading comprehension (MRC) models can perform closely to or even better than humans on benchmark datasets. However, existing works indicate that many MRC models may learn shortcuts to outwit these…

计算与语言 · 计算机科学 2021-06-03 Yuxuan Lai , Chen Zhang , Yansong Feng , Quzhe Huang , Dongyan Zhao

Revealing the robustness issues of natural language processing models and improving their robustness is important to their performance under difficult situations. In this paper, we study the robustness of paraphrase identification models…

计算与语言 · 计算机科学 2020-10-06 Zhouxing Shi , Minlie Huang

Large Language Models (LLMs), already shown to ace various unstructured text comprehension tasks, have also remarkably been shown to tackle table (structured) comprehension tasks without specific training. Building on earlier studies of…

计算与语言 · 计算机科学 2025-08-27 Kushal Raj Bhandari , Sixue Xing , Soham Dan , Jianxi Gao

Transformer-based embedding models suffer from quadratic computational and linear memory complexity, limiting their utility for long sequences. We propose recurrent architectures as an efficient alternative, introducing a vertically chunked…

计算与语言 · 计算机科学 2026-04-21 Tobias Grantner , Emanuel Sallinger , Martin Flechl

There are several issues with the existing general machine translation or natural language generation evaluation metrics, and question-answering (QA) systems are indifferent in that context. To build robust QA systems, we need the ability…

计算与语言 · 计算机科学 2022-07-06 Farida Mustafazade , Peter F. Ebbinghaus

Evaluation of QA systems is very challenging and expensive, with the most reliable approach being human annotations of correctness of answers for questions. Recent works (AVA, BEM) have shown that transformer LM encoder based similarity…

计算与语言 · 计算机科学 2023-09-22 Matteo Gabburo , Siddhant Garg , Rik Koncel Kedziorski , Alessandro Moschitti

QA models based on pretrained language mod-els have achieved remarkable performance on various benchmark datasets.However, QA models do not generalize well to unseen data that falls outside the training distribution, due to distributional…

计算与语言 · 计算机科学 2021-06-25 Seanie Lee , Minki Kang , Juho Lee , Sung Ju Hwang

Entity linking is the task of aligning mentions to corresponding entities in a given knowledge base. Previous studies have highlighted the necessity for entity linking systems to capture the global coherence. However, there are two common…

计算与语言 · 计算机科学 2019-02-04 Zheng Fang , Yanan Cao , Dongjie Zhang , Qian Li , Zhenyu Zhang , Yanbing Liu

Entity Linking has two main open areas of research: 1) generate candidate entities without using alias tables and 2) generate more contextual representations for both mentions and entities. Recently, a solution has been proposed for the…

计算与语言 · 计算机科学 2020-04-08 Oshin Agarwal , Daniel M. Bikel

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a sentence-image pair. Existing methods either (1) obtain named…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Meihuizi Jia , Lei Shen , Xin Shen , Lejian Liao , Meng Chen , Xiaodong He , Zhendong Chen , Jiaqi Li