English
Related papers

Related papers: DRCD: a Chinese Machine Reading Comprehension Data…

200 papers

Machine Reading Comprehension (MRC) models tend to take advantage of spurious correlations (also known as dataset bias or annotation artifacts in the research community). Consequently, these models may perform the MRC task without fully…

Computation and Language · Computer Science 2023-09-07 Son Quoc Tran , Matt Kretchmar

Numerical reasoning based machine reading comprehension is a task that involves reading comprehension along with using arithmetic operations such as addition, subtraction, sorting, and counting. The DROP benchmark (Dua et al., 2019) is a…

Computation and Language · Computer Science 2021-09-20 Hadeel Al-Negheimish , Pranava Madhyastha , Alessandra Russo

Multi-hop Machine reading comprehension is a challenging task with aim of answering a question based on disjoint pieces of information across the different passages. The evaluation metrics and datasets are a vital part of multi-hop MRC…

Computation and Language · Computer Science 2022-12-09 Azade Mohammadi , Reza Ramezani , Ahmad Baraani

Existing question answering systems can only predict answers without explicit reasoning processes, which hinder their explainability and make us overestimate their ability of understanding and reasoning over natural language. In this work,…

Computation and Language · Computer Science 2020-04-06 Ran Wang , Kun Tao , Dingjie Song , Zhilong Zhang , Xiao Ma , Xi'ao Su , Xinyu Dai

There has been considerable progress on academic benchmarks for the Reading Comprehension (RC) task with State-of-the-Art models closing the gap with human performance on extractive question answering. Datasets such as SQuAD 2.0 & NQ have…

Computation and Language · Computer Science 2021-02-25 Rishav Chakravarti , Avirup Sil

Recent advancements in large language models (LLMs) have transformed the field of question answering (QA). However, evaluating LLMs in the medical field is challenging due to the lack of standardized and comprehensive datasets. To address…

Computation and Language · Computer Science 2023-10-24 Junling Liu , Peilin Zhou , Yining Hua , Dading Chong , Zhongyu Tian , Andrew Liu , Helin Wang , Chenyu You , Zhenhua Guo , Lei Zhu , Michael Lingzhi Li

Measuring advances in retrieval requires test collections with relevance judgments that can faithfully distinguish systems. This paper presents NeuCLIRTech, an evaluation collection for cross-language retrieval over technical information.…

Information Retrieval · Computer Science 2026-02-06 Dawn Lawrie , James Mayfield , Eugene Yang , Andrew Yates , Sean MacAvaney , Ronak Pradeep , Scott Miller , Paul McNamee , Luca Soldaini

In this paper, we study machine reading comprehension (MRC) on long texts, where a model takes as inputs a lengthy document and a question and then extracts a text span from the document as an answer. State-of-the-art models tend to use a…

Computation and Language · Computer Science 2020-05-20 Hongyu Gong , Yelong Shen , Dian Yu , Jianshu Chen , Dong Yu

Machine Reading Comprehension (MRC) reveals the ability to understand a given text passage and answer questions based on it. Existing research works in MRC rely heavily on large-size models and corpus to improve the performance evaluated by…

Computation and Language · Computer Science 2022-03-08 Xiaoqiang Wang , Bang Liu , Fangli Xu , Bo Long , Siliang Tang , Lingfei Wu

Enhancing the attribution in large language models (LLMs) is a crucial task. One feasible approach is to enable LLMs to cite external sources that support their generations. However, existing datasets and evaluation methods in this domain…

Computation and Language · Computer Science 2024-05-30 Haolin Deng , Chang Wang , Xin Li , Dezhang Yuan , Junlang Zhan , Tianhua Zhou , Jin Ma , Jun Gao , Ruifeng Xu

Disfluency correction (DC) is the process of removing disfluent elements like fillers, repetitions and corrections from spoken utterances to create readable and interpretable text. DC is a vital post-processing step applied to Automatic…

Computation and Language · Computer Science 2023-10-26 Vineet Bhat , Preethi Jyothi , Pushpak Bhattacharyya

This paper presents BiPaR, a bilingual parallel novel-style machine reading comprehension (MRC) dataset, developed to support multilingual and cross-lingual reading comprehension. The biggest difference between BiPaR and existing reading…

Computation and Language · Computer Science 2019-10-14 Yimin Jing , Deyi Xiong , Yan Zhen

Interactive machine reading comprehension (iMRC) is machine comprehension tasks where knowledge sources are partially observable. An agent must interact with an environment sequentially to gather necessary knowledge in order to answer a…

Computation and Language · Computer Science 2021-09-02 Xingdi Yuan

We introduce Chinese Text in the Wild, a very large dataset of Chinese text in street view images. While optical character recognition (OCR) in document images is well studied and many commercial tools are available, detection and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Tai-Ling Yuan , Zhe Zhu , Kun Xu , Cheng-Jun Li , Shi-Min Hu

We present QuAC, a dataset for Question Answering in Context that contains 14K information-seeking QA dialogs (100K questions in total). The dialogs involve two crowd workers: (1) a student who poses a sequence of freeform questions to…

Computation and Language · Computer Science 2018-08-29 Eunsol Choi , He He , Mohit Iyyer , Mark Yatskar , Wen-tau Yih , Yejin Choi , Percy Liang , Luke Zettlemoyer

We present WikiReading, a large-scale natural language understanding task and publicly-available dataset with 18 million instances. The task is to predict textual values from the structured knowledge base Wikidata by reading the text of the…

Computation and Language · Computer Science 2017-03-17 Daniel Hewlett , Alexandre Lacoste , Llion Jones , Illia Polosukhin , Andrew Fandrianto , Jay Han , Matthew Kelcey , David Berthelot

Chinese is the most widely used language in the world. Algorithms that read Chinese text in natural images facilitate applications of various kinds. Despite the large potential value, datasets and competitions in the past primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Baoguang Shi , Cong Yao , Minghui Liao , Mingkun Yang , Pei Xu , Linyan Cui , Serge Belongie , Shijian Lu , Xiang Bai

We develop a technique for transfer learning in machine comprehension (MC) using a novel two-stage synthesis network (SynNet). Given a high-performing MC model in one domain, our technique aims to answer questions about documents in another…

Computation and Language · Computer Science 2017-09-26 David Golub , Po-Sen Huang , Xiaodong He , Li Deng

This technical report describes the development of WangchanLion, an instruction fine-tuned model focusing on Machine Reading Comprehension (MRC) in the Thai language. Our model is based on SEA-LION and a collection of instruction following…

Machine Reading Comprehension (MRC) with multiple-choice questions requires the machine to read given passage and select the correct answer among several candidates. In this paper, we propose a novel approach called Convolutional Spatial…

Computation and Language · Computer Science 2019-11-05 Zhipeng Chen , Yiming Cui , Wentao Ma , Shijin Wang , Guoping Hu