English
Related papers

Related papers: XCMRC: Evaluating Cross-lingual Machine Reading Co…

200 papers

Cross-lingual cross-modal retrieval (CCR) aims to retrieve visually relevant content based on non-English queries, without relying on human-labeled cross-modal data pairs during training. One popular approach involves utilizing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yabing Wang , Le Wang , Qiang Zhou , Zhibin Wang , Hao Li , Gang Hua , Wei Tang

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao

Natural language understanding (NLU) is the task of semantic decoding of human languages by machines. NLU models rely heavily on large training data to ensure good performance. However, substantial languages and domains have very few data…

Computation and Language · Computer Science 2022-08-22 Zihan Liu

Extractive Reading Comprehension (ERC) has made tremendous advances enabled by the availability of large-scale high-quality ERC training data. Despite of such rapid progress and widespread application, the datasets in languages other than…

Computation and Language · Computer Science 2021-09-29 Gaochen Wu , Bin Xu , Yuxin Qin , Fei Kong , Bangchang Liu , Hongwen Zhao , Dejie Chang

Machine Reading Comprehension (MRC) for question answering (QA), which aims to answer a question given the relevant context passages, is an important way to test the ability of intelligence systems to understand human language.…

Computation and Language · Computer Science 2019-11-20 Di Jin , Shuyang Gao , Jiun-Yu Kao , Tagyoung Chung , Dilek Hakkani-tur

Scientific machine reading comprehension (SMRC) aims to understand scientific texts through interactions with humans by given questions. As far as we know, there is only one dataset focused on exploring full-text scientific machine reading…

Computation and Language · Computer Science 2023-06-27 Xiao Zhang , Heqi Zheng , Yuxiang Nie , Heyan Huang , Xian-Ling Mao

To provide a survey on the existing tasks and models in Machine Reading Comprehension (MRC), this report reviews: 1) the dataset collection and performance evaluation of some representative simple-reasoning and complex-reasoning MRC tasks;…

Computation and Language · Computer Science 2020-01-24 Chao Wang

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks but are constrained by their small context window sizes. Various efforts have been proposed to expand the context window to accommodate even up to…

Computation and Language · Computer Science 2024-04-09 Xuanfan Ni , Hengyi Cai , Xiaochi Wei , Shuaiqiang Wang , Dawei Yin , Piji Li

We present Native Chinese Reader (NCR), a new machine reading comprehension (MRC) dataset with particularly long articles in both modern and classical Chinese. NCR is collected from the exam questions for the Chinese course in China's high…

Computation and Language · Computer Science 2021-12-15 Shusheng Xu , Yichen Liu , Xiaoyu Yi , Siyuan Zhou , Huizi Li , Yi Wu

We propose the shared task of cross-lingual conversation summarization, \emph{ConvSumX Challenge}, opening new avenues for researchers to investigate solutions that integrate conversation summarization and machine translation. This task can…

Computation and Language · Computer Science 2022-05-04 Yulong Chen , Ming Zhong , Xuefeng Bai , Naihao Deng , Jing Li , Xianchao Zhu , Yue Zhang

Commonsense reasoning (CR) has been studied in many pieces of domain and has achieved great progress with the aid of large datasets. Unfortunately, most existing CR datasets are built in English, so most previous work focus on English.…

Computation and Language · Computer Science 2025-03-11 Jie He , Yu Fu

Reading strategies have been shown to improve comprehension levels, especially for readers lacking adequate prior knowledge. Just as the process of knowledge accumulation is time-consuming for human readers, it is resource-demanding to…

Computation and Language · Computer Science 2019-03-26 Kai Sun , Dian Yu , Dong Yu , Claire Cardie

The conversational machine reading comprehension (CMRC) task aims to answer questions in conversations, which has been a hot research topic in recent years because of its wide applications. However, existing CMRC benchmarks in which each…

Computation and Language · Computer Science 2023-10-16 Nuo Chen , Hongguang Li , Junqing He , Yinan Bao , Xinshi Lin , Qi Yang , Jianfeng Liu , Ruyi Gan , Jiaxing Zhang , Baoyuan Wang , Jia Li

We present an accurate and interpretable method for answer extraction in machine reading comprehension that is reminiscent of case-based reasoning (CBR) from classical AI. Our method (CBR-MRC) builds upon the hypothesis that contextualized…

Computation and Language · Computer Science 2025-11-27 Dung Thai , Dhruv Agarwal , Mudit Chaudhary , Wenlong Zhao , Rajarshi Das , Manzil Zaheer , Jay-Yoon Lee , Hannaneh Hajishirzi , Andrew McCallum

Multi-choice Machine Reading Comprehension (MRC) requires model to decide the correct answer from a set of answer options when given a passage and a question. Thus in addition to a powerful Pre-trained Language Model (PrLM) as encoder,…

Computation and Language · Computer Science 2022-01-17 Pengfei Zhu , Hai Zhao , Xiaoguang Li

Multi-choice Machine Reading Comprehension (MMRC) aims to select the correct answer from a set of options based on a given passage and question. The existing methods employ the pre-trained language model as the encoder, share and transfer…

Computation and Language · Computer Science 2024-04-30 Chenhao Cui , Yufan Jiang , Shuangzhi Wu , Zhoujun Li

Understanding unstructured text is a major goal within natural language processing. Comprehension tests pose questions based on short text passages to evaluate such understanding. In this work, we investigate machine comprehension on the…

Computation and Language · Computer Science 2016-03-30 Adam Trischler , Zheng Ye , Xingdi Yuan , Jing He , Phillip Bachman , Kaheer Suleman

Recognizing semantically similar sentences or paragraphs across languages is beneficial for many tasks, ranging from cross-lingual information retrieval and plagiarism detection to machine translation. Recently proposed methods for…

Computation and Language · Computer Science 2018-01-22 Goran Glavaš , Marc Franco-Salvador , Simone Paolo Ponzetto , Paolo Rosso

Multi-modal large language models(MLLMs) have achieved remarkable progress and demonstrated powerful knowledge comprehension and reasoning abilities. However, the mastery of domain-specific knowledge, which is essential for evaluating the…

Computation and Language · Computer Science 2024-05-09 Zheqi He , Xinya Wu , Pengfei Zhou , Richeng Xuan , Guang Liu , Xi Yang , Qiannan Zhu , Hua Huang

As the capabilities of large multimodal models (LMMs) continue to advance, evaluating the performance of LMMs emerges as an increasing need. Additionally, there is an even larger gap in evaluating the advanced knowledge and reasoning…