English
Related papers

Related papers: Question Difficulty Ranking for Multiple-Choice Re…

200 papers

Multi-choice Machine Reading Comprehension (MRC) is a challenging extension of Natural Language Processing (NLP) that requires the ability to comprehend the semantics and logical relationships between entities in a given text. The MRC task…

Computation and Language · Computer Science 2023-07-19 Ruiqing Sun , Ping Jian

Zero-shot LLMs are now also used for textual classification tasks, e.g., sentiment and bias detection in a sentence or article. However, their performance can be suboptimal in such data annotation tasks. We introduce a novel technique that…

Computation and Language · Computer Science 2025-11-11 Sina Salimian , Gias Uddin , Shaina Raza , Henry Leung

Because it is not feasible to collect training data for every language, there is a growing interest in cross-lingual transfer learning. In this paper, we systematically explore zero-shot cross-lingual transfer learning on reading…

Computation and Language · Computer Science 2019-09-23 Tsung-yuan Hsu , Chi-liang Liu , Hung-yi Lee

Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we question to what extent the…

Computation and Language · Computer Science 2024-02-06 Sara Rajaee , Christof Monz

Massively Multilingual Transformer based Language Models have been observed to be surprisingly effective on zero-shot transfer across languages, though the performance varies from language to language depending on the pivot language(s) used…

Computation and Language · Computer Science 2022-05-13 Kabir Ahuja , Shanu Kumar , Sandipan Dandapat , Monojit Choudhury

Automated question generation is an important approach to enable personalisation of English comprehension assessment. Recently, transformer-based pretrained language models have demonstrated the ability to produce appropriate questions from…

Computation and Language · Computer Science 2022-09-27 Vatsal Raina , Mark Gales

Multi-choice reading comprehension is a challenging task, which involves the matching between a passage and a question-answer pair. This paper proposes a new co-matching approach to this problem, which jointly models whether a passage can…

Computation and Language · Computer Science 2018-06-12 Shuohang Wang , Mo Yu , Shiyu Chang , Jing Jiang

Large language models have shown that impressive zero-shot performance can be achieved through natural language prompts (Radford et al., 2019; Brown et al., 2020; Sanh et al., 2021). Creating an effective prompt, however, requires…

Computation and Language · Computer Science 2022-03-30 Gabriel Orlanski

An effective method for cross-lingual transfer is to fine-tune a bilingual or multilingual model on a supervised dataset in one language and evaluating it on another language in a zero-shot manner. Translating examples at training time or…

Computation and Language · Computer Science 2021-12-15 Guilherme Moraes Rosa , Luiz Henrique Bonifacio , Leandro Rodrigues de Souza , Roberto Lotufo , Rodrigo Nogueira

Despite their success, large pre-trained multilingual models have not completely alleviated the need for labeled data, which is cumbersome to collect for all target languages. Zero-shot cross-lingual transfer is emerging as a practical…

Computation and Language · Computer Science 2021-07-01 Iulia Turc , Kenton Lee , Jacob Eisenstein , Ming-Wei Chang , Kristina Toutanova

This work focuses on comparing different solutions for machine translation on low resource language pairs, namely, with zero-shot transfer learning and unsupervised machine translation. We discuss how the data size affects the performance…

Computation and Language · Computer Science 2021-04-02 Aviral Joshi , Chengzhi Huang , Har Simrat Singh

Text classification of unseen classes is a challenging Natural Language Processing task and is mainly attempted using two different types of approaches. Similarity-based approaches attempt to classify instances based on similarities between…

Computation and Language · Computer Science 2023-07-25 Tim Schopf , Daniel Braun , Florian Matthes

Machine reading comprehension (MRC) is an AI challenge that requires machine to determine the correct answers to questions based on a given passage. MRC systems must not only answer question when necessary but also distinguish when no…

Computation and Language · Computer Science 2020-12-14 Zhuosheng Zhang , Junjie Yang , Hai Zhao

Cross-lingual Machine Reading Comprehension (xMRC) is challenging due to the lack of training data in low-resource languages. The recent approaches use training data only in a resource-rich language like English to fine-tune large-scale…

Machine Learning · Computer Science 2021-12-10 Nuo Chen , Linjun Shou , Min Gong , Jian Pei , Daxin Jiang

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their…

Computation and Language · Computer Science 2019-04-05 Tal Schuster , Ori Ram , Regina Barzilay , Amir Globerson

The claim matching (CM) task can benefit an automated fact-checking pipeline by putting together claims that can be resolved with the same fact-check. In this work, we are the first to explore zero-shot and few-shot learning approaches to…

Computation and Language · Computer Science 2025-03-04 Dina Pisarevskaya , Arkaitz Zubiaga

Understanding unstructured text is a major goal within natural language processing. Comprehension tests pose questions based on short text passages to evaluate such understanding. In this work, we investigate machine comprehension on the…

Computation and Language · Computer Science 2016-03-30 Adam Trischler , Zheng Ye , Xingdi Yuan , Jing He , Phillip Bachman , Kaheer Suleman

Machine reading comprehension (MRC) on real web data usually requires the machine to answer a question by analyzing multiple passages retrieved by search engine. Compared with MRC on a single passage, multi-passage MRC is more challenging,…

Computation and Language · Computer Science 2018-05-11 Yizhong Wang , Kai Liu , Jing Liu , Wei He , Yajuan Lyu , Hua Wu , Sujian Li , Haifeng Wang

Recently it has been shown that without any access to the contextual passage, multiple choice reading comprehension (MCRC) systems are able to answer questions significantly better than random on average. These systems use their accumulated…

Computation and Language · Computer Science 2023-05-31 Adian Liusie , Vatsal Raina , Mark Gales

Multiple-choice tests are a common approach for assessing candidates' comprehension skills. Standard multiple-choice reading comprehension exams require candidates to select the correct answer option from a discrete set based on a question…

Computation and Language · Computer Science 2023-11-09 Vatsal Raina , Adian Liusie , Mark Gales