English
Related papers

Related papers: BERT-based distractor generation for Swedish readi…

200 papers

Multiple-choice reading and listening comprehension tests are an important part of language assessment. Content creators for standard educational tests need to carefully curate questions that assess the comprehension abilities of candidates…

Computation and Language · Computer Science 2023-07-04 Vatsal Raina , Adian Liusie , Mark Gales

In this paper, we propose a novel approach for generating document embeddings using a combination of Sentence-BERT (SBERT) and RoBERTa, two state-of-the-art natural language processing models. Our approach treats sentences as tokens and…

Information Retrieval · Computer Science 2023-08-28 Shashidhar Reddy Javaji , Krutika Sarode

Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT to new tasks mainly focus on modifying the model structure,…

Computation and Language · Computer Science 2020-02-25 Yige Xu , Xipeng Qiu , Ligao Zhou , Xuanjing Huang

Large-scale pre-trained language models such as BERT have contributed significantly to the development of NLP. However, those models require large computational resources, making it difficult to be applied to mobile devices where computing…

Computation and Language · Computer Science 2023-08-02 Weixin Wu , Hankz Hankui Zhuo

BERT is a popular language model whose main pre-training task is to fill in the blank, i.e., predicting a word that was masked out of a sentence, based on the remaining words. In some applications, however, having an additional context can…

Computation and Language · Computer Science 2020-10-30 Timo I. Denk , Ana Peleteiro Ramallo

Educational crosswords offer numerous benefits for students, including increased engagement, improved understanding, critical thinking, and memory retention. Creating high-quality educational crosswords can be challenging, but recent…

Computation and Language · Computer Science 2023-11-28 Kamyar Zeinalipour , Tommaso laquinta , Asya Zanollo , Giovanni Angelini , Leonardo Rigutini , Marco Maggini , Marco Gori

Recent years witnessed an increase in the amount of research on the task of Question Difficulty Estimation from Text QDET with Natural Language Processing (NLP) techniques, with the goal of targeting the limitations of traditional…

Computation and Language · Computer Science 2023-05-18 Luca Benedetto

Large language models having hundreds of millions, and even billions, of parameters have performed extremely well on a variety of natural language processing (NLP) tasks. Their widespread use and adoption, however, is hindered by the lack…

Computation and Language · Computer Science 2022-12-23 Dan DeGenaro , Jugal Kalita

Online shopping stores have grown steadily over the past few years. Due to the massive growth of these businesses, the detection of fake reviews has attracted attention. Fake reviews are seriously trying to mislead customers and thereby…

Computation and Language · Computer Science 2023-01-10 Abrar Qadir Mir , Furqan Yaqub Khan , Mohammad Ahsan Chishti

Large multimodal models (LMMs) have shown remarkable performance in the visual commonsense reasoning (VCR) task, which aims to answer a multiple-choice question based on visual commonsense within an image. However, the ability of LMMs to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiali Chen , Xusen Hei , Yuqi Xue , Yuancheng Wei , Jiayuan Xie , Yi Cai , Qing Li

Current grammatical error correction (GEC) models typically consider the task as sequence generation, which requires large amounts of annotated data and limit the applications in data-limited settings. We try to incorporate contextual…

Computation and Language · Computer Science 2020-01-13 Yiyuan Li , Antonios Anastasopoulos , Alan W Black

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

Computation and Language · Computer Science 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Cross-lingual word sense disambiguation (WSD) tackles the challenge of disambiguating ambiguous words across languages given context. The pre-trained BERT embedding model has been proven to be effective in extracting contextual information…

Computation and Language · Computer Science 2020-12-11 Xingran Zhu

While MCQs are valuable for learning and evaluation, manually creating them with varying difficulty levels and targeted reading skills remains a time-consuming and costly task. Recent advances in generative AI provide an opportunity to…

Computation and Language · Computer Science 2025-06-19 Bernardo Leite , Henrique Lopes Cardoso , Pedro Pinto , Abel Ferreira , Luís Abreu , Isabel Rangel , Sandra Monteiro

Counterfactual explanations can be used to interpret and debug text classifiers by producing minimally altered text inputs that change a classifier's output. In this work, we evaluate five methods for generating counterfactual explanations…

Computation and Language · Computer Science 2024-11-06 Stephen McAleese , Mark Keane

Assessment of reading comprehension through content-based interactions plays an important role in the reading acquisition process. In this paper, we propose a novel approach for generating comprehension questions geared to K-2 English…

Computation and Language · Computer Science 2025-07-31 Xiaocheng Yang , Sumuk Shashidhar , Dilek Hakkani-Tur

We propose a method for joint multichannel speech dereverberation with two spatial-aware tasks: direction-of-arrival (DOA) estimation and speech separation. The proposed method addresses involved tasks as a sequence to sequence mapping…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Yang Jiao

We propose a multilingual data-driven method for generating reading comprehension questions using dependency trees. Our method provides a strong, mostly deterministic, and inexpensive-to-train baseline for less-resourced languages. While a…

Computation and Language · Computer Science 2023-05-16 Dmytro Kalpakchi , Johan Boye

Contrastive learning has shown great potential in unsupervised sentence embedding tasks, e.g., SimCSE. However, We find that these existing solutions are heavily affected by superficial features like the length of sentences or syntactic…

Computation and Language · Computer Science 2022-03-14 Haochen Tan , Wei Shao , Han Wu , Ke Yang , Linqi Song

Abbreviations and contractions are commonly found in text across different domains. For example, doctors' notes contain many contractions that can be personalized based on their choices. Existing spelling correction models are not suitable…

Computation and Language · Computer Science 2022-07-11 Prateek Kacker , Andi Cupallari , Aswin Gridhar Subramanian , Nimit Jain