English
Related papers

Related papers: Multiple-Choice Question Generation: Towards an Au…

200 papers

Conversational question generation (CQG) serves as a vital task for machines to assist humans, such as interactive reading comprehension, through conversations. Compared to traditional single-turn question generation (SQG), CQG is more…

Computation and Language · Computer Science 2022-10-12 Xuan Long Do , Bowei Zou , Liangming Pan , Nancy F. Chen , Shafiq Joty , Ai Ti Aw

The automatic generation of Multiple Choice Questions (MCQ) has the potential to reduce the time educators spend on student assessment significantly. However, existing evaluation metrics for MCQ generation, such as BLEU, ROUGE, and METEOR,…

Computation and Language · Computer Science 2023-08-29 Hyeongdon Moon , Yoonseok Yang , Jamin Shin , Hangyeol Yu , Seunghyun Lee , Myeongho Jeong , Juneyoung Park , Minsam Kim , Seungtaek Choi

A large majority of American adults get at least some of their news from the Internet. Even though many online news products have the goal of informing their users about the news, they lack scalable and reliable tools for measuring how well…

Computation and Language · Computer Science 2021-02-19 Adam D. Lelkes , Vinh Q. Tran , Cong Yu

This paper presents an evaluation of the quality of automatically generated reading comprehension questions from Swedish text, using the Quinductor method. This method is a light-weight, data-driven but non-neural method for automatic…

Computation and Language · Computer Science 2022-11-29 Dmytro Kalpakchi , Johan Boye

In this paper, we propose the first model to be able to generate visually grounded questions with diverse types for a single image. Visual question generation is an emerging topic which aims to ask questions in natural language based on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Shijie Zhang , Lizhen Qu , Shaodi You , Zhenglu Yang , Jiawan Zhang

For the field of education, being able to generate semantically correct and educationally relevant multiple choice questions (MCQs) could have a large impact. While question generation itself is an active research topic, generating…

Computation and Language · Computer Science 2020-10-20 Jeroen Offerijns , Suzan Verberne , Tessa Verhoef

This study delves into the application potential of the large language models (LLMs) ChatGLM in the automatic generation of structured questions for National Teacher Certification Exams (NTCE). Through meticulously designed prompt…

Computers and Society · Computer Science 2024-08-21 Ling He , Yanxin Chen , Xiaoqiang Hu

Ambiguous user queries in search engines result in the retrieval of documents that often span multiple topics. One potential solution is for the search engine to generate multiple refined queries, each of which relates to a subset of the…

Computation and Language · Computer Science 2019-10-28 Woon Sang Cho , Yizhe Zhang , Sudha Rao , Chris Brockett , Sungjin Lee

Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Alkesh Patel , Akanksha Bindal , Hadas Kotek , Christopher Klein , Jason Williams

The development of Large Language Models (LLMs) has brought impressive performances on mitigation strategies against misinformation, such as counterargument generation. However, LLMs are still seriously hindered by outdated knowledge and by…

Computation and Language · Computer Science 2024-10-21 Blanca Calvo Figueras , Rodrigo Agerri

Evaluating natural language generation (NLG) is a vital but challenging problem in natural language processing. Traditional evaluation metrics mainly capturing content (e.g. n-gram) overlap between system outputs and references are far from…

Computation and Language · Computer Science 2025-05-15 Mingqi Gao , Xinyu Hu , Jie Ruan , Xiao Pu , Xiaojun Wan

Question Generation (QG), as a challenging Natural Language Processing task, aims at generating questions based on given answers and context. Existing QG methods mainly focus on building or training models for specific QG datasets. These…

Computation and Language · Computer Science 2022-12-06 Wei Yuan , Hongzhi Yin , Tieke He , Tong Chen , Qiufeng Wang , Lizhen Cui

Multiple choice exams are widely used to assess candidates across a diverse range of domains and tasks. To moderate question quality, newly proposed questions often pass through pre-test evaluation stages before being deployed into…

Computation and Language · Computer Science 2023-10-17 Adian Liusie , Vatsal Raina , Andrew Mullooly , Kate Knill , Mark J. F. Gales

Question Answering has come a long way from answer sentence selection, relational QA to reading and comprehension. We shift our attention to generative question answering (gQA) by which we facilitate machine to read passages and answer…

Computation and Language · Computer Science 2018-07-10 Rajarshee Mitra

Most existing work on automated fact checking is concerned with predicting the veracity of claims based on metadata, social network spread, language used in claims, and, more recently, evidence supporting or denying claims. A crucial piece…

Computation and Language · Computer Science 2020-04-14 Pepa Atanasova , Jakob Grue Simonsen , Christina Lioma , Isabelle Augenstein

Automatic question generation is an important problem in natural language processing. In this paper we propose a novel adaptive copying recurrent neural network model to tackle the problem of question generation from sentences and…

Machine Learning · Computer Science 2019-09-19 Xinyuan Lu , Yuhong Guo

Generating diverse and effective clarifying questions is crucial for improving query understanding and retrieval performance in open-domain conversational search (CS) systems. We propose AGENT-CQ (Automatic GENeration, and evaluaTion of…

Computation and Language · Computer Science 2024-10-28 Clemencia Siro , Yifei Yuan , Mohammad Aliannejadi , Maarten de Rijke

Advances in large language models (LLMs) are rapidly transforming scientific work, yet empirical evidence on how these systems reshape research activities remains limited. We report a mixed-methods pilot evaluation of an AI-orchestrated…

Computers and Society · Computer Science 2026-02-24 Yuan An

Literature research, vital for scientific work, faces the challenge of surging information volumes exceeding researchers' processing capabilities. We present an automated review generation method based on large language models (LLMs) to…

Computation and Language · Computer Science 2025-05-02 Shican Wu , Xiao Ma , Dehui Luo , Lulu Li , Xiangcheng Shi , Xin Chang , Xiaoyun Lin , Ran Luo , Chunlei Pei , Changying Du , Zhi-Jian Zhao , Jinlong Gong

This study explores automatic generation (AIG) using language models to create multiple choice questions (MCQs) for morphological assessment, aiming to reduce the cost and inconsistency of manual test development. The study used a two-fold…

Computation and Language · Computer Science 2025-08-29 Mohammad Amini , Babak Ahmadi , Xiaomeng Xiong , Yilin Zhang , Christopher Qiao