English
Related papers

Related papers: MCQG-SRefine: Multiple Choice Question Generation …

200 papers

Agentic Retrieval Augmented Generation (RAG) and 'deep research' systems aim to enable autonomous search processes where Large Language Models (LLMs) iteratively refine outputs. However, applying these systems to domain-specific…

Computation and Language · Computer Science 2025-08-08 Samy Ateia , Udo Kruschwitz

Automatic question generation (AQG) for mathematics education remains an elusive goal for Intelligent Tutoring Systems and educators. While pre-trained transformer-based language models have significantly advanced natural language…

Multiagent Systems · Computer Science 2025-11-07 Kia Karbasi , Kevin Hong , Mohammad Amin Samadi , Gregory Pottie

This study delves into the application potential of the large language models (LLMs) ChatGLM in the automatic generation of structured questions for National Teacher Certification Exams (NTCE). Through meticulously designed prompt…

Computers and Society · Computer Science 2024-08-21 Ling He , Yanxin Chen , Xiaoqiang Hu

Mathematical problem generation (MPG) is a significant research direction in the field of intelligent education. In recent years, the rapid development of large language models (LLMs) has enabled new technological approaches to…

Artificial Intelligence · Computer Science 2026-01-21 Yifei Sun , Yongan Li , A. K. Qin , Sicheng Hou , Tamas Pflanzner

Automatic question generation is a critical task that involves evaluating question quality by considering factors such as engagement, pedagogical value, and the ability to stimulate critical thinking. These aspects require human-like…

Computation and Language · Computer Science 2025-03-26 Aniket Deroy , Subhankar Maity , Sudeshna Sarkar

Generating diverse and effective clarifying questions is crucial for improving query understanding and retrieval performance in open-domain conversational search (CS) systems. We propose AGENT-CQ (Automatic GENeration, and evaluaTion of…

Computation and Language · Computer Science 2024-10-28 Clemencia Siro , Yifei Yuan , Mohammad Aliannejadi , Maarten de Rijke

Multi-hop question generation (MQG) aims to generate questions that require synthesizing multiple information snippets from documents to derive target answers. The primary challenge lies in effectively pinpointing crucial information…

Computation and Language · Computer Science 2025-06-04 Maodong Li , Longyin Zhang , Fang Kong

Question Generation (QG) is a Natural Language Processing (NLP) task that aids advances in Question Answering (QA) and conversational assistants. Existing models focus on generating a question based on a text and possibly the answer to the…

Computation and Language · Computer Science 2019-10-31 Junmo Kang , Haritz Puerto San Roman , Sung-Hyon Myaeng

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

In diverse professional environments, ranging from academic conferences to corporate earnings calls, the ability to anticipate audience questions stands paramount. Traditional methods, which rely on manual assessment of an audience's…

Computation and Language · Computer Science 2024-09-30 Yining Juan , Chung-Chi Chen , Hen-Hsen Huang , Hsin-Hsi Chen

Large language models (LLMs) have demonstrated remarkable proficiency in generating detailed and coherent explanations of complex concepts. However, the extent to which these models truly comprehend the concepts they articulate remains…

Computation and Language · Computer Science 2025-03-11 Saeid Asgari Taghanaki , Joao Monteiro

Natural language explanations (NLEs) are vital for elucidating the reasoning behind large language model (LLM) decisions. Many techniques have been developed to generate NLEs using LLMs. However, like humans, LLMs might not always produce…

Computation and Language · Computer Science 2024-12-03 Qianli Wang , Tatiana Anikina , Nils Feldhus , Simon Ostermann , Sebastian Möller , Vera Schmitt

NLP-powered automatic question generation (QG) techniques carry great pedagogical potential of saving educators' time and benefiting student learning. Yet, QG systems have not been widely adopted in classrooms to date. In this work, we aim…

Human-Computer Interaction · Computer Science 2022-05-03 Xu Wang , Simin Fan , Jessica Houghton , Lu Wang

Grading exams is an important, labor-intensive, subjective, repetitive, and frequently challenging task. The feasibility of autograding textual responses has greatly increased thanks to the availability of large language models (LLMs) such…

Computation and Language · Computer Science 2024-07-09 Johannes Schneider , Bernd Schenk , Christina Niklaus

Multiple Choice Question (MCQ) tests are among the most used methods for evaluating large language models (LLMs). Besides checking the correctness of the selected answer, evaluations often consider the model's confidence through the…

Computation and Language · Computer Science 2026-05-05 Tairan Fu , Javier Conde , Gonzalo Martínez , María Grandury , Pedro Reviriego

Evaluating text generation capabilities of large language models (LLMs) is challenging, particularly for low-resource languages where methods for direct assessment are scarce. We propose MUG-Eval, a novel framework that evaluates LLMs'…

Computation and Language · Computer Science 2025-11-11 Seyoung Song , Seogyeong Jeong , Eunsu Kim , Jiho Jin , Dongkwan Kim , Jay Shin , Alice Oh

While text-to-video diffusion models have advanced significantly, creating coherent long-form content remains unreliable due to stochastic sampling artifacts. This necessitates generating multiple candidates, yet verifying them creates a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Daewon Yoon , Hyeongseok Lee , Wonsik Shin , Sangyu Han , Nojun Kwak

In the field of NLP, Large Language Models (LLMs) have markedly enhanced performance across a variety of tasks. However, the comprehensive evaluation of LLMs remains an inevitable challenge for the community. Recently, the adoption of…

Computation and Language · Computer Science 2024-12-09 Haochun Wang , Sendong Zhao , Zewen Qiang , Nuwa Xi , Bing Qin , Ting Liu

Academic dishonesty is met with zero tolerance in higher education, yet plagiarism has become increasingly prevalent in the era of online teaching and learning. Automatic Question Generation (AQG) presents a potential solution to mitigate…

Computation and Language · Computer Science 2025-10-15 Xinyu Wang , Haoming Yu , Yicheng Yang , Zhiyuan Li

Large Language Models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence (AI) technology which is rapidly evolving and promises to aid in medical diagnosis either by assisting doctors or by simulating a doctor's…