English
Related papers

Related papers: ExamGAN and Twin-ExamGAN for Exam Script Generatio…

200 papers

Training regimes based on Maximum Likelihood Estimation (MLE) suffer from known limitations, often leading to poorly generated text sequences. At the root of these limitations is the mismatch between training and inference, i.e. the…

Computation and Language · Computer Science 2020-06-09 Thomas Scialom , Paul-Alexis Dray , Sylvain Lamprier , Benjamin Piwowarski , Jacopo Staiano

Writing is a foundational literacy skill that underpins effective communication, fosters critical thinking, facilitates learning across disciplines, and enables individuals to organize and articulate complex ideas. Consequently, writing…

Computation and Language · Computer Science 2026-03-05 Jiangang Hao

Academic dishonesty is met with zero tolerance in higher education, yet plagiarism has become increasingly prevalent in the era of online teaching and learning. Automatic Question Generation (AQG) presents a potential solution to mitigate…

Computation and Language · Computer Science 2025-10-15 Xinyu Wang , Haoming Yu , Yicheng Yang , Zhiyuan Li

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

This paper provides a comprehensive review of the current methods and metrics used to evaluate the performance of Large Language Models (LLMs) in code generation tasks. With the rapid growth in demand for automated software development,…

Software Engineering · Computer Science 2025-03-05 Liguo Chen , Qi Guo , Hongrui Jia , Zhengran Zeng , Xin Wang , Yijiang Xu , Jian Wu , Yidong Wang , Qing Gao , Jindong Wang , Wei Ye , Shikun Zhang

Large Language Models (LLMs) are gaining popularity among software engineers. A crucial aspect of developing effective code generation LLMs is to evaluate these models using a robust benchmark. Evaluation benchmarks with quality issues can…

Software Engineering · Computer Science 2024-09-05 Mohammed Latif Siddiq , Simantika Dristi , Joy Saha , Joanna C. S. Santos

Academic paper review is a critical yet time-consuming task within the research community. With the increasing volume of academic publications, automating the review process has become a significant challenge. The primary issue lies in…

Computation and Language · Computer Science 2025-07-17 Xian Gao , Jiacheng Ruan , Zongyun Zhang , Jingsheng Gao , Ting Liu , Yuzhuo Fu

Language models based on deep neural networks are vulnerable to textual adversarial attacks. While rich-resource languages like English are receiving focused attention, Tibetan, a cross-border language, is gradually being studied due to its…

Computation and Language · Computer Science 2025-03-13 Xi Cao , Quzong Gesang , Yuan Sun , Nuo Qun , Tashi Nyima

Consider the following task taught in introductory optimization courses which addresses challenges articulated by the community at the intersection of (generative) AI and OR: generate the dual of a linear program. LLMs, being trained at…

Machine Learning · Computer Science 2025-05-29 Michael Klamkin , Arnaud Deza , Sikai Cheng , Haoruo Zhao , Pascal Van Hentenryck

Large Language Models (LLMs) are widely applied across various domains due to their powerful text generation capabilities. While LLM-generated texts often resemble human-written ones, their misuse can lead to significant societal risks.…

Computation and Language · Computer Science 2026-03-31 Zhuoshang Wang , Yubing Ren , Guoyu Zhao , Xiaowei Zhu , Hao Li , Yanan Cao

The task of Critical Questions Generation (CQs-Gen) aims to foster critical thinking by enabling systems to generate questions that expose underlying assumptions and challenge the validity of argumentative reasoning structures. Despite…

Computation and Language · Computer Science 2025-09-24 Banca Calvo Figueras , Rodrigo Agerri

Feedback is a critical aspect of improvement. Unfortunately, when there is a lot of feedback from multiple sources, it can be difficult to distill the information into actionable insights. Consider student evaluations of teaching (SETs),…

Computation and Language · Computer Science 2024-03-19 Andrew Katz , Mitchell Gerhardt , Michelle Soledad

In the past few years, Large Language Models (LLMs) have exploded in usefulness and popularity for code generation tasks. However, LLMs still struggle with accuracy and are unsuitable for high-risk applications without additional oversight…

Software Engineering · Computer Science 2024-10-29 William Murphy , Nikolaus Holzer , Feitong Qiao , Leyi Cui , Raven Rothkopf , Nathan Koenig , Mark Santolucito

Evaluating the quality of generated text automatically remains a significant challenge. Conventional reference-based metrics have been shown to exhibit relatively weak correlation with human evaluations. Recent research advocates the use of…

Computation and Language · Computer Science 2025-11-25 Xiao Wang , Daniil Larionov , Siwei Wu , Yiqi Liu , Steffen Eger , Nafise Sadat Moosavi , Chenghua Lin

Learnersourcing offers great potential for scalable education through student content creation. However, predicting student performance on learnersourced questions, which is essential for personalizing the learning experience, is…

Machine Learning · Computer Science 2024-01-30 Lin Ni , Sijie Wang , Zeyu Zhang , Xiaoxuan Li , Xianda Zheng , Paul Denny , Jiamou Liu

Large Language Models (LLMs) have emerged as a powerful tool in advancing the Text-to-SQL task, significantly outperforming traditional methods.Nevertheless, as a nascent research field, there is still no consensus on the optimal prompt…

Computation and Language · Computer Science 2026-03-20 Bin Zhang , Yuxiao Ye , Guoqing Du , Xiaoru Hu , Zhishuai Li , Chi Harold Liu , Zhiwei Xu , Guoliang Fan , Rui Zhao , Ziyue Li , Hangyu Mao

Recent advancements in large language models (LLMs) have significantly enhanced text generation capabilities, yet evaluating their performance in generative writing remains a challenge. Existing benchmarks primarily focus on generic text…

Artificial Intelligence · Computer Science 2025-12-01 Yuning Wu , Jiahao Mei , Ming Yan , Chenliang Li , Shaopeng Lai , Yuran Ren , Zijia Wang , Ji Zhang , Mengyue Wu , Qin Jin , Fei Huang

Code generation with Large Language Models (LLMs) has been extensively studied and achieved remarkable progress. As a complementary aspect to code generation, test case generation is of crucial importance in ensuring the quality and…

Software Engineering · Computer Science 2024-04-23 Kefan Li , Yuan Yuan

The emergence of Large Language Models (LLMs) presents transformative opportunities for education, generating numerous novel application scenarios. However, significant challenges remain: evaluation metrics vary substantially across…

Computers and Society · Computer Science 2025-08-01 Shou'ang Wei , Xinyun Wang , Shuzhen Bi , Jian Chen , Ruijia Li , Bo Jiang , Xin Lin , Min Zhang , Yu Song , BingDong Li , Aimin Zhou , Hao Hao

Augmenting toxic language data in a controllable and class-specific manner is crucial for improving robustness in toxicity classification, yet remains challenging due to limited supervision and distributional skew. We propose ToxiGAN, a…

Computation and Language · Computer Science 2026-01-07 Peiran Li , Jan Fillies , Adrian Paschke