English
Related papers

Related papers: Detecting LLM-Generated Short Answers and Effects …

200 papers

Background and Context: Over the past year, large language models (LLMs) have taken the world by storm. In computing education, like in other walks of life, many opportunities and threats have emerged as a consequence. Objectives: In this…

Computers and Society · Computer Science 2023-06-12 Arto Hellas , Juho Leinonen , Sami Sarsa , Charles Koutcheme , Lilja Kujanpää , Juha Sorva

The burgeoning progress in the field of Large Language Models (LLMs) heralds significant benefits due to their unparalleled capacities. However, it is critical to acknowledge the potential misuse of these models, which could give rise to a…

Computation and Language · Computer Science 2023-08-07 Haolan Zhan , Xuanli He , Qiongkai Xu , Yuxiang Wu , Pontus Stenetorp

Large Language Models (LLMs) like GPT-4o can help automate text classification tasks at low cost and scale. However, there are major concerns about the validity and reliability of LLM outputs. By contrast, human coding is generally more…

Computation and Language · Computer Science 2025-01-17 Conrad Borchers , Danielle R. Thomas , Jionghao Lin , Ralph Abboud , Kenneth R. Koedinger

Large language models (LLMs) have gained significant attention due to their ability to mimic human language. Identifying texts generated by LLMs is crucial for understanding their capabilities and mitigating potential consequences. This…

Computation and Language · Computer Science 2024-07-19 Anjali Rawal , Hui Wang , Youjia Zheng , Yu-Hsuan Lin , Shanu Sushmita

Large Language Models (LLMs), exemplified by ChatGPT, have significantly reshaped text generation, particularly in the realm of writing assistance. While ethical considerations underscore the importance of transparently acknowledging LLM…

Information Retrieval · Computer Science 2025-09-03 Teddy Lazebnik , Ariel Rosenfeld

This study seeks to enhance academic integrity by providing tools to detect AI-generated content in student work using advanced technologies. The findings promote transparency and accountability, helping educators maintain ethical standards…

Computation and Language · Computer Science 2025-01-07 Ayat A. Najjar , Huthaifa I. Ashqar , Omar A. Darwish , Eman Hammad

Since the proliferation of LLMs, there have been concerns about their misuse for harmful content creation and spreading. Recent studies justify such fears, providing evidence of LLM vulnerabilities and high potential of their misuse. Humans…

Computation and Language · Computer Science 2025-03-20 Dominik Macko , Robert Moro , Ivan Srba

Identifying logical errors in complex, incomplete or even contradictory and overall heterogeneous data like students' experimentation protocols is challenging. Recognizing the limitations of current evaluation methods, we investigate the…

Artificial Intelligence · Computer Science 2024-09-20 Arne Bewersdorff , Kathrin Seßler , Armin Baur , Enkelejda Kasneci , Claudia Nerdel

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

This paper explores an intriguing observation: fine-tuning a large language model (LLM) with responses generated by a LLM often yields better results than using responses generated by humans, particularly in reasoning tasks. We conduct an…

Computation and Language · Computer Science 2025-12-09 Xuan Ren , Biao Wu , Lingqiao Liu

Large Language Models (LLMs) possess an extraordinary capability to produce text that is not only coherent and contextually relevant but also strikingly similar to human writing. They adapt to various styles and genres, producing content…

Computation and Language · Computer Science 2025-07-08 Chinnappa Guggilla , Budhaditya Roy , Trupti Ramdas Chavan , Abdul Rahman , Edward Bowen

Large Language Models (LLMs) have revolutionized the domain of natural language processing (NLP) with remarkable capabilities of generating human-like text responses. However, despite these advancements, several works in the existing…

Computation and Language · Computer Science 2023-10-25 Soumya Suvra Ghosal , Souradip Chakraborty , Jonas Geiping , Furong Huang , Dinesh Manocha , Amrit Singh Bedi

Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around the privacy and ethical implications of sending student work…

Computation and Language · Computer Science 2024-05-09 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Arto Hellas , Juho Leinonen , Paul Denny

With the rapid progress of large language models (LLMs) and the huge amount of text they generated, it becomes more and more impractical to manually distinguish whether a text is machine-generated. Given the growing use of LLMs in social…

Computation and Language · Computer Science 2023-06-12 Jinyan Su , Terry Yue Zhuo , Di Wang , Preslav Nakov

Large Language Models (LLMs) have shown impressive performance across a variety of Artificial Intelligence (AI) and natural language processing tasks, such as content creation, report generation, etc. However, unregulated malign application…

Computation and Language · Computer Science 2023-09-15 Harika Abburi , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

Using large language models (LLMs) for automatic evaluation has become an important evaluation method in NLP research. However, it is unclear whether these LLM-based evaluators can be applied in real-world classrooms to assess student…

Computation and Language · Computer Science 2024-09-24 Cheng-Han Chiang , Wei-Chih Chen , Chun-Yi Kuan , Chienchou Yang , Hung-yi Lee

The potentials of Generative-AI technologies like Large Language models (LLMs) to revolutionize education are undermined by ethical considerations around their misuse which worsens the problem of academic dishonesty. LLMs like GPT-4 and…

Machine Learning · Computer Science 2024-07-11 Suriya Prakash Jambunathan , Ashwath Shankarnarayan , Parijat Dube

Peer review is a critical process for ensuring the integrity of published scientific research. Confidence in this process is predicated on the assumption that experts in the relevant domain give careful consideration to the merits of…

Computation and Language · Computer Science 2024-12-09 Sungduk Yu , Man Luo , Avinash Madasu , Vasudev Lal , Phillip Howard

Large language models (LLMs) have been proposed as scalable tools to address the gap between the importance of individualized written feedback and the practical challenges of providing it at scale. However, concerns persist regarding the…

Other Statistics · Statistics 2025-11-12 Niklas Ippisch , Markus Herklotz , Anna-Carolina Haensch , Carsten Schwemmer