English
Related papers

Related papers: Creating Large Language Model Resistant Exams: Gui…

200 papers

The rapid evolution of large multimodal models (LMMs) has significantly impacted modern teaching and learning, especially in computer engineering. While LMMs offer extensive opportunities for enhancing learning, they also risk undermining…

Computers and Society · Computer Science 2024-07-18 Maoyang Xiang , T. Hui Teo

With the advancement of large language models (LLMs), an increasing number of student models have leveraged LLMs to analyze textual artifacts generated by students to understand and evaluate their learning. These student models typically…

Computation and Language · Computer Science 2025-02-03 Jiayi Zhang

Large language models (LLMs) such as ChatGPT can produce coherent, cohesive, relevant, and fluent answers for various natural language processing (NLP) tasks. Taking document-level machine translation (MT) as a testbed, this paper provides…

Computation and Language · Computer Science 2023-10-25 Longyue Wang , Chenyang Lyu , Tianbo Ji , Zhirui Zhang , Dian Yu , Shuming Shi , Zhaopeng Tu

The advent of Large Language Models (LLMs) started a serious discussion among educators on how LLMs would affect, e.g., curricula, assessments, and students' competencies. Generative AI and LLMs also raised ethical questions and concerns…

Computers and Society · Computer Science 2024-06-19 Virginia Grande , Natalie Kiesler , Maria Andreina Francisco R

The use of ChatGPT and similar Large Language Model (LLM) tools in scholarly communication and academic publishing has been widely discussed since they became easily accessible to a general audience in late 2022. This study uses keywords…

Digital Libraries · Computer Science 2024-03-26 Andrew Gray

High-risk domains pose unique challenges that require language models to provide accurate and safe responses. Despite the great success of large language models (LLMs), such as ChatGPT and its variants, their performance in high-risk…

Computation and Language · Computer Science 2023-11-28 Chia-Chien Hung , Wiem Ben Rim , Lindsay Frost , Lars Bruckner , Carolin Lawrence

The integration of Large Language Models (LLMs), such as ChatGPT and GitHub Copilot, into professional workflows is increasingly reshaping software engineering practices. These tools have lowered the cost of code generation, explanation,…

Software Engineering · Computer Science 2026-01-21 Mustafa Degerli

Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users. In this technical report, we take an initiative to investigate their capacities of playing text…

Computation and Language · Computer Science 2025-04-01 Chen Feng Tsai , Xiaochen Zhou , Sierra S. Liu , Jing Li , Mo Yu , Hongyuan Mei

As the importance of comprehensive evaluation in workshop courses increases, there is a growing demand for efficient and fair assessment methods that reduce the workload for faculty members. This paper presents an evaluation conducted with…

Computers and Society · Computer Science 2024-05-30 Toru Ishida , Tongxi Liu , Hailong Wang , William K. Cheung

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

We present this article as a small gesture in an attempt to counter what appears to be exponentially growing hype around Artificial Intelligence (AI) and its capabilities, and the distraction provided by the associated talk of…

Computation and Language · Computer Science 2023-07-12 Michael O'Neill , Mark Connor

This study explores the application of Large Language Models (LLMs), specifically GPT-4, in the analysis of classroom dialogue, a crucial research task for both teaching diagnosis and quality improvement. Recognizing the knowledge-intensive…

Computation and Language · Computer Science 2024-10-08 Yun Long , Haifeng Luo , Yu Zhang

This report aims to evaluate the performance of large language models (LLMs) in solving high school science questions and to explore their potential applications in the educational field. With the rapid development of LLMs in the field of…

Computation and Language · Computer Science 2025-05-02 Zhu Jiawei , Chen Wei

Generative Large Language Models (gLLMs), such as ChatGPT, are increasingly being used in communication research for content analysis. Studies show that gLLMs can outperform both crowd workers and trained coders, such as research…

Artificial Intelligence · Computer Science 2025-10-29 Daria Kravets-Meinke , Hannah Schmid-Petri , Sonja Niemann , Ute Schmid

Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been…

Software Engineering · Computer Science 2024-04-18 Ben Arie Tanay , Lexy Arinze , Siddhant S. Joshi , Kirsten A. Davis , James C. Davis

With the recent undeniable advancement in reasoning abilities in large language models (LLMs) like ChatGPT and GPT-4, there is a growing trend for using LLMs on various tasks. One area where LLMs can be employed is as an alternative…

Computation and Language · Computer Science 2023-10-23 Chenhui Shen , Liying Cheng , Xuan-Phi Nguyen , Yang You , Lidong Bing

While large language models (LLMs) like ChatGPT have shown impressive capabilities in Natural Language Processing (NLP) tasks, a systematic investigation of their potential in this field remains largely unexplored. This study aims to…

Computation and Language · Computer Science 2025-08-26 Libo Qin , Qiguang Chen , Xiachong Feng , Yang Wu , Yongheng Zhang , Yinghui Li , Min Li , Wanxiang Che , Philip S. Yu

Recent efforts have evaluated large language models (LLMs) in areas such as commonsense reasoning, mathematical reasoning, and code generation. However, to the best of our knowledge, no work has specifically investigated the performance of…

Computation and Language · Computer Science 2024-05-17 Xuanfan Ni , Piji Li

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

Large language models (LLM) have revolutionized the processing of natural language. Although first benchmarks of the process modeling abilities of LLM are promising, it is currently under debate to what extent an LLM can generate good…

Computation and Language · Computer Science 2025-03-19 Peter Fettke , Constantin Houy