English
Related papers

Related papers: Is this Snippet Written by ChatGPT? An Empirical S…

200 papers

AI-based code assistants are promising tools that can facilitate and speed up code development. They exploit machine learning algorithms and natural language processing to interact with developers, suggesting code snippets (e.g., method…

Software Engineering · Computer Science 2024-02-15 Vincenzo Corso , Leonardo Mariani , Daniela Micucci , Oliviero Riganelli

We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but…

Software Engineering · Computer Science 2024-03-26 Minaoar Hossain Tanzil , Junaed Younus Khan , Gias Uddin

Assessing communication and collaboration at scale depends on a labor-intensive task of coding communication data into categories according to different frameworks. Prior research has established that ChatGPT can be directly instructed with…

Computation and Language · Computer Science 2026-05-19 Jiangang Hao , Wenju Cui , Patrick Kyllonen , Emily Kerzabi

Generative AI is changing the way that many disciplines are taught, including computer science. Researchers have shown that generative AI tools are capable of solving programming problems, writing extensive blocks of code, and explaining…

Human-Computer Interaction · Computer Science 2024-02-14 Bailey Kimmel , Austin Geisert , Lily Yaro , Brendan Gipson , Taylor Hotchkiss , Sidney Osae-Asante , Hunter Vaught , Grant Wininger , Chase Yamaguchi

This study considers ChatGPT as an information source, investigating the information needs that people come to ChatGPT with and the information practices that ChatGPT supports, through a qualitative content analysis of 205 user vignettes.…

Human-Computer Interaction · Computer Science 2025-07-09 Tim Gorichanaz

AI generated content (AIGC) presents considerable challenge to educators around the world. Instructors need to be able to detect such text generated by large language models, either with the naked eye or with the help of some tools. There…

Computation and Language · Computer Science 2023-09-26 Yikang Liu , Ziyin Zhang , Wanyang Zhang , Shisen Yue , Xiaojing Zhao , Xinyuan Cheng , Yiwen Zhang , Hai Hu

This study evaluates the performance of ChatGPT variants, GPT-3.5 and GPT-4, both with and without prompt engineering, against solely student work and a mixed category containing both student and GPT-4 contributions in university-level…

Computation and Language · Computer Science 2024-10-08 Will Yeadon , Alex Peach , Craig P. Testrow

The increasing demand for programming language education and growing class sizes require immediate and personalized feedback. However, traditional code review methods have limitations in providing this level of feedback. As the capabilities…

Software Engineering · Computer Science 2025-06-23 Lee Dong-Kyu

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

Pretrained Language Models (PLMs) harbor inherent social biases that can result in harmful real-world implications. Such social biases are measured through the probability values that PLMs output for different social groups and attributes…

Computation and Language · Computer Science 2023-12-07 Rafal Kocielnik , Shrimai Prabhumoye , Vivian Zhang , Roy Jiang , R. Michael Alvarez , Anima Anandkumar

ChatGPT, the most accessible generative artificial intelligence (AI) tool, offers considerable potential for veterinary medicine, yet a dedicated review of its specific applications is lacking. This review concisely synthesizes the latest…

Computers and Society · Computer Science 2024-05-24 Candice P. Chu

The widespread adoption of Large Language Models and publicly available ChatGPT has marked a significant turning point in the integration of Artificial Intelligence into people's everyday lives. The academic community has taken notice of…

Large Language Models (LLMs), such as GPT-3 and BERT, reshape how textual content is written and communicated. These models have the potential to generate scientific content that is indistinguishable from that written by humans. Hence, LLMs…

Computation and Language · Computer Science 2024-11-19 Bushra Alhijawi , Rawan Jarrar , Aseel AbuAlRub , Arwa Bader

The potential misuse of ChatGPT and other Large Language Models (LLMs) has raised concerns regarding the dissemination of false information, plagiarism, academic dishonesty, and fraudulent activities. Consequently, distinguishing between…

Cryptography and Security · Computer Science 2023-11-10 Kavita Kumari , Alessandro Pegoraro , Hossein Fereidooni , Ahmad-Reza Sadeghi

Learning basic programming with Scratch can be hard for novices and tutors alike: Students may not know how to advance when solving a task, teachers may face classrooms with many raised hands at a time, and the problem is exacerbated when…

Software Engineering · Computer Science 2021-05-13 Florian Obermüller , Ute Heuer , Gordon Fraser

AI and generative AI tools, including chatbots like ChatGPT that rely on large language models (LLMs), have burst onto the scene this year, creating incredible opportunities to increase work productivity and improve our lives. Statisticians…

Computation and Language · Computer Science 2024-03-27 Mark Glickman , Yi Zhang

Background: Recently, code generation tools such as ChatGPT have drawn attention to their performance. Generally, a prior analysis of their performance is needed to select new code-generation tools from a list of candidates. Without such…

Software Engineering · Computer Science 2023-12-21 Ryoto Shima , Masateru Tsunoda , Yukasa Murakami , Akito Monden , Amjed Tahir , Kwabena Ebo Bennin , Koji Toda , Keitaro Nakasai

The emergence of foundation models, such as large language models (LLMs) GPT-4 and text-to-image models DALL-E, has opened up numerous possibilities across various domains. People can now use natural language (i.e. prompts) to communicate…

Software Engineering · Computer Science 2023-12-21 Yu Cheng , Jieshan Chen , Qing Huang , Zhenchang Xing , Xiwei Xu , Qinghua Lu

This study evaluates $n = 300$ short-form physics essay submissions, equally divided between student work submitted before the introduction of ChatGPT and those generated by OpenAI's GPT-4. In blinded evaluations conducted by five…

Physics Education · Physics 2024-03-11 Will Yeadon , Elise Agra , Oto-obong Inyang , Paul Mackay , Arin Mizouri

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++…

Software Engineering · Computer Science 2023-09-04 Simon Thorne