English
Related papers

Related papers: ChatGPT as a Math Questioner? Evaluating ChatGPT o…

200 papers

Large Language Models (LLM) have become sophisticated enough that complex computer programs can be created through interpretation of plain English sentences and implemented in a variety of modern languages such as Python, Java Script, C++…

Software Engineering · Computer Science 2023-09-04 Simon Thorne

The application of Artificial intelligence for teaching and learning in the academic sphere is a trending subject of interest in the computing education. ChatGPT, as an AI-based tool, provides various advantages, such as heightened student…

Computers and Society · Computer Science 2024-01-18 Basit Qureshi

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

The transformative influence of Large Language Models (LLMs) is profoundly reshaping the Artificial Intelligence (AI) technology domain. Notably, ChatGPT distinguishes itself within these models, demonstrating remarkable performance in…

Software Engineering · Computer Science 2024-05-28 Sayed Erfan Arefin , Tasnia Ashrafi Heya , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

Large language models (LLMs) have demonstrated exceptional performance across various linguistic tasks. However, it remains uncertain whether LLMs have developed human-like fine-grained grammatical intuition. This preregistered study…

Computation and Language · Computer Science 2024-06-18 Zhuang Qiu , Xufeng Duan , Zhenguang G. Cai

AI tools, particularly large-scale language model (LLM) based applications such as ChatGPT, have the potential to simplify qualitative research. Through semi-structured interviews with seventeen participants, we identified challenges and…

Human-Computer Interaction · Computer Science 2025-05-14 He Zhang , Chuhao Wu , Jingyi Xie , Yao Lyu , Jie Cai , John M. Carroll

ChatGPT is a large language model (LLM) created by OpenAI that has been carefully trained on a large amount of data. It has revolutionized the field of natural language processing (NLP) and has pushed the boundaries of LLM capabilities.…

Computation and Language · Computer Science 2023-07-18 Salman Mohamadi , Ghulam Mujtaba , Ngan Le , Gianfranco Doretto , Donald A. Adjeroh

The evaluation of mathematical reasoning capabilities is essential for advancing Artificial General Intelligence (AGI). While Large Language Models (LLMs) have shown impressive performance in solving mathematical problems, existing…

Computation and Language · Computer Science 2025-01-15 Bo Yang , Qingping Yang , Yingwei Ma , Runtao Liu

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering. Currently there is much debate, but…

Software Engineering · Computer Science 2024-05-22 Ranim Khojah , Mazen Mohamad , Philipp Leitner , Francisco Gomes de Oliveira Neto

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang

Large Language Models (LLMs) have had considerable difficulty when prompted with mathematical questions, especially those within theory of computing (ToC) courses. In this paper, we detail two experiments regarding our own ToC course and…

Computers and Society · Computer Science 2024-07-11 Matei A. Golesteanu , Garrett B. Vowinkel , Ryan E. Dougherty

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

This study investigates how undergraduate students engage with ChatGPT in self-directed learning contexts. Analyzing naturalistic interaction logs, we identify five dominant use categories of ChatGPT: information seeking, content…

Human-Computer Interaction · Computer Science 2026-01-21 Tawfiq Ammari , Meilun Chen , S M Mehedi Zaman , Kiran Garimella

Background: Large language models (LLMs) such as ChatGPT are increasingly used in introductory programming courses to provide real-time code generation, debugging, and explanations. While these tools can boost productivity and code quality,…

Software Engineering · Computer Science 2025-10-02 Shiza Andleeb , Brandon Kantorski , Jeffrey C. Carver

ChatGPT is an advanced natural language processing tool with growing applications across various disciplines in medical research. Thematic analysis, a qualitative research method to identify and interpret patterns in data, is one…

Computation and Language · Computer Science 2025-05-08 V Vien Lee , Stephanie C. C. van der Lubbe , Lay Hoon Goh , Jose M. Valderas

In the current era, a multitude of language models has emerged to cater to user inquiries. Notably, the GPT-3.5 Turbo language model has gained substantial attention as the underlying technology for ChatGPT. Leveraging extensive parameters,…

Computation and Language · Computer Science 2023-12-14 Hossein Bahak , Farzaneh Taheri , Zahra Zojaji , Arefeh Kazemi

ChatGPT, an implementation and application of large language models, has gained significant popularity since its initial release. Researchers have been exploring ways to harness the practical benefits of ChatGPT in real-world scenarios.…

Computers and Society · Computer Science 2023-08-01 Yong Zheng

This paper aims to quantitatively evaluate the performance of ChatGPT, an interactive large language model, on inter-sentential relations such as temporal relations, causal relations, and discourse relations. Given ChatGPT's promising…

Computation and Language · Computer Science 2024-01-29 Chunkit Chan , Jiayang Cheng , Weiqi Wang , Yuxin Jiang , Tianqing Fang , Xin Liu , Yangqiu Song