English
Related papers

Related papers: A Study on the Vulnerability of Test Questions aga…

200 papers

The development of advanced generative chat models, such as ChatGPT, has raised questions about the potential consciousness of these tools and the extent of their general artificial intelligence. ChatGPT consistent avoidance of passing the…

General Literature · Computer Science 2023-04-26 Arend Hintze

Large Language Models (LLMs) like ChatGPT have demonstrated amazing capabilities in comprehending user intents and generate reasonable and useful responses. Beside their ability to chat, their capabilities in various natural language…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu

This study aimed at evaluating how students perceive the linguistic quality and scientific accuracy of ChatGPT responses to physics comprehension questions. A total of 102 first- and second-year physics students were confronted with three…

Physics Education · Physics 2023-06-27 Merten Nikolay Dahlkemper , Simon Zacharias Lahme , Pascal Klein

In the current era, a multitude of language models has emerged to cater to user inquiries. Notably, the GPT-3.5 Turbo language model has gained substantial attention as the underlying technology for ChatGPT. Leveraging extensive parameters,…

Computation and Language · Computer Science 2023-12-14 Hossein Bahak , Farzaneh Taheri , Zahra Zojaji , Arefeh Kazemi

Large Language Models (LLMs) have had considerable difficulty when prompted with mathematical questions, especially those within theory of computing (ToC) courses. In this paper, we detail two experiments regarding our own ToC course and…

Computers and Society · Computer Science 2024-07-11 Matei A. Golesteanu , Garrett B. Vowinkel , Ryan E. Dougherty

ChatGPT is currently the most popular large language model (LLM), with over 100 million users, making a significant impact on people's lives. However, due to the presence of jailbreak vulnerabilities, ChatGPT might have negative effects on…

Software Engineering · Computer Science 2023-12-19 Poorna Chander Reddy Puttaparthi , Soham Sanjay Deo , Hakan Gul , Yiming Tang , Weiyi Shang , Zhe Yu

This research article highlights the potential of AI-powered chatbots in education and presents the results of using ChatGPT, a large language model, to complete the Vietnamese National High School Graduation Examination (VNHSGE). The study…

Computation and Language · Computer Science 2023-07-11 Xuan-Quy Dao , Ngoc-Bich Le , Xuan-Dung Phan , Bac-Bien Ngo

Recently, the emergence of ChatGPT has attracted wide attention from the computational linguistics community. Many prior studies have shown that ChatGPT achieves remarkable performance on various NLP tasks in terms of automatic evaluation…

Computation and Language · Computer Science 2023-10-25 Jiaan Wang , Yunlong Liang , Fandong Meng , Zengkui Sun , Haoxiang Shi , Zhixu Li , Jinan Xu , Jianfeng Qu , Jie Zhou

Large language models have been demonstrated to be valuable in different fields. ChatGPT, developed by OpenAI, has been trained using massive amounts of data and simulates human conversation by comprehending context and generating…

Computation and Language · Computer Science 2023-04-05 Ali Borji

ChatGPT, an Artificial Intelligence model, has the potential to revolutionize education. However, its effectiveness in solving non-English questions remains uncertain. This study evaluates ChatGPT's robustness using 586 Korean mathematics…

Artificial Intelligence · Computer Science 2025-02-18 Phuong-Nam Nguyen , Quang Nguyen-The , An Vu-Minh , Diep-Anh Nguyen , Xuan-Lam Pham

ChatGPT is a conversational artificial intelligence that is a member of the generative pre-trained transformer of the large language model family. This text generative model was fine-tuned by both supervised learning and reinforcement…

Computation and Language · Computer Science 2023-06-06 Niful Islam , Debopom Sutradhar , Humaira Noor , Jarin Tasnim Raya , Monowara Tabassum Maisha , Dewan Md Farid

Developed by OpenAI, ChatGPT (Conditional Generative Pre-trained Transformer) is an artificial intelligence technology that is fine-tuned using supervised machine learning and reinforcement learning techniques, allowing a computer to…

ChatGPT is a natural language processing tool that can engage in human-like conversations and generate coherent and contextually relevant responses to various prompts. ChatGPT is capable of understanding natural text that is input by a user…

Human-Computer Interaction · Computer Science 2024-09-02 Sara Amani , Lance White , Trini Balart , Laksha Arora , Kristi J. Shryock , Kelly Brumbelow , Karan L. Watson

Recently, ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. Several prior studies have shown that ChatGPT attains remarkable generation ability compared with existing models.…

Computation and Language · Computer Science 2023-03-03 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

Unit testing is essential in detecting bugs in functionally-discrete program units. Manually writing high-quality unit tests is time-consuming and laborious. Although traditional techniques can generate tests with reasonable coverage, they…

Software Engineering · Computer Science 2024-05-21 Zhiqiang Yuan , Yiling Lou , Mingwei Liu , Shiji Ding , Kaixin Wang , Yixuan Chen , Xin Peng

ChatGPT has gained both positive and negative publicity after reports suggesting that it is able to pass various professional and licensing examinations. This suggests that ChatGPT may pass Turing Test in the near future. However, a…

Computation and Language · Computer Science 2023-04-26 Maurice HT Ling

Large language models (LLMs) have made significant progress in NLP. However, their ability to memorize, represent, and leverage commonsense knowledge has been a well-known pain point. In this paper, we specifically focus on ChatGPT, a…

Computation and Language · Computer Science 2024-04-22 Ning Bian , Xianpei Han , Le Sun , Hongyu Lin , Yaojie Lu , Ben He , Shanshan Jiang , Bin Dong

This report provides a preliminary evaluation of ChatGPT for machine translation, including translation prompt, multilingual translation, and translation robustness. We adopt the prompts advised by ChatGPT to trigger its translation ability…

Computation and Language · Computer Science 2023-11-03 Wenxiang Jiao , Wenxuan Wang , Jen-tse Huang , Xing Wang , Shuming Shi , Zhaopeng Tu

ChatGPT is an advanced natural language processing tool with growing applications across various disciplines in medical research. Thematic analysis, a qualitative research method to identify and interpret patterns in data, is one…

Computation and Language · Computer Science 2025-05-08 V Vien Lee , Stephanie C. C. van der Lubbe , Lay Hoon Goh , Jose M. Valderas

We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but…

Software Engineering · Computer Science 2024-03-26 Minaoar Hossain Tanzil , Junaed Younus Khan , Gias Uddin