English
Related papers

Related papers: Can AI Chatbots Pass the Fundamentals of Engineeri…

200 papers

Upon release, ChatGPT3.5 shocked the software engineering community by its ability to generate answers to specialized questions about coding. Immediately, many educators wondered if it was possible to use the chatbot as a support tool that…

Computers and Society · Computer Science 2024-11-27 Yaiza Aragonés-Soria , Julia Kotovich , Chitsutha Soomlek , Manuel Oriol

This work conducts a comprehensive exploration into the proficiency of OpenAI's ChatGPT-4 in sourcing scientific references within an array of research disciplines. Our in-depth analysis encompasses a wide scope of fields including Computer…

Digital Libraries · Computer Science 2023-06-19 Zhi Cao

Artificial intelligence-based chatbots are increasingly influencing physics education due to their ability to interpret and respond to textual and visual inputs. This study evaluates the performance of two large multimodal model-based…

Physics Education · Physics 2025-05-29 Giulia Polverini , Jakob Melin , Elias Onerud , Bor Gregorcic

In late 2022, OpenAI released a new version of ChatGPT, a sophisticated natural language processing system capable of holding natural conversations while preserving and responding to the context of the discussion. ChatGPT has exceeded…

Computers and Society · Computer Science 2023-07-04 Kamil Malinka , Martin Perešíni , Anton Firc , Ondřej Hujňák , Filip Januš

Artificial intelligence is gaining traction in more ways than ever before. The popularity of language models and AI-based businesses has soared since ChatGPT was made available to the general public via OpenAI. It is becoming increasingly…

Computers and Society · Computer Science 2023-07-31 Prabin Sharma , Kisan Thapa , Dikshya Thapa , Prastab Dhakal , Mala Deep Upadhaya , Santosh Adhikari , Salik Ram Khanal

Historical emphasis on writing mastery has shifted with advances in generative AI, especially in scientific writing. This study analysed six AI chatbots for scholarly writing in humanities and archaeology. Using methods that assessed…

Computation and Language · Computer Science 2023-10-17 Edisa Lozić , Benjamin Štular

The well-known artificial intelligence-based chatbot ChatGPT-4 has become able to process image data as input in October 2023. We investigated its performance on the Test of Understanding Graphs in Kinematics to inform the physics education…

Physics Education · Physics 2025-02-10 Giulia Polverini , Bor Gregorcic

The release of the large language model based chatbot ChatGPT in November 2022 has brought considerable attention to the subject of artificial intelligence, not only in the public. From the perspective of higher education, ChatGPT…

Computers and Society · Computer Science 2023-11-29 Nicolas Schwenke , Heinrich Söbke , Eckhard Kraft

The integration of Artificial Intelligence (AI) into education is a recent development, with chatbots emerging as a noteworthy addition to this transformative landscape. As online learning platforms rapidly advance, students need to adapt…

Human-Computer Interaction · Computer Science 2023-11-08 Md Rabiul Hasan , Nahian Ismail Chowdhury , Md Hadisur Rahman , Md Asif Bin Syed , JuHyeong Ryu

Although recent developments in generative AI have greatly enhanced the capabilities of conversational agents such as Google's Gemini (formerly Bard) or OpenAI's ChatGPT, it's unclear whether the usage of these agents aids users across…

Human-Computer Interaction · Computer Science 2024-04-03 Crystal Qian , James Wexler

ChatGPT is a state-of-the-art (SOTA) chatbot. Although it has potential to support English as a foreign language (EFL) students' writing, to effectively collaborate with it, a student must learn to engineer prompts, that is, the skill of…

Human-Computer Interaction · Computer Science 2025-06-05 David James Woo , Kai Guo , Hengky Susanto

This study evaluated three Artificial Intelligence (AI) large language model (LLM) enabled platforms - ChatGPT, BARD, and Bing AI - to answer an undergraduate finance exam with 20 quantitative questions across various difficulty levels.…

Econometrics · Economics 2023-08-22 Rama K. Malladi

ChatGPT is a publicly available chatbot that can quickly generate texts on given topics, but it is unknown whether the chatbot is really superior to human writers in all aspects of writing and whether its writing quality can be prominently…

Computation and Language · Computer Science 2023-03-22 Tongquan Zhou , Siyi Cao , Siruo Zhou , Yao Zhang , Aijing He

This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. The emergence of ChatGPT resulted in heated debates…

Computers and Society · Computer Science 2023-10-05 Jaromir Savelka , Arav Agarwal , Marshall An , Chris Bogart , Majd Sakr

The study explores the capabilities of OpenAI's ChatGPT in solving different types of physics problems. ChatGPT (with GPT-4) was queried to solve a total of 40 problems from a college-level engineering physics course. These problems ranged…

Artificial Intelligence · Computer Science 2023-10-31 Karen D. Wang , Eric Burkholder , Carl Wieman , Shima Salehi , Nick Haber

The rise of Artificial Intelligence (AI) technology and its impact on education has been a topic of growing concern in recent years. The new generation AI systems such as chatbots have become more accessible on the Internet and stronger in…

Artificial Intelligence · Computer Science 2023-02-10 Mohammad Khalil , Erkan Er

Context: ChatGPT and other large language models (LLMs) are widely used across healthcare, business, economics, engineering, and software engineering (SE). Despite their popularity, concerns persist about their reliability, especially their…

Software Engineering · Computer Science 2025-04-29 Vahid Garousi

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

This paper presents the second ChatGPT4PCG competition at the 2024 IEEE Conference on Games. In this edition of the competition, we follow the first edition, but make several improvements and changes. We introduce a new evaluation metric…

This research explores the quickly changing field of generative artificial intelligence (GAI) chatbots in higher education, an industry that is undergoing major technological changes. AI chatbots, such as ChatGPT, HuggingChat, and Google…

Computers and Society · Computer Science 2024-05-14 Joshua Ebere Chukwuere