English
Related papers

Related papers: ChatGPT Participates in a Computer Science Exam

200 papers

This study aimed to determine if ChatGPT's large language models could match the scoring accuracy of human and machine scores from the ASAP competition. The investigation focused on various prediction models, including linear regression,…

Computation and Language · Computer Science 2024-08-20 Mark D. Shermis

Tools that can generate computer code in response to inputs written in natural language, such as ChatGPT, pose an existential threat to Computer Science education in its current form, since students can now use these tools to solve…

Computers and Society · Computer Science 2025-07-10 Kaléu Delphino

AI assistants are being increasingly used by students enrolled in higher education institutions. While these tools provide opportunities for improved teaching and education, they also pose significant challenges for assessment and learning…

Computers and Society · Computer Science 2024-11-28 Beatriz Borges , Negar Foroutan , Deniz Bayazit , Anna Sotnikova , Syrielle Montariol , Tanya Nazaretzky , Mohammadreza Banaei , Alireza Sakhaeirad , Philippe Servant , Seyed Parsa Neshaei , Jibril Frej , Angelika Romanou , Gail Weiss , Sepideh Mamooler , Zeming Chen , Simin Fan , Silin Gao , Mete Ismayilzada , Debjit Paul , Alexandre Schöpfer , Andrej Janchevski , Anja Tiede , Clarence Linden , Emanuele Troiani , Francesco Salvi , Freya Behrens , Giacomo Orsi , Giovanni Piccioli , Hadrien Sevel , Louis Coulon , Manuela Pineros-Rodriguez , Marin Bonnassies , Pierre Hellich , Puck van Gerwen , Sankalp Gambhir , Solal Pirelli , Thomas Blanchard , Timothée Callens , Toni Abi Aoun , Yannick Calvino Alonso , Yuri Cho , Alberto Chiappa , Antonio Sclocchi , Étienne Bruno , Florian Hofhammer , Gabriel Pescia , Geovani Rizk , Leello Dadi , Lucas Stoffl , Manoel Horta Ribeiro , Matthieu Bovel , Yueyang Pan , Aleksandra Radenovic , Alexandre Alahi , Alexander Mathis , Anne-Florence Bitbol , Boi Faltings , Cécile Hébert , Devis Tuia , François Maréchal , George Candea , Giuseppe Carleo , Jean-Cédric Chappelier , Nicolas Flammarion , Jean-Marie Fürbringer , Jean-Philippe Pellet , Karl Aberer , Lenka Zdeborová , Marcel Salathé , Martin Jaggi , Martin Rajman , Mathias Payer , Matthieu Wyart , Michael Gastpar , Michele Ceriotti , Ola Svensson , Olivier Lévêque , Paolo Ienne , Rachid Guerraoui , Robert West , Sanidhya Kashyap , Valerio Piazza , Viesturs Simanis , Viktor Kuncak , Volkan Cevher , Philippe Schwaller , Sacha Friedli , Patrick Jermann , Tanja Käser , Antoine Bosselut

We evaluated ChatGPT 3.5, 4, and 4 with Code Interpreter on a set of college-level engineering-math and electromagnetism problems, such as those often given to sophomore electrical engineering majors. We selected a set of 13 problems, and…

Artificial Intelligence · Computer Science 2023-09-19 Tanuj Kumar , Mikhail A. Kats

In late 2022, OpenAI released a new version of ChatGPT, a sophisticated natural language processing system capable of holding natural conversations while preserving and responding to the context of the discussion. ChatGPT has exceeded…

Computers and Society · Computer Science 2023-07-04 Kamil Malinka , Martin Perešíni , Anton Firc , Ondřej Hujňák , Filip Januš

ChatGPT is a powerful language model from OpenAI that is arguably able to comprehend and generate text. ChatGPT is expected to have a large impact on society, research, and education. An essential step to understand ChatGPT's expected…

Human-Computer Interaction · Computer Science 2023-09-20 Lukas Schulze Balhorn , Jana M. Weber , Stefan Buijsman , Julian R. Hildebrandt , Martina Ziefle , Artur M. Schweidtmann

Purpose: Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task. Design/methodology/approach: Test the extent to which ChatGPT-4 can assess the quality of…

Digital Libraries · Computer Science 2024-05-01 Mike Thelwall

This study explores the problem solving capabilities of ChatGPT and its prospective applications in standardized test preparation, focusing on the GRE quantitative exam. Prior research has shown great potential for the utilization of…

Computers and Society · Computer Science 2023-09-27 Umer Farooq , Saira Anwar

Large language models such as ChatGPT are increasingly explored in medical domains. However, the absence of standard guidelines for performance evaluation has led to methodological inconsistencies. This study aims to summarize the available…

Methodology · Statistics 2024-03-12 Qiuhong Wei , Zhengxiong Yao , Ying Cui , Bo Wei , Zhezhen Jin , Ximing Xu

In this paper, we assess the efficacy of ChatGPT (version Feb 2023), a large-scale language model, in solving probability problems typically presented in introductory computer engineering exams. Our study comprised a set of 23 probability…

ChatGPT is a groundbreaking ``chatbot"--an AI interface built on a large language model that was trained on an enormous corpus of human text to emulate human conversation. Beyond its ability to converse in a plausible way, it has attracted…

Physics Education · Physics 2023-03-28 Colin G. West

AI-powered education technologies can support students and teachers in computer science education. However, with the recent developments in generative AI, and especially the increasingly emerging popularity of ChatGPT, the effectiveness of…

Artificial Intelligence · Computer Science 2023-12-05 Nora Dunder , Saga Lundborg , Olga Viberg , Jacqueline Wong

This research paper presents an analysis of how well three artificial intelligence chatbots: Bing, ChatGPT, and GPT-4, perform when answering questions from standardized tests. The Graduate Record Examination is used in this paper as a case…

Computation and Language · Computer Science 2024-04-09 Mohammad Abu-Haifa , Bara'a Etawi , Huthaifa Alkhatatbeh , Ayman Ababneh

Large language models such as ChatGPT-3.5 and GPT-4.0 are ubiquitous and dominate the current discourse. Their transformative capabilities have led to a paradigm shift in how we interact with and utilize (text-based) information. Each day,…

Computers and Society · Computer Science 2023-08-07 Tim Krüger , Michael Gref

This study evaluates the efficacy of ChatGPT as an AI teaching and learning support tool in an integrated circuit systems course at a higher education institution in an Asian country. Various question types were completed, and ChatGPT…

Computers and Society · Computer Science 2023-11-03 Thanh Nguyen Ngoc , Quang Nhat Tran , Arthur Tang , Bao Nguyen , Thuy Nguyen , Thanh Pham

This study explores the integration and impact of ChatGPT, a generative AI that utilizes natural language processing, in an educational environment. The main goal is to evaluate how ChatGPT affects project performance. To this end, we…

Computers and Society · Computer Science 2024-09-09 Sunhee Hwang , Yudoo Kim , Heejin Lee

In recent years, advancements in artificial intelligence (AI) have led to the development of large language models like GPT-4, demonstrating potential applications in various fields, including education. This study investigates the…

Computers and Society · Computer Science 2023-04-25 Vinay Pursnani , Yusuf Sermet , Ibrahim Demir

ChatGPT has been increasingly used in computer science, offering efficient support across software development tasks. While it helps students navigate programming challenges, its use also raises concerns about academic integrity and…

Software Engineering · Computer Science 2025-11-19 Daihan Xu , Diana Martin

The potential of ChatGPT to transform the education landscape is drawing increasing attention. With its translation-related capabilities being tested and examined, ChatGPT presents both opportunities and challenges for translation training.…

Human-Computer Interaction · Computer Science 2024-06-11 Lulu Wang , Simin Xu , Kanglong Liu