English
Related papers

Related papers: Fight Fire with Fire: How Much Can We Trust ChatGP…

200 papers

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

ChatGPT and other large language models (LLMs) promise to revolutionize software development by automatically generating code from program specifications. We assess the performance of ChatGPT's GPT-3.5-turbo model on LeetCode, a popular…

Software Engineering · Computer Science 2024-11-13 Minda Li , Bhaskar Krishnamachari

Background: The integration of artificial intelligence (AI) into daily life, particularly through chatbots utilizing natural language processing (NLP), presents both revolutionary potential and unique challenges. This intended to…

Computation and Language · Computer Science 2024-04-16 Gian Alexandre Michaelsen , Renato P. dos Santos

Hate speech is a severe issue that affects many online platforms. So far, several studies have been performed to develop robust hate speech detection systems. Large language models like ChatGPT have recently shown a great promise in…

Computation and Language · Computer Science 2023-05-24 Mithun Das , Saurabh Kumar Pandey , Animesh Mukherjee

Stack Overflow and other similar forums are used commonly by developers to seek answers for their software development as well as privacy-related concerns. Recently, ChatGPT has been used as an alternative to generate code or produce…

Software Engineering · Computer Science 2024-06-13 Zack Delile , Sean Radel , Joe Godinez , Garrett Engstrom , Theo Brucker , Kenzie Young , Sepideh Ghanavati

ChatGPT is a generative pretrained transformer language model created using artificial intelligence implemented as chatbot which can provide very detailed responses to a wide variety of questions. As a very contemporary phenomenon, this…

Cryptography and Security · Computer Science 2023-07-14 Sheetal Temara

I shall quantify the logical faults generated by ChatGPT when applied to reasoning tasks. For experiments, I use the 144 puzzles from the library \url{https://users.utcluj.ro/~agroza/puzzles/maloga}~\cite{groza:fol}. The library contains…

Artificial Intelligence · Computer Science 2023-10-11 Adrian Groza

Generative AI systems such as ChatGPT have a disruptive effect on learning and assessment. Computer science requires practice to develop skills in problem solving and programming that are traditionally developed using assignments.…

Computers and Society · Computer Science 2023-11-29 Kevin Wang , Seth Akins , Abdallah Mohammed , Ramon Lawrence

This study explores the capabilities of Large Language Models, particularly OpenAI's ChatGPT, in addressing the challenges associated with software modeling, explicitly focusing on the bidirectional traceability problem between design…

Software Engineering · Computer Science 2023-10-11 Hideyuki Kanuka , Genta Koreki , Ryo Soga , Kazu Nishikawa

As artificial intelligence technology continues to advance, chatbots are becoming increasingly powerful. Among them, ChatGPT, launched by OpenAI, has garnered widespread attention globally due to its powerful natural language processing…

Cryptography and Security · Computer Science 2026-02-03 Yushan Xiang , Zhongwen Li , Xiaoqi Li

Large language models (LLMs) have undergone rapid evolution and achieved remarkable results in recent times. OpenAI's ChatGPT, backed by GPT-3.5 or GPT-4, has gained instant popularity due to its strong capability across a wide range of…

Cryptography and Security · Computer Science 2023-12-12 Fangzhou Wu , Qingzhao Zhang , Ati Priya Bajaj , Tiffany Bao , Ning Zhang , Ruoyu "Fish" Wang , Chaowei Xiao

ChatGPT has gained a huge popularity since its introduction. Its positive aspects have been reported through many media platforms, and some analyses even showed that ChatGPT achieved a decent grade in professional exams, adding extra…

Computation and Language · Computer Science 2023-11-15 Myeongjun Erik Jang , Thomas Lukasiewicz

Source code identifiers often contain abbreviations. Such abbreviations may reduce the readability of the source code, which in turn hinders the maintenance of the software applications. To this end, accurate and automated approaches to…

Software Engineering · Computer Science 2024-11-01 Yanjie Jiang , Hui Liu , Lu Zhang

Prompt design plays a crucial role in shaping the efficacy of ChatGPT, influencing the model's ability to extract contextually accurate responses. Thus, optimal prompt construction is essential for maximizing the utility and performance of…

Software Engineering · Computer Science 2024-02-08 Saikat Mondal , Suborno Deb Bappon , Chanchal K. Roy

Code reviews are central for software quality assurance. Ideally, reviewers should explain their feedback to enable authors of code changes to understand the feedback and act accordingly. Different developers might need different…

Software Engineering · Computer Science 2024-10-11 Ratnadira Widyasari , Ting Zhang , Abir Bouraffa , Walid Maalej , David Lo

Q&A platforms have been crucial for the online help-seeking behavior of programmers. However, the recent popularity of ChatGPT is altering this trend. Despite this popularity, no comprehensive study has been conducted to evaluate the…

Software Engineering · Computer Science 2024-05-22 Samia Kabir , David N. Udo-Imeh , Bonan Kou , Tianyi Zhang

Large language models such as ChatGPT have the potential to revolutionize the construction industry by automating repetitive and time-consuming tasks. This paper presents a study in which ChatGPT was used to generate a construction schedule…

Human-Computer Interaction · Computer Science 2023-07-21 Samuel A. Prieto , Eyob T. Mengiste , Borja García de Soto

ChatGPT, an AI-based chatbot, was released to provide coherent and useful replies based on analysis of large volumes of data. In this article, leading scientists, researchers and engineers discuss the transformative effects of ChatGPT on…

Generating unit tests is a crucial task in software development, demanding substantial time and effort from programmers. The advent of Large Language Models (LLMs) introduces a novel avenue for unit test script generation. This research…

Software Engineering · Computer Science 2024-02-14 Shreya Bhatia , Tarushi Gandhi , Dhruv Kumar , Pankaj Jalote