English
Related papers

Related papers: From Code to Compliance: Assessing ChatGPT's Utili…

200 papers

Prompt engineering reduces reasoning mistakes in Large Language Models (LLMs). However, its effectiveness in mitigating vulnerabilities in LLM-generated code remains underexplored. To address this gap, we implemented a benchmark to…

Software Engineering · Computer Science 2025-02-11 Marc Bruni , Fabio Gabrielli , Mohammad Ghafari , Martin Kropp

Addressing the global challenge of breast cancer, this research explores the fusion of generative AI, focusing on ChatGPT 3.5 turbo model, and the intricacies of breast cancer risk assessment. The research aims to evaluate ChatGPT's…

Computation and Language · Computer Science 2024-06-04 Yousef Khan , Ahmed Abdeen Hamed

Despite the success of ChatGPT, its performances on most NLP tasks are still well below the supervised baselines. In this work, we looked into the causes, and discovered that its subpar performance was caused by the following factors: (1)…

Computation and Language · Computer Science 2023-10-10 Xiaofei Sun , Linfeng Dong , Xiaoya Li , Zhen Wan , Shuhe Wang , Tianwei Zhang , Jiwei Li , Fei Cheng , Lingjuan Lyu , Fei Wu , Guoyin Wang

ChatGPT is currently the most popular large language model (LLM), with over 100 million users, making a significant impact on people's lives. However, due to the presence of jailbreak vulnerabilities, ChatGPT might have negative effects on…

Software Engineering · Computer Science 2023-12-19 Poorna Chander Reddy Puttaparthi , Soham Sanjay Deo , Hakan Gul , Yiming Tang , Weiyi Shang , Zhe Yu

The integration of Large Language Models (LLMs) into interactive systems opens new opportunities for adaptive user experiences, yet it also raises challenges regarding accessibility, explainability, and normative compliance. This paper…

Human-Computer Interaction · Computer Science 2026-01-13 Blessing Jerry , Lourdes Moreno , Virginia Francisco , Raquel Hervas

ChatGPT has been increasingly used in computer science, offering efficient support across software development tasks. While it helps students navigate programming challenges, its use also raises concerns about academic integrity and…

Software Engineering · Computer Science 2025-11-19 Daihan Xu , Diana Martin

Large language models (LLMs), such as ChatGPT and Copilot, are transforming software development by automating code generation and, arguably, enable rapid prototyping, support education, and boost productivity. Therefore, correctness and…

Software Engineering · Computer Science 2024-08-30 Robin Beer , Alexander Feix , Tim Guttzeit , Tamara Muras , Vincent Müller , Maurice Rauscher , Florian Schäffler , Welf Löwe

Code reviews are an integral part of software development and have been recognized as a crucial practice for minimizing bugs and favouring higher code quality. They serve as an important checkpoint before committing code and play an…

Software Engineering · Computer Science 2024-12-05 Genevieve Caumartin , Qiaolin Qin , Sharon Chatragadda , Janmitsinh Panjrolia , Heng Li , Diego Elias Costa

Computer programming is a fundamental tool for life scientists, allowing them to carry out many essential research tasks. However, despite a variety of educational efforts, learning to write code can be a challenging endeavor for both…

Other Quantitative Biology · Quantitative Biology 2024-01-02 Stephen R. Piccolo , Paul Denny , Andrew Luxton-Reilly , Samuel Payne , Perry G. Ridge

This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. The emergence of ChatGPT resulted in heated debates…

Computers and Society · Computer Science 2023-10-05 Jaromir Savelka , Arav Agarwal , Marshall An , Chris Bogart , Majd Sakr

The rapid evolution of Web UI incurs time and effort in UI test maintenance. Prior techniques in Web UI test repair focus on locating the target elements on the new Webpage that match the old ones so that the corresponding broken statements…

Software Engineering · Computer Science 2025-01-23 Zhuolin Xu , Qiushi Li , Shin Hwei Tan

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

Computation and Language · Computer Science 2025-09-15 Jing Ren , Weiqi Wang

This bachelor's thesis examines the capabilities of ChatGPT 4 in code generation across 19 programming languages. The study analyzed solution rates across three difficulty levels, types of errors encountered, and code quality in terms of…

Software Engineering · Computer Science 2025-01-07 L. C. Gilbert

Low-code applications are gaining popularity across various fields, enabling non-developers to participate in the software development process. However, due to the strong reliance on graphical user interfaces, they may unintentionally…

Software Engineering · Computer Science 2025-08-11 Mohammadali Mohammadkhani , Sara Zahedi Movahed , Hourieh Khalajzadeh , Mojtaba Shahin , Khuong Tran Hoang

Using large language models (LLMs) for source code has recently gained attention. LLMs, such as Transformer-based models like Codex and ChatGPT, have been shown to be highly capable of solving a wide range of programming problems. However,…

Computation and Language · Computer Science 2023-06-27 Atsushi Shirafuji , Yutaka Watanobe , Takumi Ito , Makoto Morishita , Yuki Nakamura , Yusuke Oda , Jun Suzuki

This paper introduces DevGPT, a dataset curated to explore how software developers interact with ChatGPT, a prominent large language model (LLM). The dataset encompasses 29,778 prompts and responses from ChatGPT, including 19,106 code…

Software Engineering · Computer Science 2024-02-15 Tao Xiao , Christoph Treude , Hideaki Hata , Kenichi Matsumoto

Ensuring web accessibility is crucial for advancing social welfare, justice, and equality in digital spaces, yet the vast majority of website user interfaces remain non-compliant, due in part to the resource-intensive and unscalable nature…

Artificial Intelligence · Computer Science 2025-11-06 Ming Gu , Ziwei Wang , Sicen Lai , Zirui Gao , Sheng Zhou , Jiajun Bu

ChatGPT is a state-of-the-art (SOTA) chatbot. Although it has potential to support English as a foreign language (EFL) students' writing, to effectively collaborate with it, a student must learn to engineer prompts, that is, the skill of…

Human-Computer Interaction · Computer Science 2025-06-05 David James Woo , Kai Guo , Hengky Susanto

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

Cryptography and Security · Computer Science 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos

In recent years, large language models (LLMs), such as ChatGPT, have been pivotal in advancing various artificial intelligence applications, including natural language processing and software engineering. A promising yet underexplored area…

Software Engineering · Computer Science 2024-01-26 Hiroyuki Kirinuki , Haruto Tanno