English
Related papers

Related papers: Using ChatGPT as a Static Application Security Tes…

200 papers

Early identification of security issues in software development is vital to minimize their unanticipated impacts. Code review is a widely used manual analysis method that aims to uncover security issues along with other coding issues in…

Software Engineering · Computer Science 2024-07-18 Wachiraphan Charoenwet , Patanamon Thongtanunam , Van-Thuan Pham , Christoph Treude

This study evaluated the ability of ChatGPT, a recently developed artificial intelligence (AI) agent, to perform high-level cognitive tasks and produce text that is indistinguishable from human-generated text. This capacity raises concerns…

Artificial Intelligence · Computer Science 2022-12-20 Teo Susnjak

ChatGPT has changed the AI community and an active research line is the performance evaluation of ChatGPT. A key challenge for the evaluation is that ChatGPT is still closed-source and traditional benchmark datasets may have been used by…

Computation and Language · Computer Science 2024-05-13 Ming Liu , Ran Liu , Ye Zhu , Hua Wang , Youyang Qu , Rongsheng Li , Yongpan Sheng , Wray Buntine

This is the study that presents an AI-Python-based chatbot that helps students to learn programming by demonstrating solutions to such problems as debugging errors, solving syntax problems or converting abstract theoretical concepts to…

Software Engineering · Computer Science 2025-09-26 Sayed Mahbub Hasan Amiri , Md Mainul Islam

To support software developers in finding and fixing software bugs, several automated program repair techniques have been introduced. Given a test suite, standard methods usually either synthesize a repair, or navigate a search space of…

Software Engineering · Computer Science 2023-01-23 Dominik Sobania , Martin Briesch , Carol Hanna , Justyna Petke

LLM models are increasingly used to generate code, but the quality and security of this code are often uncertain. Several recent studies have raised alarm bells, indicating that such AI-generated code may be particularly vulnerable to…

Cryptography and Security · Computer Science 2025-12-05 Kobra Khanmohammadi , Pooria Roy , Raphael Khoury , Abdelwahab Hamou-Lhadj , Wilfried Patrick Konan

The conversational artificial-intelligence (AI) technology ChatGPT has become one of the most widely used natural language processing tools. With thousands of published papers demonstrating its applications across various industries and…

Computers and Society · Computer Science 2023-05-30 Irene S. Gabashvili

ChatGPT has recently emerged as a powerful tool for performing diverse NLP tasks. However, ChatGPT has been criticized for generating nonfactual responses, raising concerns about its usability for sensitive tasks like fact verification.…

Information Retrieval · Computer Science 2023-11-14 Mohna Chakraborty , Adithya Kulkarni , Qi Li

ChatGPT is an advanced natural language processing tool with growing applications across various disciplines in medical research. Thematic analysis, a qualitative research method to identify and interpret patterns in data, is one…

Computation and Language · Computer Science 2025-05-08 V Vien Lee , Stephanie C. C. van der Lubbe , Lay Hoon Goh , Jose M. Valderas

Large Language Models (LLMs) are increasingly used in software security, but their trustworthiness in generating accurate vulnerability advisories remains uncertain. This study investigates the ability of ChatGPT to (1) generate plausible…

Cryptography and Security · Computer Science 2025-06-17 Bayu Fedra Abdullah , Yusuf Sulistyo Nugroho , Brittany Reid , Raula Gaikovina Kula , Kazumasa Shimari , Kenichi Matsumoto

Sonatype's 2023 report found that 97% of developers and security leads integrate generative Artificial Intelligence (AI), particularly Large Language Models (LLMs), into their development process. Concerns about the security implications of…

Software Engineering · Computer Science 2025-07-24 Sivana Hamer , Marcelo d'Amorim , Laurie Williams

Pretrained Language Models (PLMs) harbor inherent social biases that can result in harmful real-world implications. Such social biases are measured through the probability values that PLMs output for different social groups and attributes…

Computation and Language · Computer Science 2023-12-07 Rafal Kocielnik , Shrimai Prabhumoye , Vivian Zhang , Roy Jiang , R. Michael Alvarez , Anima Anandkumar

The increasing trend of using Large Language Models (LLMs) for code generation raises the question of their capability to generate trustworthy code. While many researchers are exploring the utility of code generation for uncovering software…

Cryptography and Security · Computer Science 2024-04-08 Zahra Mousavi , Chadni Islam , Kristen Moore , Alsharif Abuadbba , Muhammad Ali Babar

Email continues to be a pivotal and extensively utilized communication medium within professional and commercial domains. Nonetheless, the prevalence of spam emails poses a significant challenge for users, disrupting their daily routines…

Computation and Language · Computer Science 2025-02-13 Shijing Si , Yuwei Wu , Le Tang , Yugui Zhang , Jedrek Wosik , Qinliang Su

ChatGPT is a large language model recently released by the OpenAI company. In this technical report, we explore for the first time the capability of ChatGPT for programming numerical algorithms. Specifically, we examine the capability of…

Machine Learning · Computer Science 2023-04-28 Ali Kashefi , Tapan Mukerji

Since its launch in November 2022, ChatGPT has gained popularity among users, especially programmers who use it as a tool to solve development problems. However, while offering a practical solution to programming problems, ChatGPT should be…

Software Engineering · Computer Science 2023-08-08 Phuong T. Nguyen , Juri Di Rocco , Claudio Di Sipio , Riccardo Rubei , Davide Di Ruscio , Massimiliano Di Penta

ChatGPT is a natural language processing tool that can engage in human-like conversations and generate coherent and contextually relevant responses to various prompts. ChatGPT is capable of understanding natural text that is input by a user…

Human-Computer Interaction · Computer Science 2024-09-02 Sara Amani , Lance White , Trini Balart , Laksha Arora , Kristi J. Shryock , Kelly Brumbelow , Karan L. Watson

The ability of ChatGPT to generate human-like responses and understand context has made it a popular tool for conversational agents, content creation, data analysis, and research and innovation. However, its effectiveness and ease of…

Cryptography and Security · Computer Science 2023-05-10 Sayak Saha Roy , Krishna Vamsi Naragam , Shirin Nilizadeh

It is quite common for security testing to be delayed until after the software has been developed, but vulnerabilities may get noticed throughout the implementation phase and the earlier they are discovered, the easier and cheaper it will…

Software Engineering · Computer Science 2018-05-25 Rahma Mahmood , Qusay H. Mahmoud

The use of Artificial Intelligence (AI) to support cybersecurity operations is now a consolidated practice, e.g., to detect malicious code or configure traffic filtering policies. The recent surge of AI, generative techniques and frameworks…

Cryptography and Security · Computer Science 2023-03-27 Enrico Cambiaso , Luca Caviglione