English
Related papers

Related papers: Exploring ChatGPT's Capabilities on Vulnerability …

200 papers

The performance of text summarization has been greatly boosted by pre-trained language models. A main concern of existing methods is that most generated summaries are not factually inconsistent with their source documents. To alleviate the…

Computation and Language · Computer Science 2023-04-14 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Large Language Models (LLMs) have gained significant attention in the software engineering community. Nowadays developers have the possibility to exploit these models through industrial-grade tools providing a handy interface toward LLMs,…

Software Engineering · Computer Science 2024-02-27 Rosalia Tufano , Antonio Mastropaolo , Federica Pepe , Ozren Dabić , Massimiliano Di Penta , Gabriele Bavota

With the rise of foundation models, a new artificial intelligence paradigm has emerged, by simply using general purpose foundation models with prompting to solve problems instead of training a separate machine learning model for each…

Artificial Intelligence · Computer Science 2023-08-29 Mostafa M. Amin , Rui Mao , Erik Cambria , Björn W. Schuller

ChatGPT has the ability to generate grammatically flawless and seemingly-human replies to different types of questions from various domains. The number of its users and of its applications is growing at an unprecedented rate. Unfortunately,…

Computation and Language · Computer Science 2023-02-01 Sandra Mitrović , Davide Andreoletti , Omran Ayoub

In recent years, large language models (LLMs), such as ChatGPT, have been pivotal in advancing various artificial intelligence applications, including natural language processing and software engineering. A promising yet underexplored area…

Software Engineering · Computer Science 2024-01-26 Hiroyuki Kirinuki , Haruto Tanno

In November 2022, OpenAI has introduced ChatGPT, a chatbot based on supervised and reinforcement learning. Not only can it answer questions emulating human-like responses, but it can also generate code from scratch or complete coding…

Human-Computer Interaction · Computer Science 2024-02-01 Dan-Matei Popovici

Unit testing is essential in detecting bugs in functionally-discrete program units. Manually writing high-quality unit tests is time-consuming and laborious. Although traditional techniques can generate tests with reasonable coverage, they…

Software Engineering · Computer Science 2024-05-21 Zhiqiang Yuan , Yiling Lou , Mingwei Liu , Shiji Ding , Kaixin Wang , Yixuan Chen , Xin Peng

ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: (1) the inflexibility of…

Computation and Language · Computer Science 2023-09-20 Yucheng Shi , Hehuan Ma , Wenliang Zhong , Qiaoyu Tan , Gengchen Mai , Xiang Li , Tianming Liu , Junzhou Huang

Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great…

Computation and Language · Computer Science 2023-10-24 Arslan Akram

Since the launch of ChatGPT in 2022, an increasing number of ChatGPT-related projects are being published on GitHub, sparking widespread discussions. However, GitHub does not provide a detailed classification of these projects to help users…

Software Engineering · Computer Science 2024-08-13 Zheng Lin , Neng Zhang , Chao Liu , Zibin Zheng

Understanding how users authentically interact with Large Language Models (LLMs) remains a significant challenge in human-computer interaction research. Most existing studies rely on self-reported usage patterns or controlled experimental…

Computers and Society · Computer Science 2025-09-18 Kalyani Khona

Chatbots shifted from rule-based to artificial intelligence techniques and gained traction in medicine, shopping, customer services, food delivery, education, and research. OpenAI developed ChatGPT blizzard on the Internet as it crossed one…

Cryptography and Security · Computer Science 2023-06-16 Attia Qammar , Hongmei Wang , Jianguo Ding , Abdenacer Naouri , Mahmoud Daneshmand , Huansheng Ning

Recent advancements in Large Language Models (LLMs) have demonstrated significant potential across a wide range of software engineering tasks, including software design, an area traditionally regarded as highly dependent on human expertise…

Software Engineering · Computer Science 2026-05-05 Yifei Wang , Ruiyin Li , Peng Liang , Yangxiao Cai , Zengyang Li , Mojtaba Shahin , Arif Ali Khan , Qiong Feng

Question-and-answer agents like ChatGPT offer a novel tool for use as a potential honeypot interface in cyber security. By imitating Linux, Mac, and Windows terminal commands and providing an interface for TeamViewer, nmap, and ping, it is…

Cryptography and Security · Computer Science 2023-01-11 Forrest McKee , David Noever

In the life-cycle of software development, testing plays a crucial role in quality assurance. Proper testing not only increases code coverage and prevents regressions but it can also ensure that any potential vulnerabilities in the software…

Software Engineering · Computer Science 2025-06-16 Gábor Antal , Dénes Bán , Martin Isztin , Rudolf Ferenc , Péter Hegedűs

ChatGPT is a recent chatbot service released by OpenAI and is receiving increasing attention over the past few months. While evaluations of various aspects of ChatGPT have been done, its robustness, i.e., the performance to unexpected…

Artificial Intelligence · Computer Science 2023-08-30 Jindong Wang , Xixu Hu , Wenxin Hou , Hao Chen , Runkai Zheng , Yidong Wang , Linyi Yang , Haojun Huang , Wei Ye , Xiubo Geng , Binxin Jiao , Yue Zhang , Xing Xie

ChatGPT has been used in several educational contexts,including learning, teaching and research. It also has potential to conduct the systematic literature review (SLR). However, there are limited empirical studies on how to use ChatGPT in…

Artificial Intelligence · Computer Science 2024-09-27 Qian Huang , Qiyun Wang

ChatGPT has garnered significant interest due to its impressive performance; however, there is growing concern about its potential risks, particularly in the detection of AI-generated content (AIGC), which is often challenging for untrained…

Computation and Language · Computer Science 2024-10-10 Zhenpeng Su , Xing Wu , Wei Zhou , Guangyuan Ma , Songlin Hu

Artificial Intelligence has demonstrated its significance in software engineering through notable improvements in productivity, accuracy, collaboration, and learning outcomes. This study examines the impact of generative AI tools,…

Software Engineering · Computer Science 2024-02-23 Muhammad Waseem , Teerath Das , Aakash Ahmad , Peng Liang , Mahdi Fehmideh , Tommi Mikkonen

Purpose: Assess whether ChatGPT 4.0 is accurate enough to perform research evaluations on journal articles to automate this time-consuming task. Design/methodology/approach: Test the extent to which ChatGPT-4 can assess the quality of…

Digital Libraries · Computer Science 2024-05-01 Mike Thelwall