English
Related papers

Related papers: A Qualitative Study on Using ChatGPT for Software …

200 papers

The widespread availability of large language models (LLMs), such as ChatGPT, has significantly impacted education, raising both opportunities and challenges. Students can frequently interact with LLM-powered, interactive learning tools,…

Artificial Intelligence · Computer Science 2026-03-06 Hunter McNichols , Fareya Ikram , Andrew Lan

Large language models (LLM) are perceived to offer promising potentials for automating security tasks, such as those found in security operation centers (SOCs). As a first step towards evaluating this perceived potential, we investigate the…

Cryptography and Security · Computer Science 2024-02-01 Kumar Shashwat , Francis Hahn , Xinming Ou , Dmitry Goldgof , Lawrence Hall , Jay Ligatti , S. Raj Rajgopalan , Armin Ziaie Tabari

In this study, we evaluated the capability of Large Language Models (LLMs), particularly OpenAI's GPT-4, in detecting software vulnerabilities, comparing their performance against traditional static code analyzers like Snyk and Fortify. Our…

Software Engineering · Computer Science 2023-08-22 David Noever

Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great…

Computation and Language · Computer Science 2023-10-24 Arslan Akram

Cybersecurity breaches targeting electrical substations constitute a significant threat to the integrity of the power grid, necessitating comprehensive defense and mitigation strategies. Any anomaly in information and communication…

Cryptography and Security · Computer Science 2024-02-27 Aydin Zaboli , Seong Lok Choi , Tai-Jin Song , Junho Hong

The generative Artificial Intelligence (AI) tools based on Large Language Models (LLMs) use billions of parameters to extensively analyse large datasets and extract critical private information such as, context, specific details,…

Cryptography and Security · Computer Science 2023-10-20 Imdad Ullah , Najm Hassan , Sukhpal Singh Gill , Basem Suleiman , Tariq Ahamed Ahanger , Zawar Shah , Junaid Qadir , Salil S. Kanhere

Despite being introduced only a few years ago, Large Language Models (LLMs) are already widely used by developers for code generation. However, their application in automating other Software Engineering activities remains largely…

Software Engineering · Computer Science 2024-09-27 Aylton Almeida , Laerte Xavier , Marco Tulio Valente

This research article critically examines the potential risks and implications arising from the malicious utilization of large language models(LLM), focusing specifically on ChatGPT and Google's Bard. Although these large language models…

Cryptography and Security · Computer Science 2023-05-25 P. V. Sai Charan , Hrushikesh Chunduri , P. Mohan Anand , Sandeep K Shukla

The control of complex laboratory instrumentation often requires significant programming expertise, creating a barrier for researchers lacking computational skills. This work explores the potential of large language models (LLMs), such as…

Artificial Intelligence · Computer Science 2026-04-07 Yong Xie , Kexin He , Andres Castellanos-Gomez

Large Language Models (LLMs) such as ChatGPT can infer personal attributes from seemingly innocuous text, raising privacy risks beyond memorized data leakage. While prior work has demonstrated these risks, little is known about how users…

Human-Computer Interaction · Computer Science 2025-09-16 Synthia Wang , Sai Teja Peddinti , Nina Taft , Nick Feamster

ChatGPT is a type of artificial intelligence language model that uses deep learning algorithms to generate human-like responses to text-based prompts. The introduction of the latest ChatGPT version in November of 2022 has caused shockwaves…

Computers and Society · Computer Science 2023-05-02 Mohammad Fraiwan , Natheer Khasawneh

Large language models (LLMs) are increasingly used for analytical tasks, yet their effectiveness in real-world applications remains underexamined, partly due to the opacity of proprietary models. We evaluate ChatGPT (GPT-3.5 and GPT-4) on…

Human-Computer Interaction · Computer Science 2026-03-25 Jonas Oppenlaender , Joonas Hämäläinen

Recently, Automated Vulnerability Localization (AVL) has attracted growing attention, aiming to facilitate diagnosis by pinpointing the specific lines of code responsible for vulnerabilities. Large Language Models (LLMs) have shown…

Software Engineering · Computer Science 2025-12-29 Jian Zhang , Chong Wang , Anran Li , Weisong Sun , Cen Zhang , Wei Ma , Yang Liu

The increasing frequency of attacks on Android applications coupled with the recent popularity of large language models (LLMs) necessitates a comprehensive understanding of the capabilities of the latter in identifying potential…

Cryptography and Security · Computer Science 2025-03-18 Vasileios Kouliaridis , Georgios Karopoulos , Georgios Kambourakis

While Large Language Models (LLMs) are rapidly integrating into daily life, research on their risks often remains lab-based and disconnected from the problems users encounter "in the wild." While recent HCI research has begun to explore…

Computers and Society · Computer Science 2025-09-12 Lingyao Li , Renkai Ma , Zhaoqian Xue , Junjie Xiong

As large language models (LLMs) advance and become widespread, students increasingly turn to systems like ChatGPT for assistance with writing tasks. Educators are concerned with students' usage of ChatGPT beyond cheating; using ChatGPT may…

Human-Computer Interaction · Computer Science 2026-04-23 Andrew Jelson , Daniel Manesh , Alice Jang , Daniel Dunlap , Young-Ho Kim , Sang Won Lee

The assessment of cybersecurity Capture-The-Flag (CTF) exercises involves participants finding text strings or ``flags'' by exploiting system vulnerabilities. Large Language Models (LLMs) are natural-language models trained on vast amounts…

Artificial Intelligence · Computer Science 2023-08-22 Wesley Tann , Yuancheng Liu , Jun Heng Sim , Choon Meng Seah , Ee-Chien Chang

This study investigates the capabilities of large language models (LLMs), specifically ChatGPT, in annotating MT outputs based on an error typology. In contrast to previous work focusing mainly on general language, we explore ChatGPT's…

Computation and Language · Computer Science 2025-04-22 Joachim Minder , Guillaume Wisniewski , Natalie Kübler

Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community. Previous research has evaluated these LLMs for various applications such as generating programming exercises and…

Human-Computer Interaction · Computer Science 2024-01-08 Ishika Joshi , Ritvik Budhiraja , Harshal D Akolekar , Jagat Sesh Challa , Dhruv Kumar

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen