English
Related papers

Related papers: Poisoned ChatGPT Finds Work for Idle Hands: Explor…

200 papers

Instruction-tuned Large Language Models designed for coding tasks are increasingly employed as AI coding assistants. However, the cybersecurity vulnerabilities and implications arising from the widespread integration of these models are not…

Cryptography and Security · Computer Science 2025-03-10 Md Imran Hossen , Sai Venkatesh Chilukoti , Liqun Shan , Sheng Chen , Yinzhi Cao , Xiali Hei

Artificial Intelligence (AI) has revolutionized software development, particularly by automating repetitive tasks and improving developer productivity. While these advancements are well-documented, the use of AI-powered tools for Software…

Software Engineering · Computer Science 2025-12-24 M. Mehdi Kholoosi , Triet Huynh Minh Le , M. Ali Babar

In the rapidly advancing field of artificial intelligence, software development has emerged as a key area of innovation. Despite the plethora of general-purpose AI assistants available, their effectiveness diminishes in complex,…

Software Engineering · Computer Science 2023-12-01 Gustavo Pinto , Cleidson de Souza , Thayssa Rocha , Igor Steinmacher , Alberto de Souza , Edward Monteiro

The use of generative AI (GenAI) tools has fundamentally transformed software development. Central to this shift is prompt engineering, the practice of crafting textual prompts to guide GenAI tools in generating useful content. Although…

Software Engineering · Computer Science 2026-01-26 Daniel Otten , Trevor Stalnaker , Nathan Wintersgill , Oscar Chaparro , Denys Poshyvanyk

The recent release of ChatGPT has gained huge attention and discussion worldwide, with responsible AI being a key topic of discussion. How can we ensure that AI systems, including ChatGPT, are developed and adopted in a responsible way? To…

Software Engineering · Computer Science 2023-02-28 Qinghua Lu , Yuxiu Luo , Liming Zhu , Mingjian Tang , Xiwei Xu , Jon Whittle

Prompt injection attacks pose a critical threat to large language models (LLMs), with prior work focusing on cutting-edge LLM applications like personal copilots. In contrast, simpler LLM applications, such as customer service chatbots, are…

Cryptography and Security · Computer Science 2025-11-11 Yigitcan Kaya , Anton Landerer , Stijn Pletinckx , Michelle Zimmermann , Christopher Kruegel , Giovanni Vigna

Large language models (LLMs) demonstrate powerful information handling capabilities and are widely integrated into chatbot applications. OpenAI provides a platform for developers to construct custom GPTs, extending ChatGPT's functions and…

Cryptography and Security · Computer Science 2025-06-05 Wei Wenying , Zhao Kaifa , Xue Lei , Fan Ming

As large language models (LLMs) advance and become widespread, students increasingly turn to systems like ChatGPT for assistance with writing tasks. Educators are concerned with students' usage of ChatGPT beyond cheating; using ChatGPT may…

Human-Computer Interaction · Computer Science 2026-04-23 Andrew Jelson , Daniel Manesh , Alice Jang , Daniel Dunlap , Young-Ho Kim , Sang Won Lee

LLM-based coding agents are rapidly being deployed in software development, yet their safety implications remain poorly understood. These agents, while capable of accelerating software development, may exhibit unsafe behaviors during normal…

Artificial Intelligence · Computer Science 2025-08-26 Matous Kozak , Roshanak Zilouchian Moghaddam , Siva Sivaraman

Artificial Intelligence (AI)-driven code generation tools are increasingly used throughout the software development lifecycle to accelerate coding tasks. However, the security of AI-generated code using Large Language Models (LLMs) remains…

Cryptography and Security · Computer Science 2026-03-10 Mohammed Kharma , Soohyeon Choi , Mohammed AlKhanafseh , David Mohaisen

Modern code generation tools utilizing AI models like Large Language Models (LLMs) have gained increased popularity due to their ability to produce functional code. However, their usage presents security challenges, often resulting in…

Software Engineering · Computer Science 2025-02-07 Yujia Fu , Peng Liang , Amjed Tahir , Zengyang Li , Mojtaba Shahin , Jiaxin Yu , Jinfu Chen

As large language models (LLMs) become more powerful and are deployed more autonomously, it will be increasingly important to prevent them from causing harmful outcomes. Researchers have investigated a variety of safety techniques for this…

Machine Learning · Computer Science 2024-07-24 Ryan Greenblatt , Buck Shlegeris , Kshitij Sachan , Fabien Roger

The increasing demand for programming language education and growing class sizes require immediate and personalized feedback. However, traditional code review methods have limitations in providing this level of feedback. As the capabilities…

Software Engineering · Computer Science 2025-06-23 Lee Dong-Kyu

The new capabilities of generative artificial intelligence tools Generative AI, such as ChatGPT, allow users to interact with the system in intuitive ways, such as simple conversations, and receive (mostly) good-quality answers. These…

Human-Computer Interaction · Computer Science 2024-10-14 Matin Amoozadeh , Daye Nam , Daniel Prol , Ali Alfageeh , James Prather , Michael Hilton , Sruti Srinivasa Ragavan , Mohammad Amin Alipour

This paper aims to explore fundamental questions in the era when AI coding assistants like GitHub Copilot are widely adopted: what do developers truly value and criticize in AI coding assistants, and what does this reveal about their needs…

Software Engineering · Computer Science 2025-08-19 Yunbo Lyu , Zhou Yang , Jieke Shi , Jianming Chang , Yue Liu , David Lo

The software development industry is amid another disruptive paradigm change - adopting the use of generative AI (GAI) assistants for programming. Whilst AI is already used in various areas of software engineering, GAI technologies, such as…

Software Engineering · Computer Science 2023-08-21 Christopher Bull , Ahmed Kharrufa

Artificial Intelligence (AI) has the potential to fundamentally change the educational landscape. So far, much of the physics education research relating to AI has focused on lecture-based assessment and the ability of ChatGPT to answer…

Physics Education · Physics 2024-01-02 Andrew Low , Z. Yasemin Kalender

This research paper contributes to the computing education research community's understanding of Generative AI (GenAI) in the context of introductory programming, and specifically, how students utilize related tools, such as ChatGPT. An…

Artificial Intelligence · Computer Science 2024-07-31 Andreas Scholl , Natalie Kiesler

Large language models (LLMs) like ChatGPT have shown the potential to assist developers with coding and debugging tasks. However, their role in collaborative issue resolution is underexplored. In this study, we analyzed 1,152…

Software Engineering · Computer Science 2024-12-12 Joy Krishan Das , Saikat Mondal , Chanchal K. Roy

Large Language Models (LLMs) like GPT and Bard are capable of producing code based on textual descriptions, with remarkable efficacy. Such technology will have profound implications for computing education, raising concerns about cheating,…

Emerging Technologies · Computer Science 2024-04-29 Bruno Pereira Cipriano , Pedro Alves