English
Related papers

Related papers: Exploring the Limits of ChatGPT in Software Securi…

200 papers

As Large Language Models (LLMs), including ChatGPT and analogous systems, continue to advance, their robust natural language processing capabilities and diverse applications have garnered considerable attention. Nonetheless, despite the…

ChatGPT embarks on a new era of artificial intelligence and will revolutionize the way we approach intelligent traffic safety systems. This paper begins with a brief introduction about the development of large language models (LLMs). Next,…

Computation and Language · Computer Science 2023-09-07 Ou Zheng , Mohamed Abdel-Aty , Dongdong Wang , Zijin Wang , Shengxuan Ding

The rapid advancement of Large Language Models (LLMs) has opened up new opportunities for leveraging artificial intelligence in a variety of application domains, including cybersecurity. As the volume and sophistication of cyber threats…

Cryptography and Security · Computer Science 2025-09-23 Hanxiang Xu , Shenao Wang , Ningke Li , Kailong Wang , Yanjie Zhao , Kai Chen , Ting Yu , Yang Liu , Haoyu Wang

In the ever-evolving landscape of software engineering, the emergence of large language models (LLMs) and conversational interfaces, exemplified by ChatGPT, is nothing short of revolutionary. While their potential is undeniable across…

Software Engineering · Computer Science 2023-12-12 Mithila Sivakumar , Alvine Boaye Belle , Jinjun Shan , Kimya Khakzad Shahandashti

Various deep learning-based approaches utilizing pre-trained language models (PLMs) have been proposed for automated vulnerability detection. With recent advancements in large language models (LLMs), several studies have begun exploring…

Software Engineering · Computer Science 2026-03-11 Honglin Shu , Michael Fu , Junji Yu , Dong Wang , Chakkrit Tantithamthavorn , Junjie Chen , Yasutaka Kamei

As a way of addressing increasingly sophisticated problems, software professionals face the constant challenge of seeking improvement. However, for these individuals to enhance their skills, their process of studying and training must…

Software Engineering · Computer Science 2023-08-02 Gustavo Pinto , Isadora Cardoso-Pereira , Danilo Monteiro Ribeiro , Danilo Lucena , Alberto de Souza , Kiev Gama

Background and Context: Over the past year, large language models (LLMs) have taken the world by storm. In computing education, like in other walks of life, many opportunities and threats have emerged as a consequence. Objectives: In this…

Computers and Society · Computer Science 2023-06-12 Arto Hellas , Juho Leinonen , Sami Sarsa , Charles Koutcheme , Lilja Kujanpää , Juha Sorva

AI safety training and red-teaming of large language models (LLMs) are measures to mitigate the generation of unsafe content. Our work exposes the inherent cross-lingual vulnerability of these safety mechanisms, resulting from the…

Computation and Language · Computer Science 2024-01-30 Zheng-Xin Yong , Cristina Menghini , Stephen H. Bach

Code reviews are an integral part of software development and have been recognized as a crucial practice for minimizing bugs and favouring higher code quality. They serve as an important checkpoint before committing code and play an…

Software Engineering · Computer Science 2024-12-05 Genevieve Caumartin , Qiaolin Qin , Sharon Chatragadda , Janmitsinh Panjrolia , Heng Li , Diego Elias Costa

Large language models (LLMs) show impressive abilities via few-shot prompting. Commercialized APIs such as OpenAI GPT-3 further increase their use in real-world language applications. However, the crucial problem of how to improve the…

Computation and Language · Computer Science 2023-02-16 Chenglei Si , Zhe Gan , Zhengyuan Yang , Shuohang Wang , Jianfeng Wang , Jordan Boyd-Graber , Lijuan Wang

Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and…

Computation and Language · Computer Science 2025-03-25 Shervin Minaee , Tomas Mikolov , Narjes Nikzad , Meysam Chenaghlu , Richard Socher , Xavier Amatriain , Jianfeng Gao

This paper studies recent developments in large language models' (LLM) abilities to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. The emergence of ChatGPT resulted in heated debates…

Computers and Society · Computer Science 2023-10-05 Jaromir Savelka , Arav Agarwal , Marshall An , Chris Bogart , Majd Sakr

In the present study, we provided students an unfiltered access to a state-of-the-art large language model (LLM) chatbot. The chatbot was intentionally designed to mimic proprietary commercial chatbots such as ChatGPT where the chatbot has…

Computers and Society · Computer Science 2024-06-10 Arto Hellas , Juho Leinonen , Leo Leppänen

Large vision-language models (VLMs) such as GPT-4 have achieved unprecedented performance in response generation, especially with visual inputs, enabling more creative and adaptable interaction than large language models such as ChatGPT.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yunqing Zhao , Tianyu Pang , Chao Du , Xiao Yang , Chongxuan Li , Ngai-Man Cheung , Min Lin

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

Computation and Language · Computer Science 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

Large Language models (LLMs) are transforming digital usage, particularly in text generation, image creation, information retrieval and code development. ChatGPT, launched by OpenAI in November 2022, quickly became a reference, prompting…

Cryptography and Security · Computer Science 2025-06-13 Rafaël Nouailles

As Large-Scale Language Models (LLMs) continue to evolve, they demonstrate significant enhancements in performance and an expansion of functionalities, impacting various domains, including education. In this study, we conducted interviews…

Human-Computer Interaction · Computer Science 2024-07-18 He Zhang , Jingyi Xie , Chuhao Wu , Jie Cai , ChanMin Kim , John M. Carroll

With the rapid development of artificial intelligence, large language models (LLMs) have made remarkable advancements in natural language processing. These models are trained on vast datasets to exhibit powerful language understanding and…

Cryptography and Security · Computer Science 2025-09-22 Shang Wang , Tianqing Zhu , Bo Liu , Ming Ding , Dayong Ye , Wanlei Zhou , Philip S. Yu

Large Language Models (LLMs), such as ChatGPT, have become widely popular and widely used in various software engineering tasks such as refactoring, testing, code review, and program comprehension. Although recent studies have examined the…

Software Engineering · Computer Science 2025-09-11 Eman Abdullah AlOmar , Luo Xu , Sofia Martinez , Anthony Peruma , Mohamed Wiem Mkaouer , Christian D. Newman , Ali Ouni

Large Language Models (LLMs) such as ChatGPT-4, Claude 3, and LLaMA 4 are increasingly embedded in software/application development, supporting tasks from code generation to debugging. Yet, their real-world effectiveness in detecting…

Software Engineering · Computer Science 2026-04-28 Akshay Mhatre , Noujoud Nader , Patrick Diehl , Deepti Gupta