English
Related papers

Related papers: Evaluating Large Language Models for Line-Level Vu…

200 papers

Large language models (LLMs) have brought significant advancements to code generation and code repair, benefiting both novice and experienced developers. However, their training using unsanitized data from open-source repositories, like…

Software Engineering · Computer Science 2024-07-08 Jiexin Wang , Xitong Luo , Liuwen Cao , Hongkui He , Hailin Huang , Jiayuan Xie , Adam Jatowt , Yi Cai

The exponential increase in software vulnerabilities has created an urgent need for automatic vulnerability repair (AVR) solutions. Recent research has formulated AVR as a sequence generation problem and has leveraged large language models…

Artificial Intelligence · Computer Science 2025-10-08 Xin-Cheng Wen , Zirui Lin , Yijun Yang , Cuiyun Gao , Deheng Ye

Large Language Models (LLMs) have presented impressive performance across several transformative tasks. However, it is non-trivial to efficiently utilize large-scale cluster resources to develop LLMs, often riddled with numerous challenges…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Qinghao Hu , Zhisheng Ye , Zerui Wang , Guoteng Wang , Meng Zhang , Qiaoling Chen , Peng Sun , Dahua Lin , Xiaolin Wang , Yingwei Luo , Yonggang Wen , Tianwei Zhang

Language models (LMs) show promise for vulnerability detection but struggle with long, real-world code due to sparse and uncertain vulnerability locations. These issues, exacerbated by token limits, often cause models to miss…

Software Engineering · Computer Science 2025-07-16 Xinran Zheng , Xingzhi Qian , Huichi Zhou , Shuo Yang , Yiling He , Suman Jana , Lorenzo Cavallaro

As large language models (LLMs) gain popularity, their vulnerability to adversarial attacks emerges as a primary concern. While fine-tuning models on domain-specific datasets is often employed to improve model performance, it can…

Computation and Language · Computer Science 2026-02-24 Punya Syon Pandey , Samuel Simko , Kellin Pelrine , Zhijing Jin

Code translation is crucial for cross-language codebase migration, and large language models (LLMs) have emerged as a promising technique to automate this process. However, the security implications of using LLMs for code translation remain…

Cryptography and Security · Computer Science 2025-12-09 Hailong Chang , Guozhu Meng , Shuhui Xiao , Kai Chen , Kun Sun , Yilin Li

The widespread adoption of Large Language Models (LLMs), exemplified by OpenAI's ChatGPT, brings to the forefront the imperative to defend against adversarial threats on these models. These attacks, which manipulate an LLM's output by…

Cryptography and Security · Computer Science 2025-04-04 Amelia Kawasaki , Andrew Davis , Houssam Abbas

The Large Vision-Language Model (LVLM) integrates computer vision and natural language processing techniques, offering substantial application potential. However, these models demand extensive resources during inference. Adaptive attention…

Artificial Intelligence · Computer Science 2025-02-10 Junyang Zhang , Mu Yuan , Ruiguang Zhong , Puhan Luo , Huiyou Zhan , Ningkang Zhang , Chengchen Hu , Xiangyang Li

The rapid advancement of large language models (LLMs) such as GPT-4 has revolutionized the landscape of software engineering, positioning these models at the core of modern development practices. As we anticipate these models to evolve into…

Software Engineering · Computer Science 2025-06-16 Jianian Gong , Nachuan Duan , Ziheng Tao , Zhaohui Gong , Yuan Yuan , Minlie Huang

Supervised-learning-based vulnerability detectors often fall short due to limited labelled training data. In contrast, Large Language Models (LLMs) like GPT-4 are trained on vast unlabelled code corpora, yet perform only marginally better…

Cryptography and Security · Computer Science 2025-06-03 Weizhou Wang , Eric Liu , Xiangyu Guo , Xiao Hu , Ilya Grishchenko , David Lie

Large Language Models (LLMs) have demonstrated significant capabilities in understanding and analyzing code for security vulnerabilities, such as Common Weakness Enumerations (CWEs). However, their reliance on cloud infrastructure and…

Cryptography and Security · Computer Science 2026-05-14 Md. Azizul Hakim Bappy , Hossen A Mustafa , Prottoy Saha , Rajinus Salehat

This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm practice and technical interviews. We began by crawling the…

Software Engineering · Computer Science 2025-03-04 Lun Wang , Chuanqi Shi , Shaoshui Du , Yiyi Tao , Yixian Shen , Hang Zheng , Yanxin Shen , Xinyu Qiu

The growing trend of vulnerability issues in software development as a result of a large dependence on open-source projects has received considerable attention recently. This paper investigates the effectiveness of Large Language Models…

Software Engineering · Computer Science 2024-09-17 Shaznin Sultana , Sadia Afreen , Nasir U. Eisty

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

The rising use of Large Language Models (LLMs) to create and disseminate malware poses a significant cybersecurity challenge due to their ability to generate and distribute attacks with ease. A single prompt can initiate a wide array of…

Cryptography and Security · Computer Science 2024-09-13 Jamal Al-Karaki , Muhammad Al-Zafar Khan , Marwan Omar

Code review is a crucial practice in software development. As code review nowadays is lightweight, various issues can be identified, and sometimes, they can be trivial. Research has investigated automated approaches to classify review…

Software Engineering · Computer Science 2025-08-14 Linh Nguyen , Chunhua Liu , Hong Yi Lin , Patanamon Thongtanunam

Large Language Model (LLM) agents face security vulnerabilities spanning AI-specific and traditional software domains, yet current research addresses these separately. This study bridges this gap through comparative evaluation of Function…

Cryptography and Security · Computer Science 2025-07-10 Tarek Gasmi , Ramzi Guesmi , Ines Belhadj , Jihene Bennaceur

Recent advancements in large language models (LLMs) have shown promise in feature engineering for tabular data, but concerns about their reliability persist, especially due to variability in generated outputs. We introduce a multi-level…

Machine Learning · Computer Science 2025-10-01 Yebin Lim , Susik Yoon

The application of Large Language Models (LLMs) in software engineering, particularly in static analysis tasks, represents a paradigm shift in the field. In this paper, we investigate the role that current LLMs can play in improving…

Software Engineering · Computer Science 2024-02-28 Ashwin Prasad Shivarpatna Venkatesh , Samkutty Sabu , Amir M. Mir , Sofia Reis , Eric Bodden

Vulnerability detection is a critical aspect of software security. Accurate detection is essential to prevent potential security breaches and protect software systems from malicious attacks. Recently, vulnerability detection methods…

Software Engineering · Computer Science 2025-04-24 Yixin Yang , Bowen Xu , Xiang Gao , Hailong Sun