English
Related papers

Related papers: False Security Confidence in Benign LLM Code Gener…

200 papers

LLMs show strong performance in code generation, but their outputs lack correctness guarantees. Sample-based uncertainty estimators address this by generating multiple candidate programs and measuring their disagreement. However, existing…

Software Engineering · Computer Science 2026-05-12 Weilin He , Arindam Sharma , Cristina David

Function-level code generation leverages foundation Large Language Models (LLMs) to automatically produce source code with expected functionality. It has been widely investigated and applied in intelligent programming assistants, such as…

Software Engineering · Computer Science 2025-01-22 Hao Wen , Yueheng Zhu , Chao Liu , Xiaoxue Ren , Weiwei Du , Meng Yan

Function calling (FC) has emerged as a powerful technique for facilitating large language models (LLMs) to interact with external systems and perform structured tasks. However, the mechanisms through which it influences model behavior…

Software Engineering · Computer Science 2025-09-23 Zhenlan Ji , Daoyuan Wu , Wenxuan Wang , Pingchuan Ma , Shuai Wang , Lei Ma

Fine-tuning is an essential and pervasive functionality for applying large language models (LLMs) to downstream tasks. However, it has the potential to substantially degrade safety alignment, e.g., by greatly increasing susceptibility to…

Machine Learning · Computer Science 2026-01-16 Jiawen Zhang , Yangfan Hu , Kejia Chen , Lipeng He , Jiachen Ma , Jian Lou , Dan Li , Jian Liu , Xiaohu Yang , Ruoxi Jia

Large Language Models (LLMs) frequently hallucinate, impeding their reliability in mission-critical situations. One approach to address this issue is to provide citations to relevant sources alongside generated content, enhancing the…

Computation and Language · Computer Science 2024-07-16 Rami Aly , Zhiqiang Tang , Samson Tan , George Karypis

High-quality smart contract vulnerability datasets are critical for evaluating security tools and advancing smart contract security research. Two major limitations of current manual dataset construction are (1) labor-intensive and…

Cryptography and Security · Computer Science 2025-06-24 Jiachi Chen , Yiming Shen , Jiashuo Zhang , Zihao Li , John Grundy , Zhenzhe Shao , Yanlin Wang , Jiashui Wang , Ting Chen , Zibin Zheng

Large Language Models (LLMs) deploy safety mechanisms to prevent harmful outputs, yet these defenses remain vulnerable to adversarial prompts. While existing research demonstrates that jailbreak attacks succeed, it does not explain…

Cryptography and Security · Computer Science 2026-02-11 Hayfa Dhabhi , Kashyap Thimmaraju

Recent studies have uncovered a troubling vulnerability in the fine-tuning stage of large language models (LLMs): even fine-tuning on entirely benign datasets can lead to a significant increase in the harmfulness of LLM outputs. Building on…

Machine Learning · Computer Science 2025-05-27 Zihan Guan , Mengxuan Hu , Ronghang Zhu , Sheng Li , Anil Vullikanti

Logic locking refers to a set of techniques that can protect integrated circuits (ICs) from counterfeiting, piracy and malicious functionality changes by an untrusted foundry. It achieves these goals by introducing new inputs, called key…

Cryptography and Security · Computer Science 2020-01-20 Deepak Sirone , Pramod Subramanyan

With the increasing popularity of large language models (LLMs) and LLM-based agents, reliable and effective code evaluation metrics (CEMs) have become crucial for progress across several software engineering tasks. While popular benchmarks…

Software Engineering · Computer Science 2025-10-09 Simantika Bhattacharjee Dristi , Matthew B. Dwyer

LLMs are increasingly explored for malware analysis; however, current LLM-based malware attribution remains limited by unsupported indicators and insufficient code-level grounding for identifying malicious and vulnerable code segments. To…

Cryptography and Security · Computer Science 2026-05-08 Christopher G. Pedraza Pohlenz , Hassan Jalil Hadi , Ali Hassan , Ali Shoker

Language models (LMs) have exhibited impressive abilities in generating codes from natural language requirements. In this work, we highlight the diversity of code generated by LMs as a critical criterion for evaluating their code generation…

Software Engineering · Computer Science 2024-08-28 Heejae Chon , Seonghyeon Lee , Jinyoung Yeo , Dongha Lee

Large Language Models (LLMs) have shown promise in software engineering tasks, but evaluating their effectiveness in vulnerability detection is challenging due to the lack of high-quality datasets. Most existing datasets are limited to…

Software Engineering · Computer Science 2025-05-27 Md Basim Uddin Ahmed , Nima Shiri Harzevili , Jiho Shin , Hung Viet Pham , Song Wang

Large language models deployed at runtime can misbehave in ways that clean-data validation cannot anticipate: training-time backdoors lie dormant until triggered, jailbreaks subvert safety alignment, and prompt injections override the…

Cryptography and Security · Computer Science 2026-04-28 Nay Myat Min , Long H. Pham , Jun Sun

The emergence of vibe coding, a paradigm where non-technical users instruct Large Language Models (LLMs) to generate executable codes via natural language, presents both significant opportunities and severe risks for the construction…

Software Engineering · Computer Science 2026-04-28 S M Jamil Uddin

Foundation Models (FMs) display exceptional performance in tasks such as natural language processing and are being applied across a growing range of disciplines. Although typically trained on large public datasets, FMs are often fine-tuned…

Cryptography and Security · Computer Science 2024-10-10 Marcin Chrapek , Anjo Vahldiek-Oberwagner , Marcin Spoczynski , Scott Constable , Mona Vij , Torsten Hoefler

False positives (FPs) have been an issue of extreme importance for anti-virus (AV) systems for decades. As more security vendors turn to machine learning, alert deluge has hit critical mass with over 20% of all alerts resulting in FPs and,…

Machine Learning · Computer Science 2020-10-26 Edward Raff , Bobby Filar , James Holt

Large Language Models (LLMs) have demonstrated potential in cybersecurity applications but have also caused lower confidence due to problems like hallucinations and a lack of truthfulness. Existing benchmarks provide general evaluations but…

Code-generating Large Language Models (LLMs) significantly accelerate software development. However, their frequent generation of insecure code presents serious risks. We present a comprehensive evaluation of seven parameter-efficient…

Cryptography and Security · Computer Science 2025-09-17 Kiho Lee , Jungkon Kim , Doowon Kim , Hyoungshick Kim

Static Application Security Testing (SAST) tools are critical to software quality, identifying potential code issues early in development. However, they often produce false positive warnings that require manual review, slowing down…

Software Engineering · Computer Science 2025-06-03 Jinbao Chen , Hongjing Xiang , Zuohong Zhao , Luhao Li , Yu Zhang , Boyao Ding , Qingwei Li , Songyuan Xiong