中文
相关论文

相关论文: Are Frontier LLMs Ready for Cybersecurity? Evidenc…

200 篇论文

The rapid evolution of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) has driven major gains in reasoning, perception, and generation across language and vision, yet whether these advances translate into…

Large Language Models (LLMs) have achieved remarkable success but remain highly susceptible to jailbreak attacks, in which adversarial prompts coerce models into generating harmful, unethical, or policy-violating outputs. Such attacks pose…

Prior work has demonstrated that functionally correct yet vulnerable outputs arise systematically in threat-oriented settings, where adversarial or implicit channels are used to induce security failures in code agents and automated patching…

密码学与安全 · 计算机科学 2026-04-22 Xiaolei Ren

Code security and usability are both essential for various coding assistant applications driven by large language models (LLMs). Current code security benchmarks focus solely on single evaluation task and paradigm, such as code completion…

计算与语言 · 计算机科学 2025-05-16 Yutao Mou , Xiao Deng , Yuxiao Luo , Shikun Zhang , Wei Ye

Recent advancements in training paradigms for Large Language Models (LLMs) have unlocked their remarkable capabilities in natural language processing and cross-domain generalization. While LLMs excel in tasks like programming and…

机器学习 · 计算机科学 2025-10-01 Yuan Huang

Large vision-language model (LVLM)-based web agents are emerging as powerful tools for automating complex online tasks. However, when deployed in real-world environments, they face serious security risks, motivating the design of security…

This paper presents insights from evaluating 16 frontier large language models (LLMs) on the WebApp1K benchmark, a test suite designed to assess the ability of LLMs to generate web application code. The results reveal that while all models…

软件工程 · 计算机科学 2024-09-10 Yi Cui

Large Language Models (LLMs) are increasingly integrated into critical systems in industries like healthcare and finance. Users can often submit queries to LLM-enabled chatbots, some of which can enrich responses with information retrieved…

密码学与安全 · 计算机科学 2025-05-21 Sayon Palit , Daniel Woods

The rapid advancement of Large Language Models (LLMs) presents new opportunities for automated software vulnerability detection, a crucial task in securing modern codebases. This paper presents a comparative study on the effectiveness of…

软件工程 · 计算机科学 2026-01-05 Md Hasan Saju , Maher Muhtadi , Akramul Azim

Even though large language models are becoming increasingly capable, it is still unreasonable to expect them to excel at tasks that are under-represented on the Internet. Leveraging LLMs for specialized applications, particularly in niche…

机器学习 · 计算机科学 2025-08-18 Brendan R. Hogan , Will Brown , Adel Boyarsky , Anderson Schneider , Yuriy Nevmyvaka

The rise of Large Language Models (LLMs) has revolutionized our comprehension of intelligence bringing us closer to Artificial Intelligence. Since their introduction, researchers have actively explored the applications of LLMs across…

A series of influential studies established that large language models cannot reliably solve even simple planning tasks. We show that the latest generation of frontier models overturns this conclusion. We evaluate three families of frontier…

人工智能 · 计算机科学 2026-05-18 Augusto B. Corrêa , André G. Pereira , Jendrik Seipp

Cybersecurity education is challenging and it is helpful for educators to understand Large Language Models' (LLMs') capabilities for supporting education. This study evaluates the effectiveness of LLMs in conducting a variety of penetration…

密码学与安全 · 计算机科学 2026-03-30 Martin Nizon-Deladoeuille , Brynjólfur Stefánsson , Helmut Neukirchen , Thomas Welsh

Large language models (LLMs) are improving at an exceptional rate. However, these models are still susceptible to jailbreak attacks, which are becoming increasingly dangerous as models become increasingly powerful. In this work, we…

Advances in self-supervised learning (SSL) for machine vision have improved representation robustness and model performance, giving rise to pre-trained backbones like \emph{ResNet} and \emph{ViT} models tuned with SSL methods such as…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Erik Arakelyan , Karen Hambardzumyan , Davit Papikyan , Pasquale Minervini , Albert Gordo , Isabelle Augenstein , Aram H. Markosyan

Recently, machine and deep learning (ML/DL) algorithms have been increasingly adopted in many software systems. Due to their inductive nature, ensuring the quality of these systems remains a significant challenge for the research community.…

软件工程 · 计算机科学 2024-07-16 Moses Openja , Foutse Khomh , Armstrong Foundjem , Zhen Ming , Jiang , Mouna Abidi , Ahmed E. Hassan

This study compares state-of-the-art Large Language Models (LLMs) on their tendency to generate vulnerabilities when writing C programs using a neutral zero-shot prompt. Tihanyi et al. introduced the FormAI dataset at PROMISE'23, featuring…

密码学与安全 · 计算机科学 2024-12-12 Norbert Tihanyi , Tamas Bisztray , Mohamed Amine Ferrag , Ridhi Jain , Lucas C. Cordeiro

Background: Fine-tuning is central to adapting pre-trained Large Language Models (LLMs) to downstream tasks, but its reliance on training data, parameter updates, and reusable components opens entry points for attackers. Threats have…

密码学与安全 · 计算机科学 2026-05-26 Wenjuan Li , Yitao Liu , Runze Chen , Rajkumar Buyya

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

计算与语言 · 计算机科学 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Vulnerability detection methods based on deep learning (DL) have shown strong performance on benchmark datasets, yet their real-world effectiveness remains underexplored. Recent work suggests that both graph neural network (GNN)-based and…

密码学与安全 · 计算机科学 2025-12-12 Chaomeng Lu , Bert Lagaisse