English
Related papers

Related papers: CyberMetric: A Benchmark Dataset based on Retrieva…

200 papers

To address the increasing complexity and frequency of cybersecurity incidents emphasized by the recent cybersecurity threat reports with over 10 billion instances, cyber threat intelligence (CTI) plays a critical role in the modern…

Cryptography and Security · Computer Science 2024-06-04 Hangyuan Ji , Jian Yang , Linzheng Chai , Chaoren Wei , Liqun Yang , Yunlong Duan , Yunli Wang , Tianzhen Sun , Hongcheng Guo , Tongliang Li , Changyu Ren , Zhoujun Li

Large Language Models (LLMs) show potential for medical applications but often lack specialized clinical knowledge. Retrieval Augmented Generation (RAG) allows customization with domain-specific information, making it suitable for…

Retrieval-augmented generation (RAG) on specialized domain datasets has shown improved performance when large language models (LLMs) are fine-tuned for generating responses to user queries. In this study, we develop a cybersecurity…

Machine Learning · Computer Science 2024-11-05 Varun Badrinath Krishna

The purpose of research: Detection of cybersecurity incidents and analysis of decision support and assessment of the effectiveness of measures to counter information security threats based on modern generative models. The methods of…

Cryptography and Security · Computer Science 2025-04-21 Leonid Legashev , Arthur Zhigalov

The recent progression of Large Language Models (LLMs) has witnessed great success in the fields of data-centric applications. LLMs trained on massive textual datasets showed ability to encode not only context but also ability to provide…

Cryptography and Security · Computer Science 2024-05-24 Mohammed Hassanin , Nour Moustafa

Proper implementation of technical and administrative controls reinforces an organization's cybersecurity posture and business resilience, reduces risks, and enhances governance, ultimately elevating business maturity. The dynamics of the…

Cryptography and Security · Computer Science 2026-05-08 Gustavo Roberto Pinto , Arthur do Prado Labaki , Rodrigo Sanches Miani

Numerous studies have investigated methods for jailbreaking Large Language Models (LLMs) to generate harmful content. Typically, these methods are evaluated using datasets of malicious prompts designed to bypass security policies…

Cryptography and Security · Computer Science 2025-01-03 Johan Wahréus , Ahmed Mohamed Hussain , Panos Papadimitratos

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Large Language Models (LLMs) have shown impressive performance on a range of educational tasks, but are still understudied for their potential to solve mathematical problems. In this study, we compare three prominent LLMs, including GPT-4o,…

Artificial Intelligence · Computer Science 2025-07-01 Ruonan Wang , Runxi Wang , Yunwen Shen , Chengfeng Wu , Qinglin Zhou , Rohitash Chandra

As cyber threats continue to grow in scale and sophistication, blue team defenders increasingly require advanced tools to proactively detect and mitigate risks. Large Language Models (LLMs) offer promising capabilities for enhancing threat…

Cryptography and Security · Computer Science 2026-05-29 Yuqiao Meng , Luoxi Tang , Feiyang Yu , Xi Li , Guanhua Yan , Ping Yang , Zhaohan Xi

Large Language Models (LLMs) are increasingly used for cybersecurity threat analysis, but their deployment in security-sensitive environments raises trust and safety concerns. With over 21,000 vulnerabilities disclosed in 2025, manual…

Cryptography and Security · Computer Science 2025-09-04 Reza Fayyazi , Michael Zuzak , Shanchieh Jay Yang

With the rapid development of technology and the acceleration of digitalisation, the frequency and complexity of cyber security threats are increasing. Traditional cybersecurity approaches, often based on static rules and predefined…

Cryptography and Security · Computer Science 2025-04-29 Shuang Tian , Tao Zhang , Jiqiang Liu , Jiacheng Wang , Xuangou Wu , Xiaoqiang Zhu , Ruichen Zhang , Weiting Zhang , Zhenhui Yuan , Shiwen Mao , Dong In Kim

Large language model (LLM) self-correction -- the ability to detect and fix errors in generated outputs -- remains largely ad hoc, relying on generic prompts such as "please reconsider your answer" without systematic error analysis or…

Artificial Intelligence · Computer Science 2026-05-19 Yuning Wu , Yingmin Liu , Yang Shu

LLMs are increasingly pervasive in the security environment, with limited measures of their effectiveness, which limits trust and usefulness to security practitioners. Here, we present an open-source evaluation framework and benchmark…

Cryptography and Security · Computer Science 2025-09-23 Anna Bertiger , Bobby Filar , Aryan Luthra , Stefano Meschiari , Aiden Mitchell , Sam Scholten , Vivek Sharath

Evaluating Large Language Models (LLMs) is crucial for understanding their capabilities and limitations across various applications, including natural language processing and code generation. Existing benchmarks like MMLU, C-Eval, and…

Cryptography and Security · Computer Science 2025-01-07 Pengfei Jing , Mengyun Tang , Xiaorong Shi , Xing Zheng , Sen Nie , Shi Wu , Yong Yang , Xiapu Luo

This report explores the convergence of large language models (LLMs) and cybersecurity, synthesizing interdisciplinary insights from network security, artificial intelligence, formal methods, and human-centered design. It examines emerging…

Cryptography and Security · Computer Science 2025-05-05 Tao Li , Ya-Ting Yang , Yunian Pan , Quanyan Zhu

This study investigated the integration readiness of four predominant cybersecurity Governance, Risk and Compliance (GRC) frameworks - NIST CSF 2.0, COBIT 2019, ISO 27001:2022, and the latest ISO 42001:2023 - for the opportunities, risks,…

Computers and Society · Computer Science 2024-06-25 Timothy R. McIntosh , Teo Susnjak , Tong Liu , Paul Watters , Raza Nowrozy , Malka N. Halgamuge

This paper presents CyberSecEval, a comprehensive benchmark developed to help bolster the cybersecurity of Large Language Models (LLMs) employed as coding assistants. As what we believe to be the most extensive unified cybersecurity safety…

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

Artificial Intelligence · Computer Science 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun