English
Related papers

Related papers: OrgForge-IT: A Verifiable Synthetic Benchmark for …

200 papers

Recovering concurrency structure directly from source code is difficult because shared-resource identity and protection relations are often obscured by aliasing, ownership, and API-specific idioms. We therefore study a specification-driven,…

Programming Languages · Computer Science 2026-04-13 Kaiwen Zhang , Guanjun Liu

The integration of large language models (LLMs) into cyber security applications presents both opportunities and critical safety risks. We introduce CyberLLMInstruct, a dataset of 54,928 pseudo-malicious instruction-response pairs spanning…

Cryptography and Security · Computer Science 2025-09-18 Adel ElZemity , Budi Arief , Shujun Li

Static benchmarks for harmful content detection face limitations in scalability and diversity, and may also be affected by contamination from web-scale pre-training corpora. To address these issues, we propose a framework for synthesizing…

Computation and Language · Computer Science 2026-04-21 Huije Lee , Jisu Shin , Hoyun Song , Changgeon Ko , Jong C. Park

Multi-purpose Large Language Models (LLMs), a subset of generative Artificial Intelligence (AI), have recently made significant progress. While expectations for LLMs to assist systems engineering (SE) tasks are paramount; the…

Computation and Language · Computer Science 2025-02-17 Taylan G. Topcu , Mohammed Husain , Max Ofsa , Paul Wach

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

Long-horizon reasoning in LLM-based agents often fails not from generative weakness but from insufficient verification of intermediate reasoning. Co-Sight addresses this challenge by turning reasoning into a falsifiable and auditable…

Artificial Intelligence · Computer Science 2025-10-27 Hongwei Zhang , Ji Lu , Shiqing Jiang , Chenxiang Zhu , Li Xie , Chen Zhong , Haoran Chen , Yurui Zhu , Yongsheng Du , Yanqin Gao , Lingjun Huang , Baoli Wang , Fang Tan , Peng Zou

Insider threat detection presents unique challenges due to the authorized status of malicious actors and the subtlety of anomalous behaviors. Existing machine learning methods often treat user activity as isolated events, thereby failing to…

Machine Learning · Computer Science 2025-07-11 Mohamed Elbasheer , Adewale Akinfaderin

The impact of inference-time data perturbation (e.g., adversarial attacks) has been extensively studied in machine learning, leading to well-established certification techniques for adversarial robustness. In contrast, certifying models…

Machine Learning · Computer Science 2025-11-13 Philip Sosnin , Matthew Wicker , Josh Collyer , Calvin Tsay

User authentication and fraud detection face growing challenges as digital systems expand and adversaries adopt increasingly sophisticated tactics. Traditional knowledge-based authentication remains rigid, requiring exact word-for-word…

Cryptography and Security · Computer Science 2026-04-29 Emunah S-S. Chan , Aldar C-F. Chan

Detecting synthetic from real speech is increasingly crucial due to the risks of misinformation and identity impersonation. While various datasets for synthetic speech analysis have been developed, they often focus on specific areas,…

Sound · Computer Science 2025-07-18 Zhoulin Ji , Chenhao Lin , Hang Wang , Chao Shen

Modern software relies on a multitude of automated testing and quality assurance tools to prevent errors, bugs and potential vulnerabilities. This study sets out to provide a head-to-head, quantitative and qualitative evaluation of six…

Software Engineering · Computer Science 2025-08-07 Damian Gnieciak , Tomasz Szandala

In cybersecurity, security analysts constantly face the challenge of mitigating newly discovered vulnerabilities in real-time, with over 300,000 vulnerabilities identified since 1999. The sheer volume of known vulnerabilities complicates…

Cryptography and Security · Computer Science 2026-01-26 Reza Fayyazi , Stella Hoyos Trueba , Michael Zuzak , Shanchieh Jay Yang

Current hardware security verification processes predominantly rely on manual threat modeling and test plan generation, which are labor-intensive, error-prone, and struggle to scale with increasing design complexity and evolving attack…

Cryptography and Security · Computer Science 2025-05-13 Dipayan Saha , Hasan Al Shaikh , Shams Tarek , Farimah Farahmandi

Prompt injection attacks exploit vulnerabilities in large language models (LLMs) to manipulate the model into unintended actions or generate malicious content. As LLM integrated applications gain wider adoption, they face growing…

Cryptography and Security · Computer Science 2024-01-03 Daniel Wankit Yip , Aysan Esmradi , Chun Fai Chan

Intrusion Detection and Prevention Systems (IDS/IPS) in large enterprises can generate hundreds of thousands of alerts per hour, overwhelming analysts with logs requiring rapidly evolving expertise. Conventional machine-learning detectors…

Cryptography and Security · Computer Science 2026-02-10 Francesco Blefari , Cristian Cosentino , Francesco Aurelio Pironti , Angelo Furfaro , Fabrizio Marozzo

Large language models (LLMs) are being increasingly integrated into practical hardware and firmware development pipelines for code generation. Existing studies have primarily focused on evaluating the functional correctness of LLM-generated…

Cryptography and Security · Computer Science 2026-01-21 Qirui Chen , Jingxian Shuai , Shuangwu Chen , Shenghao Ye , Zijian Wen , Xufei Su , Jie Jin , Jiangming Li , Jun Chen , Xiaobin Tan , Jian Yang

Insider threats pose a persistent and critical security risk, yet are notoriously difficult to detect in complex enterprise environments, where malicious actions are often hidden within seemingly benign user behaviors. Although…

Cryptography and Security · Computer Science 2026-01-06 Jiongchi Yu , Xiaofei Xie , Qiang Hu , Yuhan Ma , Ziming Zhao

Large language models (LLMs) are increasingly used to translate natural-language optimization problems into mathematical formulations and solver code, but matching the reference objective value is not a reliable test of correctness: an…

Artificial Intelligence · Computer Science 2026-05-13 Zhong Li , Zihan Guo , Xiaohan Lu , Juntao Wang , Jie Song , Chao Shen , Jiageng Wu , Mingyang Sun

Diagnosing failures in LLM agents remains largely manual. Practitioners inspect a small subset of execution traces, form ad-hoc hypotheses, and iterate. This process misses patterns that only emerge across trace populations and does not…

Artificial Intelligence · Computer Science 2026-05-22 Akshay Manglik , Apaar Shanker , Kaustubh Deshpande , Jason Qin , Yash Maurya , Veronica Chatrath , Vijay S. Kalmath , Levi Lentz , Yuan , Xue

Cyber threat intelligence (CTI) analysts routinely convert noisy, unstructured security artifacts into standardized, automation-ready representations. Although large language models (LLMs) show promise for this task, existing approaches…

Machine Learning · Computer Science 2026-05-11 Md Tanvirul Alam , Aritran Piplai , Ionut Cardei , Nidhi Rastogi , Peter J Worth