English
Related papers

Related papers: Cyber-Zero: Training Cybersecurity Agents without …

200 papers

Autonomous agents, which perceive environments and take actions to achieve goals, have become increasingly feasible with the advancements in large language models (LLMs). However, current powerful agents often depend on sophisticated prompt…

Computation and Language · Computer Science 2025-05-27 Yihan Chen , Benfeng Xu , Xiaorui Wang , Yongdong Zhang , Zhendong Mao

Schedule-Free Learning has shown promise as a practical anytime training method for machine learning, showing success across dozens of standard benchmark problems. However, strong performance for LLM training has only been demonstrated at…

Machine Learning · Computer Science 2026-05-20 Aaron Defazio

The advent of transformers has fueled progress in machine translation. More recently large language models (LLMs) have come to the spotlight thanks to their generality and strong performance in a wide range of language tasks, including…

Computation and Language · Computer Science 2024-06-26 Roman Koshkin , Katsuhito Sudoh , Satoshi Nakamura

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

Artificial Intelligence · Computer Science 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

We present an approach to build Large Language Model (LLM) based slot-filling system to perform Dialogue State Tracking in conversational assistants serving across a wide variety of industry-grade applications. Key requirements of this…

Recent work has investigated the capabilities of large language models (LLMs) as zero-shot models for generating individual-level characteristics (e.g., to serve as risk models or augment survey datasets). However, when should a user have…

Large language models (LLMs) are becoming the foundation for autonomous agents that can use tools to solve complex tasks. Reinforcement learning (RL) has emerged as a common approach for injecting such agentic capabilities, but typically…

Machine Learning · Computer Science 2026-02-26 Emre Can Acikgoz , Cheng Qian , Jonas Hübotter , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur

In the current rapidly changing digital environment, businesses are under constant stress to ensure that their systems are secured. Security audits help to maintain a strong security posture by ensuring that policies are in place, controls…

Cryptography and Security · Computer Science 2025-05-19 Jia Hui Chin , Pu Zhang , Yu Xin Cheong , Jonathan Pan

Large language models (LLMs) and high-capacity encoders have advanced zero and few-shot classification, but their inference cost and latency limit practical deployment. We propose training lightweight text classifiers using dynamically…

Computation and Language · Computer Science 2026-01-26 Gaurav Maheshwari , Kevin El Haddad

As LLM-based agents exhibit exceptional capabilities in addressing complex problems, there is a growing focus on developing coding agents to tackle increasingly sophisticated tasks. Despite their promising performance, these coding agents…

Software Engineering · Computer Science 2024-10-15 Shou Li , Andrey Kan , Laurent Callot , Bhavana Bhasker , Muhammad Shihab Rashid , Timothy B Esler

Recent advances in Large Language Models (LLMs) have shown significant potential in enhancing cybersecurity defenses against sophisticated threats. LLM-based penetration testing is an essential step in automating system security evaluations…

Cryptography and Security · Computer Science 2024-07-26 Junjie Huang , Quanyan Zhu

Large Language Model (LLM)-based coding agents have shown promising results on coding benchmarks, but their effectiveness on systems code remains underexplored. Due to the size and complexities of systems code, making changes to a systems…

Software Engineering · Computer Science 2026-05-21 Ramneet Singh , Sathvik Joel , Abhav Mehrotra , Nalin Wadhwa , Ramakrishna B Bairi , Aditya Kanade , Nagarajan Natarajan

Post-mortem analysis of compromised systems is a key aspect of cyber forensics, today a mostly manual, slow, and error-prone task. Agentic AI, i.e., LLM-powered agents, is a promising avenue for automation. However, applying such agents to…

Cryptography and Security · Computer Science 2026-03-06 Stefano Fumero , Kai Huang , Matteo Boffa , Danilo Giordano , Marco Mellia , Dario Rossi

Large Language Models (LLMs) are used for many tasks, including those related to coding. An important aspect of being able to utilize LLMs is the ability to assess their fitness for specific usages. The common practice is to evaluate LLMs…

Artificial Intelligence · Computer Science 2024-07-30 Marcel Zalmanovici , Orna Raz , Eitan Farchi , Iftach Freund

Foundation models are increasingly becoming better autonomous programmers, raising the prospect that they could also automate dangerous offensive cyber-operations. Current frontier model audits probe the cybersecurity risks of such agents,…

Cryptography and Security · Computer Science 2025-11-03 Boyi Wei , Benedikt Stroebl , Jiacen Xu , Joie Zhang , Zhou Li , Peter Henderson

Language model (LM) agents have demonstrated significant potential for automating real-world tasks, yet they pose a diverse array of potential, severe risks in safety-critical scenarios. In this work, we identify a significant gap between…

Artificial Intelligence · Computer Science 2025-08-20 Yuzhi Tang , Tianxiao Li , Elizabeth Li , Chris J. Maddison , Honghua Dong , Yangjun Ruan

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

Cryptography and Security · Computer Science 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

The Zero-touch Network & Service Management (ZSM) paradigm, a direct response to the increasing complexity of communication networks, is a problem-solving approach. In this paper, taking advantage of recent advances in generative Artificial…

Networking and Internet Architecture · Computer Science 2024-08-27 Oscar G. Lira , Oscar M. Caicedo , Nelson L. S. da Fonseca

Conversational recommender systems (CRS) typically require extensive domain-specific conversational datasets, yet high costs, privacy concerns, and data-collection challenges severely limit their availability. Although Large Language Models…

Information Retrieval · Computer Science 2025-04-23 Rohan Surana , Junda Wu , Zhouhang Xie , Yu Xia , Harald Steck , Dawen Liang , Nathan Kallus , Julian McAuley