English
Related papers

Related papers: Supporting AI/ML Security Workers through an Adver…

200 papers

The advancements in communication technology (5G and beyond) and global connectivity Internet of Things (IoT) also come with new security problems that will need to be addressed in the next few years. The threats and vulnerabilities…

Cryptography and Security · Computer Science 2025-05-27 Sandeep Pirbhulal , Habtamu Abie , Martin Jullum , Didrik Nielsen , Anders Løland

Machine Learning (ML) can be incredibly valuable to automate anomaly detection and cyber-attack classification, improving the way that Network Intrusion Detection (NID) is performed. However, despite the benefits of ML models, they are…

Cryptography and Security · Computer Science 2024-02-27 João Vitorino , Isabel Praça , Eva Maia

The use of Artificial Intelligence (AI) and Machine Learning (ML) to solve cybersecurity problems has been gaining traction within industry and academia, in part as a response to widespread malware attacks on critical systems, such as cloud…

Cryptography and Security · Computer Science 2020-09-24 Maanak Gupta , Sudip Mittal , Mahmoud Abdelsalam

AI leaders and companies have much to offer to AI/ML practitioners to support them in addressing and mitigating biases in the AI/ML systems they develop. AI/ML practitioners need to receive the necessary resources and support from experts…

Software Engineering · Computer Science 2024-07-15 Aastha Pant , Rashina Hoda , Burak Turhan , Chakkrit Tantithamthavorn

Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive---new systems and models are being deployed in every…

Cryptography and Security · Computer Science 2016-11-14 Nicolas Papernot , Patrick McDaniel , Arunesh Sinha , Michael Wellman

This paper introduces a dynamic and actionable framework for securing agentic AI systems in enterprise deployment. We contend that safety and security are not merely fixed attributes of individual models but also emergent properties arising…

Autonomous agents based on large language models (LLMs) are rapidly emerging as a general-purpose technology, with recent systems such as OpenClaw extending their capabilities through broad tool use, third-party skills, and deeper…

Cryptography and Security · Computer Science 2026-05-15 Lukas Pirch , Micha Horlboge , Patrick Großmann , Syeda Mahnur Asif , Klim Kireev , Thorsten Holz , Konrad Rieck

With the recent advancements in machine learning (ML), numerous ML-based approaches have been extensively applied in software analytics tasks to streamline software development and maintenance processes. Nevertheless, studies indicate that…

Software Engineering · Computer Science 2025-07-15 MD Abdul Awal , Mrigank Rochan , Chanchal K. Roy

As Large Language Models (LLMs) are deployed and integrated into thousands of applications, the need for scalable evaluation of how models respond to adversarial attacks grows rapidly. However, LLM security is a moving target: models…

Computation and Language · Computer Science 2024-06-18 Leon Derczynski , Erick Galinkin , Jeffrey Martin , Subho Majumdar , Nanna Inie

Adversarial machine learning (AML) studies the adversarial phenomenon of machine learning, which may make inconsistent or unexpected predictions with humans. Some paradigms have been recently developed to explore this adversarial phenomenon…

Machine Learning · Computer Science 2024-01-05 Baoyuan Wu , Zihao Zhu , Li Liu , Qingshan Liu , Zhaofeng He , Siwei Lyu

There have been recent adversarial attacks that are difficult to find. These new adversarial attacks methods may pose challenges to current deep learning cyber defense systems and could influence the future defense of cyberattacks. The…

Machine Learning · Computer Science 2023-08-25 John Harshith , Mantej Singh Gill , Madhan Jothimani

Recent progress in (Large) Language Models (LMs) has enabled the development of autonomous LM-based agents capable of executing complex tasks with minimal supervision. These agents have started to be integrated into systems with significant…

Cryptography and Security · Computer Science 2026-03-04 Federico Villa , F. Betül Durak , Tadayoshi Kohno , Tapdig Maharramli , Franziska Roesner

Machine learning (ML) and artificial intelligence (AI) have become hot topics in many information processing areas, from chatbots to scientific data analysis. At the same time, there is uncertainty about the possibility of extending…

Artificial Intelligence · Computer Science 2018-06-08 Abel Torres Montoya

An exponential growth of Machine Learning and its Generative AI applications brings with it significant security challenges, often referred to as Adversarial Machine Learning (AML). In this paper, we conducted two comprehensive studies to…

Cryptography and Security · Computer Science 2026-04-28 Vishruti Kakkad , Paul Chung , Hanan Hibshi , Maverick Woo

The increased adoption of Artificial Intelligence (AI) presents an opportunity to solve many socio-economic and environmental challenges; however, this cannot happen without securing AI-enabled technologies. In recent years, most AI models…

Cryptography and Security · Computer Science 2021-02-10 Ayodeji Oseni , Nour Moustafa , Helge Janicke , Peng Liu , Zahir Tari , Athanasios Vasilakos

Large Language Models (LLMs) are increasingly deployed as agentic systems that plan, memorize, and act in open-world environments. This shift brings new security problems: failures are no longer only unsafe text generation, but can become…

Cryptography and Security · Computer Science 2026-03-03 Zhihang Deng , Jiaping Gui , Weinan Zhang

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

Computation and Language · Computer Science 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

From automated intrusion testing to discovery of zero-day attacks before software launch, agentic AI calls for great promises in security engineering. This strong capability is bound with a similar threat: the security and research…

Cryptography and Security · Computer Science 2025-05-13 Brian Challita , Pierre Parrend

The idea of applying machine learning(ML) to solve problems in security domains is almost 3 decades old. As information and communications grow more ubiquitous and more data become available, many security risks arise as well as appetite to…

Cryptography and Security · Computer Science 2016-11-11 Heju Jiang , Jasvir Nagra , Parvez Ahammad

AI agents that combine large language models with non-AI system components are rapidly emerging in real-world applications, offering unprecedented automation and flexibility. However, this unprecedented flexibility introduces complex…

Cryptography and Security · Computer Science 2026-03-13 Juhee Kim , Xiaoyuan Liu , Zhun Wang , Shi Qiu , Bo Li , Wenbo Guo , Dawn Song