English
Related papers

Related papers: Supporting AI/ML Security Workers through an Adver…

200 papers

Software systems are increasingly relying on Artificial Intelligence (AI) and Machine Learning (ML) components. The emerging popularity of AI techniques in various application domains attracts malicious actors and adversaries. Therefore,…

Cryptography and Security · Computer Science 2022-02-22 Mohamad Fazelnia , Igor Khokhlov , Mehdi Mirakhorli

Artificial intelligence (AI) and machine learning (ML) have become increasingly vital in the development of novel defense and intelligence capabilities across all domains of warfare. An adversarial AI (A2I) and adversarial ML (AML) attack…

The MITRE ATT&CK framework is a widely adopted tool for enhancing cybersecurity, supporting threat intelligence, incident response, attack modeling, and vulnerability prioritization. This paper synthesizes research on its application across…

Cryptography and Security · Computer Science 2025-02-18 Yuning Jiang , Qiaoran Meng , Feiyang Shang , Nay Oo , Le Thi Hong Minh , Hoon Wei Lim , Biplab Sikdar

Agentic AI systems powered by large language models (LLMs) and endowed with planning, tool use, memory, and autonomy, are emerging as powerful, flexible platforms for automation. Their ability to autonomously execute tasks across web,…

Artificial Intelligence · Computer Science 2026-04-07 Anshuman Chhabra , Shrestha Datta , Shahriar Kabir Nahin , Prasant Mohapatra

Large language models (LLMs) used across enterprises often use proprietary models and operate on sensitive inputs and data. The wide range of attack vectors identified in prior research - targeting various software and hardware components…

Cryptography and Security · Computer Science 2024-11-21 Sarbartha Banerjee , Prateek Sahu , Mulong Luo , Anjo Vahldiek-Oberwagner , Neeraja J. Yadwadkar , Mohit Tiwari

Based on interviews with 28 organizations, we found that industry practitioners are not equipped with tactical and strategic tools to protect, detect and respond to attacks on their Machine Learning (ML) systems. We leverage the insights…

Computers and Society · Computer Science 2021-03-22 Ram Shankar Siva Kumar , Magnus Nyström , John Lambert , Andrew Marshall , Mario Goertzel , Andi Comissoneru , Matt Swann , Sharon Xia

The ever-growing big data and emerging artificial intelligence (AI) demand the use of machine learning (ML) and deep learning (DL) methods. Cybersecurity also benefits from ML and DL methods for various types of applications. These methods…

Machine Learning · Computer Science 2019-07-18 Arif Siddiqi

This research provides a comprehensive overview of adversarial attacks on AI and ML models, exploring various attack types, techniques, and their potential harms. We also delve into the business implications, mitigation strategies, and…

The MITRE ATT&CK framework, a comprehensive knowledge base of adversary tactics and techniques, has been widely adopted by the cybersecurity industry as well as by academic researchers. Its broad range of industry applications include…

Cryptography and Security · Computer Science 2023-04-18 Shanto Roy , Emmanouil Panaousis , Cameron Noakes , Aron Laszka , Sakshyam Panda , George Loukas

Adversarial Machine Learning (AML) addresses vulnerabilities in AI systems where adversaries manipulate inputs or training data to degrade performance. This article provides a comprehensive analysis of evasion and poisoning attacks,…

Cryptography and Security · Computer Science 2025-02-11 Pranav K Jha

Security Operations Centers (SOCs) face growing challenges in managing cybersecurity threats due to an overwhelming volume of alerts, a shortage of skilled analysts, and poorly integrated tools. Human-AI collaboration offers a promising…

Cryptography and Security · Computer Science 2025-05-13 Massimiliano Albanese , Xinming Ou , Kevin Lybarger , Daniel Lende , Dmitry Goldgof

As the number of cyber-attacks is increasing, cybersecurity is evolving to a key concern for any business. Artificial Intelligence (AI) and Machine Learning (ML) (in particular Deep Learning - DL) can be leveraged as key enabling…

Cryptography and Security · Computer Science 2020-12-08 Mayra Macas , Chunming Wu

Adversarial Machine Learning (AML) is emerging as a major field aimed at protecting machine learning (ML) systems against security threats: in certain scenarios there may be adversaries that actively manipulate input data to fool learning…

Artificial Intelligence · Computer Science 2024-02-23 David Rios Insua , Roi Naveiro , Victor Gallego , Jason Poulos

AI agents, specifically powered by large language models, have demonstrated exceptional capabilities in various applications where precision and efficacy are necessary. However, these agents come with inherent risks, including the potential…

Cryptography and Security · Computer Science 2025-03-04 Ishaan Domkundwar , Mukunda N S , Ishaan Bhola , Riddhik Kochhar

Multi-Agent Reinforcement Learning (MARL) is vulnerable to Adversarial Machine Learning (AML) attacks and needs adequate defences before it can be used in real world applications. We have conducted a survey into the use of execution-time…

Machine Learning · Computer Science 2023-01-12 Maxwell Standen , Junae Kim , Claudia Szabo

As artificial intelligence (AI) assistants become more widely adopted in safety-critical domains, it becomes important to develop safeguards against potential failures or adversarial attacks. A key prerequisite to developing these…

Human-Computer Interaction · Computer Science 2025-04-04 Abed Kareem Musaffar , Anand Gokhale , Sirui Zeng , Rasta Tadayon , Xifeng Yan , Ambuj Singh , Francesco Bullo

Adversarial attack breaks the boundaries of traditional security defense. For adversarial attack and the characteristics of cloud services, we propose Security Development Lifecycle for Machine Learning applications, e.g., SDL for ML. The…

Machine Learning · Computer Science 2020-08-06 Dou Goodman , Hao Xin

Engineering more secure software has become a critical challenge in the cyber world. It is very important to develop methodologies, techniques, and tools for developing secure software. To develop secure software, software developers need…

Software Engineering · Computer Science 2023-02-14 Nicholas Lasky , Benjamin Hallis , Mounika Vanamala , Rushit Dave , Jim Seliya

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through…

Cryptography and Security · Computer Science 2024-12-19 Yifeng He , Ethan Wang , Yuyang Rong , Zifei Cheng , Hao Chen

MITRE ATT&CK is a comprehensive framework of adversary tactics, techniques and procedures based on real-world observations. It has been used as a foundation for threat modelling in different sectors, such as government, academia and…

Cryptography and Security · Computer Science 2023-08-29 Bader Al-Sada , Alireza Sadighian , Gabriele Oligeri
‹ Prev 1 2 3 10 Next ›