English
Related papers

Related papers: Asset-centric Threat Modeling for AI-based Systems

200 papers

The complex and evolving threat landscape of frontier AI development requires a multi-layered approach to risk management ("defense-in-depth"). By reviewing cybersecurity and AI frameworks, we outline three approaches that can help identify…

Computers and Society · Computer Science 2024-08-16 Shaun Ee , Joe O'Brien , Zoe Williams , Amanda El-Dakhakhni , Michael Aird , Alex Lintz

Current hardware security verification processes predominantly rely on manual threat modeling and test plan generation, which are labor-intensive, error-prone, and struggle to scale with increasing design complexity and evolving attack…

Cryptography and Security · Computer Science 2025-05-13 Dipayan Saha , Hasan Al Shaikh , Shams Tarek , Farimah Farahmandi

Insider threats pose a significant challenge to organizational security, often evading traditional rule-based detection systems due to their subtlety and contextual nature. This paper presents an AI-powered Insider Risk Management (IRM)…

Cryptography and Security · Computer Science 2025-05-08 Lokesh Koli , Shubham Kalra , Rohan Thakur , Anas Saifi , Karanpreet Singh

Numerous safety- or security-critical systems depend on cameras to perceive their surroundings, further allowing artificial intelligence (AI) to analyze the captured images to make important decisions. However, a concerning attack vector…

Cryptography and Security · Computer Science 2024-08-12 Youqian Zhang , Michael Cheung , Chunxi Yang , Xinwei Zhai , Zitong Shen , Xinyu Ji , Eugene Y. Fu , Sze-Yiu Chau , Xiapu Luo

LLMs are increasingly deployed as autonomous agents with access to tools, databases, and external services, yet practitioners (across different sectors) lack systematic methods to assess how known threat classes translate into concrete…

Artificial Intelligence · Computer Science 2026-05-12 Tim Van hamme , Thomas Vissers , Javier Carnerero-Cano , Mario Fritz , Emil C. Lupu , Lieven Desmet , Dinil Mon Divakaran

The literature and multiple experts point to many potential risks from large language models (LLMs), but there are still very few direct measurements of the actual harms posed. AI risk assessment has so far focused on measuring the models'…

Artificial Intelligence · Computer Science 2025-03-11 Malcolm Murray , Henry Papadatos , Otter Quarks , Pierre-François Gimenez , Simeon Campos

This study examines how Artificial Intelligence can aid in identifying and mitigating cyber threats in the U.S. across four key areas: intrusion detection, malware classification, phishing detection, and insider threat analysis. Each of…

As artificial intelligence (AI) assistants become more widely adopted in safety-critical domains, it becomes important to develop safeguards against potential failures or adversarial attacks. A key prerequisite to developing these…

Human-Computer Interaction · Computer Science 2025-04-04 Abed Kareem Musaffar , Anand Gokhale , Sirui Zeng , Rasta Tadayon , Xifeng Yan , Ambuj Singh , Francesco Bullo

The need for secure and private Artificial Intelligence (AI) and Machine Learning (ML) on edge and mobile devices has increased the necessity of protecting the architecture of these systems from threats to both security and privacy. With an…

Cryptography and Security · Computer Science 2026-05-29 Zisis Tsiatsikas , Alexandros Fakis , Georgios Karopoulos , Vasileios Kouliaridis , Marios Anagnostopoulos

Advanced AI models hold the promise of tremendous benefits for humanity, but society needs to proactively manage the accompanying risks. In this paper, we focus on what we term "frontier AI" models: highly capable foundation models that…

AI agent-based systems are becoming increasingly integral to modern software architectures, enabling autonomous decision-making, dynamic task execution, and multimodal interactions through large language models (LLMs). However, these…

The cybersecurity threat landscape has lately become overly complex. Threat actors leverage weaknesses in the network and endpoint security in a very coordinated manner to perpetuate sophisticated attacks that could bring down the entire…

Cryptography and Security · Computer Science 2022-06-07 Mohit Sewak , Sanjay K. Sahay , Hemant Rathore

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

Financial institutions face increasing cyber risk while operating under strict regulatory oversight. To manage this risk, they rely heavily on Cyber Threat Intelligence (CTI) to inform detection, response, and strategic security decisions.…

Cryptography and Security · Computer Science 2026-03-25 Emir Karaosman , Advije Rizvani , Irdin Pekaric

Nowadays, companies are highly exposed to cyber security threats. In many industrial domains, protective measures are being deployed and actively supported by standards. However the global process remains largely dependent on document…

Cryptography and Security · Computer Science 2024-09-13 Christophe Ponsard

As foundation models grow in both popularity and capability, researchers have uncovered a variety of ways that the models can pose a risk to the model's owner, user, or others. Despite the efforts of measuring these risks via benchmarks and…

Cryptography and Security · Computer Science 2025-06-04 David Piorkowski , Michael Hind , John Richards , Jacquelyn Martino

Insider threats, as one type of the most challenging threats in cyberspace, usually cause significant loss to organizations. While the problem of insider threat detection has been studied for a long time in both security and data mining…

Cryptography and Security · Computer Science 2020-05-27 Shuhan Yuan , Xintao Wu

Risk thresholds provide a measure of the level of risk exposure that a society or individual is willing to withstand, ultimately shaping how we determine the safety of technological systems. Against the backdrop of the Cold War, the first…

Computers and Society · Computer Science 2025-04-22 Heidy Khlaaf , Sarah Myers West

Artificial intelligence (AI) is increasingly being used to augment and automate cyber operations, altering the scale, speed, and accessibility of malicious activity. These shifts raise urgent questions about when AI systems introduce…

Cryptography and Security · Computer Science 2026-01-27 Krystal Jackson , Deepika Raman , Jessica Newman , Nada Madkour , Charlotte Yuan , Evan R. Murphy

As the internet continues to be populated with new devices and emerging technologies, the attack surface grows exponentially. Technology is shifting towards a profit-driven Internet of Things market where security is an afterthought.…