English
Related papers

Related papers: Offensive Security for AI Systems: Concepts, Pract…

200 papers

The critical need for transparent and trustworthy machine learning in cybersecurity operations drives the development of this integrated Explainable AI (XAI) framework. Our methodology addresses three fundamental challenges in deploying AI…

Cryptography and Security · Computer Science 2026-02-24 Norrakith Srisumrith , Sunantha Sodsee

In recent years machine learning algorithms, and more specifically deep learning algorithms, have been widely used in many fields, including cyber security. However, machine learning systems are vulnerable to adversarial attacks, and this…

Machine Learning · Computer Science 2021-03-16 Ihai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

Over the last decade, Artificial Intelligence (AI) has become increasingly popular, especially with the use of chatbots such as ChatGPT, Gemini, and DALL-E. With this rise, large language models (LLMs) and Generative AI (GenAI) have also…

Cryptography and Security · Computer Science 2024-03-20 Yagmur Yigit , William J Buchanan , Madjid G Tehrani , Leandros Maglaras

As the number of cyber-attacks is increasing, cybersecurity is evolving to a key concern for any business. Artificial Intelligence (AI) and Machine Learning (ML) (in particular Deep Learning - DL) can be leveraged as key enabling…

Cryptography and Security · Computer Science 2020-12-08 Mayra Macas , Chunming Wu

As generative AI, particularly large language models (LLMs), become increasingly integrated into production applications, new attack surfaces and vulnerabilities emerge and put a focus on adversarial threats in natural language and…

With the advent of the digital era, every day-to-day task is automated due to technological advances. However, technology has yet to provide people with enough tools and safeguards. As the internet connects more-and-more devices around the…

Cryptography and Security · Computer Science 2022-09-28 Abhilash Chakraborty , Anupam Biswas , Ajoy Kumar Khan

AI alignment research aims to develop techniques to ensure that AI systems do not cause harm. However, every alignment technique has failure modes, which are conditions in which there is a non-negligible chance that the technique fails to…

Artificial Intelligence · Computer Science 2025-10-14 Leonard Dung , Florian Mai

Artificial Intelligence is rapidly embedding itself within militaries, economies, and societies, reshaping their very foundations. Given the depth and breadth of its consequences, it has never been more pressing to understand how to ensure…

Machine Learning · Computer Science 2024-11-19 Dan Hendrycks

Agentic AI marks an important transition from single-step generative models to systems capable of reasoning, planning, acting, and adapting over long-lasting tasks. By integrating memory, tool use, and iterative decision cycles, these…

Cryptography and Security · Computer Science 2026-01-12 Sahaya Jestus Lazer , Kshitiz Aryal , Maanak Gupta , Elisa Bertino

An Artificial Intelligence (AI) agent is a software entity that autonomously performs tasks or makes decisions based on pre-defined objectives and data inputs. AI agents, capable of perceiving user inputs, reasoning and planning tasks, and…

Cryptography and Security · Computer Science 2025-11-26 Zehang Deng , Yongjian Guo , Changzhou Han , Wanlun Ma , Junwu Xiong , Sheng Wen , Yang Xiang

Recent advancements in the field of Artificial Intelligence (AI) establish the basis to address challenging tasks. However, with the integration of AI, new risks arise. Therefore, to benefit from its advantages, it is essential to…

Machine Learning · Computer Science 2024-12-20 Ronald Schnitzer , Andreas Hapfelmeier , Sven Gaube , Sonja Zillner

Artificial Intelligence (AI) is rapidly being integrated into critical systems across various domains, from healthcare to autonomous vehicles. While its integration brings immense benefits, it also introduces significant risks, including…

Computers and Society · Computer Science 2025-06-25 Zhiqiang Lin , Huan Sun , Ness Shroff

In this position paper, we address the persistent gap between rapidly growing AI capabilities and lagging safety progress. Existing paradigms divide into ``Make AI Safe'', which applies post-hoc alignment and guardrails but remains brittle…

Machine Learning · Computer Science 2025-09-09 Youbang Sun , Xiang Wang , Jie Fu , Chaochao Lu , Bowen Zhou

In the rapidly evolving field of cybersecurity, ensuring the reproducibility of AI-driven research is critical to maintaining the reliability and integrity of security systems. This paper addresses the reproducibility crisis within the…

Machine Learning · Computer Science 2024-12-17 Richard H. Moulton , Gary A. McCully , John D. Hastings

As AI systems grow more capable and autonomous, ensuring their safety and reliability requires not only model-level alignment but also strategic oversight of the humans and institutions involved in their development and deployment. Existing…

Artificial Intelligence · Computer Science 2026-02-10 Cheol Woo Kim , Davin Choo , Tzeh Yuan Neoh , Milind Tambe

Deep learning has emerged as a strong and efficient framework that can be applied to a broad spectrum of complex learning problems which were difficult to solve using the traditional machine learning techniques in the past. In the last few…

Machine Learning · Computer Science 2018-10-02 Anirban Chakraborty , Manaar Alam , Vishal Dey , Anupam Chattopadhyay , Debdeep Mukhopadhyay

Cybersecurity is being fundamentally reshaped by foundation-model-based artificial intelligence. Large language models now enable autonomous planning, tool orchestration, and strategic adaptation at scale, challenging security architectures…

Cryptography and Security · Computer Science 2025-12-30 Tao Li , Quanyan Zhu

Smart grid systems are critical to the power industry, however their sophisticated architectural design and operations expose them to a number of cybersecurity threats, such as data tampering, data eavesdropping, and Denial of Service,…

Cryptography and Security · Computer Science 2022-02-16 J. D. Ndibwile

The rapid advancement of large models, driven by their exceptional abilities in learning and generalization through large-scale pre-training, has reshaped the landscape of Artificial Intelligence (AI). These models are now foundational to a…

Emerging Distributed AI systems are revolutionizing big data computing and data processing capabilities with growing economic and societal impact. However, recent studies have identified new attack surfaces and risks caused by security,…

Machine Learning · Computer Science 2024-02-05 Wenqi Wei , Ling Liu