English
Related papers

Related papers: Lessons From Red Teaming 100 Generative AI Product…

200 papers

Artificial intelligence (AI) is reshaping society, from video generation to medical diagnosis, coding agents to autonomous vehicles. Yet researchers, policymakers, and technology companies lack shared terminology for discussing AI risks.…

As agentic systems move into real-world deployments, their decisions increasingly depend on external inputs such as retrieved content, tool outputs, and information provided by other actors. When these inputs can be strategically shaped by…

Artificial Intelligence · Computer Science 2026-03-24 Shouqiao Wang , Marcello Politi , Samuele Marro , Davide Crapis

AI systems are being deployed to support human decision making in high-stakes domains. In many cases, the human and AI form a team, in which the human makes decisions after reviewing the AI's inferences. A successful partnership requires…

Human-Computer Interaction · Computer Science 2019-06-06 Gagan Bansal , Besmira Nushi , Ece Kamar , Dan Weld , Walter Lasecki , Eric Horvitz

Machine learning techniques are finding many applications in computer systems, including many tasks that require decision making: network optimization, quality of service assurance, and security. We believe machine learning systems are here…

Computers and Society · Computer Science 2019-12-02 David Mohaisen , Songqing Chen

Organisations are starting to adopt LLM-based AI agents, with their deployments naturally evolving from single agents towards interconnected, multi-agent networks. Yet a collection of safe agents does not guarantee a safe collection of…

Multiagent Systems · Computer Science 2025-08-11 Alistair Reid , Simon O'Callaghan , Liam Carroll , Tiberio Caetano

We want language model assistants to conform to a character specification, which asserts how the model should act across diverse user interactions. While models typically follow these character specifications, they can occasionally violate…

Machine Learning · Computer Science 2026-02-16 Nate Rahn , Allison Qi , Avery Griffin , Jonathan Michala , Henry Sleight , Erik Jones

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, yet they pose significant security risks that threaten their safe deployment in critical domains. Current security alignment methodologies…

Cryptography and Security · Computer Science 2025-07-22 Pengfei Du

Artificial intelligence (AI) and Machine Learning (ML) have moved from research and pilot projects into everyday business operations, with generative AI accelerating adoption across processes, products, and services. This paper introduces…

Computers and Society · Computer Science 2026-02-17 Stephan Sandfuchs , Diako Farooghi , Janis Mohr , Sarah Grewe , Markus Lemmen , Jörg Frochte

Warning: this paper contains content that may be inappropriate or offensive. As generative models become available for public use in various applications, testing and analyzing vulnerabilities of these models has become a priority. In this…

Artificial Intelligence · Computer Science 2024-11-11 Ninareh Mehrabi , Palash Goyal , Christophe Dupuy , Qian Hu , Shalini Ghosh , Richard Zemel , Kai-Wei Chang , Aram Galstyan , Rahul Gupta

Many leading AI researchers expect AI development to exceed the transformative impact of all previous technological revolutions. This belief is based on the idea that AI will be able to automate the process of AI research itself, leading to…

Computers and Society · Computer Science 2026-03-09 Severin Field , Raymond Douglas , David Krueger

Large Language Models (LLMs) are set to reshape cybersecurity by augmenting red and blue team operations. Red teams can exploit LLMs to plan attacks, craft phishing content, simulate adversaries, and generate exploit code. Conversely, blue…

Cryptography and Security · Computer Science 2025-06-17 Alsharif Abuadbba , Chris Hicks , Kristen Moore , Vasilios Mavroudis , Burak Hasircioglu , Diksha Goel , Piers Jennings

Agentic AI systems, specifically LLM-driven agents that plan, invoke tools, maintain persistent memory, and delegate tasks to peer agents via protocols such as MCP and A2A, introduce a threat surface that differs materially from standalone…

Cryptography and Security · Computer Science 2026-05-08 Javad Forough , Marios Kogias , Hamed Haddadi

Generative AI is reshaping offensive cybersecurity by enabling autonomous red team agents that can plan, execute, and adapt during penetration tests. However, existing approaches face trade-offs between generality and specialization, and…

Cryptography and Security · Computer Science 2025-11-25 Strahinja Janjusevic , Anna Baron Garcia , Sohrob Kazerounian

With the ongoing rapid adoption of Artificial Intelligence (AI)-based systems in high-stakes domains, ensuring the trustworthiness, safety, and observability of these systems has become crucial. It is essential to evaluate and monitor AI…

Computation and Language · Computer Science 2024-07-19 Krishnaram Kenthapadi , Mehrnoosh Sameki , Ankur Taly

Agent skills extend LLM agents with reusable instructions, tool interfaces, and executable code, and users increasingly install third-party skills from marketplaces, repositories, and community channels. Because a skill exposes both…

Cryptography and Security · Computer Science 2026-05-13 Zhaojiacheng Zhou

This paper proposes an Artificial Intelligence (AI) Grounded Theory for management studies. We argue that this novel and rigorous approach that embeds topic modelling will lead to the latent knowledge to be found. We illustrate this…

Human-Computer Interaction · Computer Science 2022-07-07 Eyyub Can Odacioglu , Lihong Zhang , Richard Allmendinger

This paper presents the vision, scientific contributions, and technical details of RedTWIZ: an adaptive and diverse multi-turn red teaming framework, to audit the robustness of Large Language Models (LLMs) in AI-assisted software…

With the rise of text-to-image (T2I) generative AI models reaching wide audiences, it is critical to evaluate model robustness against non-obvious attacks to mitigate the generation of offensive images. By focusing on ``implicitly…

Generative AI, the most popular current approach to AI, consists of large language models (LLMs) that are trained to produce outputs that are plausible, but not necessarily correct. Although their abilities are often uncanny, they are…

Machine Learning · Computer Science 2023-08-10 Doug Lenat , Gary Marcus

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks, but their vulnerability to jailbreak attacks poses significant security risks. This survey paper presents a comprehensive analysis…

Computation and Language · Computer Science 2024-12-18 Tarun Raheja , Nilay Pochhi , F. D. C. M. Curie