English
Related papers

Related papers: When Autonomy Goes Rogue: Preparing for Risks of M…

200 papers

Artificial intelligence (AI) has the potential to greatly improve society, but as with any powerful technology, it comes with heightened risks and responsibilities. Current AI research lacks a systematic discussion of how to manage…

Computers and Society · Computer Science 2022-09-21 Dan Hendrycks , Mantas Mazeika

AI agents are increasingly used in consumer-facing applications to assist with tasks such as product search, negotiation, and transaction execution. In this paper, we explore a future scenario where both consumers and merchants authorize AI…

Artificial Intelligence · Computer Science 2025-09-23 Shenzhe Zhu , Jiao Sun , Yi Nian , Tobin South , Alex Pentland , Jiaxin Pei

The recent trend of self-sovereign Decentralized AI Agents (DeAgents) combines Large Language Model (LLM)-based AI agents with decentralization technologies such as blockchain smart contracts and trusted execution environments (TEEs). These…

Human-Computer Interaction · Computer Science 2025-09-19 Botao Amber Hu , Yuhan Liu , Helena Rong

In the face of rapidly advancing AI technology, individuals will increasingly rely on AI agents to navigate life's growing complexities, raising critical concerns about maintaining both human agency and autonomy. This paper addresses a…

Computers and Society · Computer Science 2025-04-29 Philipp Koralus

AI Agents can perform complex operations at great speed, but just like all the humans we have ever hired, their intelligence remains fallible. Miscommunications aren't noticed, systemic biases have no counter-action, and inner monologues…

Multiagent Systems · Computer Science 2026-01-22 Gopal Vijayaraghavan , Prasanth Jayachandran , Arun Murthy , Sunil Govindan , Vivek Subramanian

As artificial intelligence (AI) becomes increasingly embedded in the core functions of social, political, and economic life, it catalyzes structural transformations with far-reaching societal implications. This paper advances the concept of…

Computers and Society · Computer Science 2025-05-19 Kyle A Kilian

This paper concerns the consensus and formation of a network of mobile autonomous agents in adversarial settings where a group of malicious (compromised) agents are subject to deception attacks. In addition, the communication network is…

Multiagent Systems · Computer Science 2024-10-08 Rayan Bahrami , Hamidreza Jafarnejadsani

As Industrial Internet of Things (IIoT) environments expand to include tens of thousands of connected devices. The centralization of security monitoring architectures creates serious latency issues that savvy attackers can exploit to…

Machine Learning · Computer Science 2026-01-27 Samaresh Kumar Singh , Joyjit Roy

Generative AI systems are increasingly used not only to produce content but also to retrieve data, invoke tools, and execute actions. This work examines the security and safety implications of that shift across content-level, model-level,…

Cryptography and Security · Computer Science 2026-05-19 Zelin Zhang , Qi Li , Jie Cao , Lingshuang Liu , Jianbing Ni

Human behaviors are regularized by a variety of norms or regulations, either to maintain orders or to enhance social welfare. If artificially intelligent (AI) agents make decisions on behalf of human beings, we would hope they can also…

Computer Science and Game Theory · Computer Science 2019-10-28 Fan-Yun Sun , Yen-Yu Chang , Yueh-Hua Wu , Shou-De Lin

Agentic AI systems powered by large language models (LLMs) and endowed with planning, tool use, memory, and autonomy, are emerging as powerful, flexible platforms for automation. Their ability to autonomously execute tasks across web,…

Artificial Intelligence · Computer Science 2026-04-07 Anshuman Chhabra , Shrestha Datta , Shahriar Kabir Nahin , Prasant Mohapatra

Multi-agent systems (MAS), composed of networks of two or more autonomous AI agents, have become increasingly popular in production deployments, yet introduce security risks that do not arise in single-agent settings. Even if individual…

Multiagent Systems · Computer Science 2026-04-28 Ben Hagag , William L. Anderson , Christian Schroeder de Witt , Sarah Scheffler

The integration of Generative Artificial Intelligence (AI) into autonomous machines represents a major paradigm shift in how these systems operate and unlocks new solutions to problems once deemed intractable. Although generative AI agents…

Robotics · Computer Science 2024-10-22 Jason Jabbour , Vijay Janapa Reddi

Recent developments in artificial intelligence (AI) have permeated through an array of different immersive environments, including virtual, augmented, and mixed realities. AI brings a wealth of potential that centers on its ability to…

Human-Computer Interaction · Computer Science 2024-05-10 Wangfan Li , Rohit Mallick , Carlos Toxtli-Hernandez , Christopher Flathmann , Nathan J. McNeese

The trajectory of AI development suggests that we will increasingly rely on agent-based systems composed of independently developed agents with different information, privileges, and tools. The success of these systems will critically…

Artificial Intelligence · Computer Science 2025-11-05 Tim R. Davidson , Adam Fourney , Saleema Amershi , Robert West , Eric Horvitz , Ece Kamar

Multi-agent systems, where LLM agents communicate through free-form language, enable sophisticated coordination for solving complex cooperative tasks. This surfaces a unique safety problem when a group of agents forms a coalition and…

With the widespread adoption of Artificial intelligence (AI), AI-based tools and components are becoming omnipresent in today's solutions. However, these components and tools are posing a significant threat when it comes to adversarial…

Cryptography and Security · Computer Science 2025-06-09 Ruba Nasser , Ahmed Alagha , Shakti Singh , Rabeb Mizouni , Hadi Otrok , Jamal Bentahar

Multi-agent system (MAS) has demonstrated exceptional capabilities in addressing complex challenges, largely due to the integration of multiple large language models (LLMs). However, the heterogeneity of LLMs, the scalability of quantities…

Multiagent Systems · Computer Science 2025-04-11 Yiting Zhang , Yijiang Li , Tianwei Zhao , Kaijie Zhu , Haohan Wang , Nuno Vasconcelos

Securing Agentic Artificial Intelligence (AI) systems requires addressing the complex cyber risks introduced by autonomous, decision-making, and adaptive behaviors. Agentic AI systems are increasingly deployed across industries,…

Cryptography and Security · Computer Science 2025-12-23 Sunil Arora , John Hastings

The implementation of agentic AI systems has the potential of providing more helpful AI systems in a variety of applications. These systems work autonomously towards a defined goal with reduced external control. Despite their potential, one…

Artificial Intelligence · Computer Science 2025-11-13 Niclas Flehmig , Mary Ann Lundteigen , Shen Yin
‹ Prev 1 3 4 5 6 7 10 Next ›