中文
相关论文

相关论文: Categorizing Wireheading in Partially Embedded Age…

200 篇论文

Multi-modal AI systems will likely become a ubiquitous presence in our everyday lives. A promising approach to making these systems more interactive is to embody them as agents within physical and virtual environments. At present, systems…

Agentic AI systems, specifically LLM-driven agents that plan, invoke tools, maintain persistent memory, and delegate tasks to peer agents via protocols such as MCP and A2A, introduce a threat surface that differs materially from standalone…

密码学与安全 · 计算机科学 2026-05-08 Javad Forough , Marios Kogias , Hamed Haddadi

Tool-integrated agents are deployed on the premise that external tools ground their outputs in reality. Yet this very reliance creates a critical attack surface. Current evaluations benchmark capability in benign settings, asking "can the…

人工智能 · 计算机科学 2026-04-22 Zhonghao Zhan , Huichi Zhou , Zhenhao Li , Peiyuan Jing , Krinos Li , Hamed Haddadi

Understanding an agent's goals helps explain and predict its behaviour, yet there is no established methodology for reliably attributing goals to agentic systems. We propose a framework for evaluating goal-directedness that integrates…

As Large Language Model (LLM) agents become more widespread, associated misalignment risks increase. While prior research has studied agents' ability to produce harmful outputs or follow malicious instructions, it remains unclear how likely…

Artificial General Intelligence (AGI), widely regarded as the fundamental goal of artificial intelligence, represents the realization of cognitive capabilities that enable the handling of general tasks with human-like proficiency.…

神经与进化计算 · 计算机科学 2024-12-13 Bo Yu , Jiangning Wei , Minzhen Hu , Zejie Han , Tianjian Zou , Ye He , Jun Liu

We introduce WebGames, a comprehensive benchmark suite designed to evaluate general-purpose web-browsing AI agents through a collection of 50+ interactive challenges. These challenges are specifically crafted to be straightforward for…

Open agentic systems combine LLM-based planning with external capabilities, persistent memory, and privileged execution. They are used in coding assistants, browser copilots, and enterprise automation. OpenClaw is a visible instance of this…

密码学与安全 · 计算机科学 2026-03-30 Shiping Chen , Qin Wang , Guangsheng Yu , Xu Wang , Liming Zhu

Deep reinforcement learning is a technique for solving problems in a variety of environments, ranging from Atari video games to stock trading. This method leverages deep neural network models to make decisions based on observations of a…

机器学习 · 计算机科学 2022-09-13 Anthony Dowling

Existing frameworks for LLM-based agent architectures describe systems from a single perspective: industry guides (Anthropic, Google, LangChain) focus on execution topology -- how data flows -- while cognitive science surveys focus on…

人工智能 · 计算机科学 2026-05-26 Jia Huang , Joey Tianyi Zhou

In multi-agent systems, the agents may have goals that depend on a social, shared interpretation about the facts occurring in the system. These are the so-called social goals. Artificial institutions provide such a social interpretation by…

多智能体系统 · 计算机科学 2021-05-04 Rafhael R. Cunha , Jomi Fred Hübner , Maiquel de Brito

Spatial reasoning in partially observable environments has often been approached through passive predictive models, yet theories of embodied cognition suggest that genuinely useful representations arise only when perception is tightly…

人工智能 · 计算机科学 2025-04-29 Li Jin , Liu Jia

In a social system, the self-interest of agents can be detrimental to the collective good, sometimes leading to social dilemmas. To resolve such a conflict, a central designer may intervene by either redesigning the system or incentivizing…

机器学习 · 计算机科学 2020-10-28 Jiayang Li , Jing Yu , Yu Marco Nie , Zhaoran Wang

During the first step of practical reasoning, i.e. deliberation or goals selection, an intelligent agent generates a set of pursuable goals and then selects which of them he commits to achieve. Explainable Artificial Intelligence (XAI)…

人工智能 · 计算机科学 2020-09-15 Mariela Morveli-Espinoza , Cesar Augusto Tacla , Henrique Jasinski

We consider a multi-agent reinforcement learning problem where each agent seeks to maximize a shared reward while interacting with other agents, and they may or may not be able to communicate. Typically the agents do not have access to…

多智能体系统 · 计算机科学 2021-04-26 Alex Tong Lin , Mark J. Debord , Katia Estabridis , Gary Hewer , Guido Montufar , Stanley Osher

Web-use agents are rapidly being deployed to automate complex web tasks with extensive browser capabilities. However, these capabilities create a critical and previously unexplored attack surface. This paper demonstrates how attackers can…

密码学与安全 · 计算机科学 2025-10-22 Avishag Shapira , Parth Atulbhai Gandhi , Edan Habler , Asaf Shabtai

AI agents are beginning to interact with each other directly and across internet platforms and physical environments, creating security challenges beyond traditional cybersecurity and AI safety frameworks. Free-form protocols are essential…

The current advancement in and deployment of agentic AI systems has created a set of key challenges for the legal frameworks that govern their use. We cover two central components: first, the regulatory classification of agents under the EU…

计算机与社会 · 计算机科学 2026-04-28 Philipp Hacker , Matthias Holweg

AI agents that take actions in their environment autonomously over extended time horizons require robust governance interventions to curb their potentially consequential risks. Prior proposals for governing AI agents primarily target…

计算机与社会 · 计算机科学 2025-12-02 K. J. Kevin Feng , Tae Soo Kim , Rock Yuren Pang , Faria Huq , Tal August , Amy X. Zhang

Ad hoc teamwork refers to the problem of enabling an agent to collaborate with teammates without prior coordination. Data-driven methods represent the state of the art in ad hoc teamwork. They use a large labeled dataset of prior…

人工智能 · 计算机科学 2023-06-02 Hasra Dodampegama , Mohan Sridharan