中文
相关论文

相关论文: AGI Agent Safety by Iteratively Improving the Util…

200 篇论文

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

机器学习 · 计算机科学 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

AI-based defensive solutions are necessary to defend networks and information assets against intelligent automated attacks. Gathering enough realistic data for training machine learning-based defenses is a significant practical challenge.…

密码学与安全 · 计算机科学 2021-10-05 Kalle Kujanpää , Willie Victor , Alexander Ilin

AI Alignment is often presented as an interaction between a single designer and an artificial agent in which the designer attempts to ensure the agent's behavior is consistent with its purpose, and risks arise solely because of conflicts…

人工智能 · 计算机科学 2023-09-14 Steve Phelps , Rebecca Ranson

Multimodal AI Agents are AI models that have the capability of interactively and cooperatively assisting human users to solve day-to-day tasks. Augmented Reality (AR) head worn devices can uniquely improve the user experience of solving…

人工智能 · 计算机科学 2025-01-17 Saptarashmi Bandyopadhyay , Vikas Bahirwani , Lavisha Aggarwal , Bhanu Guda , Lin Li , Andrea Colaco

Agent technology, a new paradigm in software engineering, has received attention from research and industry since 1990s. However, it is still not used widely to date because it requires expertise on both programming and agent technology;…

多智能体系统 · 计算机科学 2016-01-26 Siyao Li

AI agents capable of controlling user interfaces have the potential to transform human interaction with digital devices. To accelerate this transformation, two fundamental building blocks are essential: high-quality datasets that enable…

From early days, a key and controversial question inside the artificial intelligence community was whether Artificial General Intelligence (AGI) is achievable. AGI is the ability of machines and computer programs to achieve human-level…

人工智能 · 计算机科学 2022-09-15 Mostafa Haghir Chehreghani

Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomously interact with digital systems or software applications…

AI scientists powered by large language models have demonstrated substantial promise in autonomously conducting experiments and facilitating scientific discoveries across various disciplines. While their capabilities are promising, these…

Artificial agents are promising for real-time power network operations, particularly, to compute remedial actions for congestion management. However, due to high reliability requirements, purely autonomous agents will not be deployed any…

The use of reward functions to structure AI learning and decision making is core to the current reinforcement learning paradigm; however, without careful design of reward functions, agents can learn to solve problems in ways that may be…

人工智能 · 计算机科学 2025-01-22 Jonathan Keane , Sam Keyser , Jeremy Kedziora

GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is described with radically different degrees of autonomy, obscuring…

软件工程 · 计算机科学 2026-02-13 Sidong Feng , Chunyang Chen

Evolving AI systems increasingly deploy multi-agent architectures where autonomous agents collaborate, share information, and delegate tasks through developing protocols. This connectivity, while powerful, introduces novel security risks.…

密码学与安全 · 计算机科学 2025-07-30 Gauri Sharma , Vidhi Kulkarni , Miles King , Ken Huang

Producing an artificial general intelligence (AGI) has been an elusive goal in artificial intelligence (AI) research for some time. An AGI would have the capability, like a human, to be exposed to a new problem domain, learn about it and…

人工智能 · 计算机科学 2024-06-18 Jeremy Straub

Equipped with various tools and knowledge, GPTs, one kind of customized AI agents based on OpenAI's large language models, have illustrated great potential in many fields, such as writing, research, and programming. Today, the number of…

密码学与安全 · 计算机科学 2025-12-02 Tong Wu , Weibin Wu , Zibin Zheng

Recent AI progress has outpaced expectations, with some experts now predicting AI that matches or exceeds human capabilities in all cognitive areas (AGI) could emerge this decade, potentially posing grave national and global security…

计算机与社会 · 计算机科学 2025-07-30 Sarah Hastings-Woodhouse

In recent years, a myriad of superlative works on intelligent robotics policies have been done, thanks to advances in machine learning. However, inefficiency and lack of transfer ability hindered algorithms from pragmatic applications,…

人工智能 · 计算机科学 2022-09-23 Yiwen Chen , Zedong Zhang , Haofeng Liu , Jiayi Tan , Chee-Meng Chew , Marcelo Ang

The rise of AI agents is transforming how software can be built. The promise of agents is that developers might write code quicker, delegate multiple tasks to different agents, and even write a full piece of software purely out of natural…

软件工程 · 计算机科学 2025-12-17 Ruanqianqian Huang , Avery Reyna , Sorin Lerner , Haijun Xia , Brian Hempel

Large language model (LLM) agents increasingly rely on external tools and retrieval systems to autonomously complete complex tasks. However, this design exposes agents to indirect prompt injection (IPI), where attacker-controlled context…

密码学与安全 · 计算机科学 2026-02-27 Tian Zhang , Yiwei Xu , Juan Wang , Keyan Guo , Xiaoyang Xu , Bowen Xiao , Quanlong Guan , Jinlin Fan , Jiawei Liu , Zhiquan Liu , Hongxin Hu

Contemporary benchmarks for agentic artificial intelligence (AI) frequently evaluate safety through isolated task-level accuracy thresholds, implicitly treating autonomous systems as single points of failure. This single-channel paradigm…

计算机与社会 · 计算机科学 2026-02-24 Nelu D. Radpour