English
Related papers

Related papers: PAC-BENCH: Evaluating Multi-Agent Collaboration un…

200 papers

Multi-agent systems represent a significant advancement in artificial intelligence, enabling complex problem-solving through coordinated specialized agents. However, these systems face fundamental challenges in context management,…

Multiagent Systems · Computer Science 2025-05-01 Naveen Krishnan

Existing benchmarks for conversational AI agents simulate single-control environments, where only the AI agent can use tools to interact with the world, while the user remains a passive information provider. This differs from real-world…

Artificial Intelligence · Computer Science 2025-06-10 Victor Barres , Honghua Dong , Soham Ray , Xujie Si , Karthik Narasimhan

Collaborative multi-agent reinforcement learning has rapidly evolved, offering state-of-the-art algorithms for real-world applications, including sensitive domains. However, a key challenge to its widespread adoption is the lack of a…

Machine Learning · Computer Science 2026-01-22 Amine Andam , Jamal Bentahar , Mustapha Hedabou

AI intensive systems that operate upon user data face the challenge of balancing data utility with privacy concerns. We propose the idea and present the prototype of an open-source tool called Privacy Utility Trade-off (PUT) Workbench which…

Cryptography and Security · Computer Science 2019-02-06 Saurabh Srivastava , Vinay P. Namboodiri , T. V. Prabhakar

AI is becoming increasingly integrated into everyday life, both in professional work environments and in leisure and entertainment contexts. This integration requires AI to move beyond acting as an assistant for informational or…

Human-Computer Interaction · Computer Science 2026-02-26 Christian Poelitz , Finale Doshi-Velez , Siân Lindley

The proliferation of LLM-based agents has led to increasing deployment of inter-agent collaboration for tasks like scheduling, negotiation, resource allocation etc. In such systems, privacy is critical, as agents often access proprietary…

Artificial Intelligence · Computer Science 2025-06-27 Gurusha Juneja , Alon Albalak , Wenyue Hua , William Yang Wang

Agents based on large language models leverage tools to modify environments, revolutionizing how AI interacts with the physical world. Unlike traditional NLP tasks that rely solely on historical dialogue for responses, these agents must…

Artificial Intelligence · Computer Science 2025-06-30 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

Large language model (LLM) agents face a structural tension: cloud agents provide strong reasoning but expose user data, while on-device agents preserve privacy at the cost of overall capability. Existing device-cloud designs treat this…

Machine Learning · Computer Science 2026-05-12 Liangqi Yuan , Wenzhi Fang , Shiqiang Wang , Christopher G. Brinton

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Large language model agents that interact with PC applications often face limitations due to their singular mode of interaction with real-world environments, leading to restricted versatility and frequent hallucinations. To address this, we…

Artificial Intelligence · Computer Science 2025-03-25 Zirui Song , Yaohang Li , Meng Fang , Yanda Li , Zhenhao Chen , Zecheng Shi , Yuan Huang , Xiuying Chen , Ling Chen

Credible commitment devices have been a popular approach for robust multi-agent coordination. However, existing commitment mechanisms face limitations like privacy, integrity, and susceptibility to mediator or user strategic behavior. It is…

Artificial Intelligence · Computer Science 2023-11-15 Xinyuan Sun , Davide Crapis , Matt Stephenson , Barnabé Monnot , Thomas Thiery , Jonathan Passerat-Palmbach

Increased delegation of commercial, scientific, governmental, and personal activities to AI agents -- systems capable of pursuing complex goals with limited supervision -- may exacerbate existing societal risks and introduce new risks.…

People frequently face challenging decision-making problems in which outcomes are uncertain or unknown. Artificial intelligence (AI) algorithms exist that can outperform humans at learning such tasks. Thus, there is an opportunity for AI…

Artificial Intelligence · Computer Science 2018-12-27 Ravi Pandya , Sandy H. Huang , Dylan Hadfield-Menell , Anca D. Dragan

Addressing contextual privacy concerns remains challenging in interactive settings where large language models (LLMs) process information from multiple sources (e.g., summarizing meetings with private and public information). We introduce a…

Artificial Intelligence · Computer Science 2026-02-26 Wenkai Li , Liwen Sun , Zhenxiang Guan , Xuhui Zhou , Maarten Sap

AI chatbots designed as emotional companions blur the boundaries between interpersonal intimacy and institutional software, creating a complex, multi-dimensional privacy environment. Drawing on Communication Privacy Management theory and…

Cryptography and Security · Computer Science 2026-01-19 Hsuen-Chi Chiu , Jeremy Foote

As AI agents evolve, the community is rapidly shifting from single Large Language Models (LLMs) to Multi-Agent Systems (MAS) to overcome cognitive bottlenecks in automated research. However, the optimal multi-agent coordination framework…

Multiagent Systems · Computer Science 2026-05-12 Yang Shen , Zhenyi Yi , Ziyi Zhao , Lijun Sun , Dongyang Li , Chin-Teng Lin , Yuhui Shi

Benchmarks are essential for quantitatively tracking progress in AI. As AI agents become increasingly capable, researchers and practitioners have introduced agentic benchmarks to evaluate agents on complex, real-world tasks. These…

The study of cooperation within social dilemmas has long been a fundamental topic across various disciplines, including computer science and social science. Recent advancements in Artificial Intelligence (AI) have significantly reshaped…

Artificial Intelligence · Computer Science 2024-07-31 Chunjiang Mu , Hao Guo , Yang Chen , Chen Shen , Shuyue Hu , Zhen Wang

Workspace learning requires AI agents to identify, reason over, exploit, and update explicit and implicit dependencies among heterogeneous files in a worker's workspace, enabling them to complete both routine and advanced tasks effectively.…

As language models evolve into autonomous agents that act and communicate on behalf of users, ensuring safety in multi-agent ecosystems becomes a central challenge. Interactions between personal assistants and external service providers…

Cryptography and Security · Computer Science 2025-11-10 Amr Gomaa , Ahmed Salem , Sahar Abdelnabi