中文
相关论文

相关论文: Designing for Human-Agent Alignment: Understanding…

200 篇论文

As AI agents built on large language models (LLMs) become increasingly embedded in society, issues of coordination, control, delegation, and accountability are entangled with concerns over their reliability. To design and implement LLM…

计算机与社会 · 计算机科学 2025-12-09 R. Patrick Xian , Garry A. Gabison , Ahmed Alaa , Christoph Riedl , Grigorios G. Chrysos

There is a growing focus on how to design safe artificial intelligent (AI) agents. As systems become more complex, poorly specified goals or control mechanisms may cause AI agents to engage in unwanted and harmful outcomes. Thus it is…

人工智能 · 计算机科学 2017-01-09 Mark Muraven

As AI becomes more "agentic," it faces technical and socio-legal issues it must address if it is to fulfill its promise of increased economic productivity and efficiency. This paper uses technical and legal perspectives to explain how…

计算机与社会 · 计算机科学 2025-08-13 Mark O. Riedl , Deven R. Desai

Autonomous agents powered by Large Language Models are transforming AI, creating an imperative for the visualization field to embrace agentic frameworks. However, our field's focus on a human in the sensemaking loop raises critical…

人机交互 · 计算机科学 2025-09-17 Vaishali Dhanoa , Anton Wolter , Gabriela Molina León , Hans-Jörg Schulz , Niklas Elmqvist

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

计算与语言 · 计算机科学 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

Humans strive to design safe AI systems that align with our goals and remain under our control. However, as AI capabilities advance, we face a new challenge: the emergence of deeper, more persistent relationships between humans and AI…

人机交互 · 计算机科学 2025-02-05 Hannah Rose Kirk , Iason Gabriel , Chris Summerfield , Bertie Vidgen , Scott A. Hale

Modern AI enables a high-level, declarative form of interaction: Users describe the intended outcome they wish an AI to produce, but do not actually create the outcome themselves. In contrast, in traditional user interfaces, users invoke…

人机交互 · 计算机科学 2024-09-18 Michael Terry , Chinmay Kulkarni , Martin Wattenberg , Lucas Dixon , Meredith Ringel Morris

While we would like agents that can coordinate with humans, current algorithms such as self-play and population-based training create agents that can coordinate with themselves. Agents that assume their partner to be optimal or similar to…

机器学习 · 计算机科学 2020-01-10 Micah Carroll , Rohin Shah , Mark K. Ho , Thomas L. Griffiths , Sanjit A. Seshia , Pieter Abbeel , Anca Dragan

Agentic AIs $-$ AIs that are capable and permitted to undertake complex actions with little supervision $-$ mark a new frontier in AI capabilities and raise new questions about how to safely create and align such systems with users,…

计算机与社会 · 计算机科学 2024-10-04 Hayley Clatterbuck , Clinton Castro , Arvo Muñoz Morán

How can we build AI systems that can learn any set of individual human values both quickly and safely, avoiding causing harm or violating societal standards for acceptable behavior during the learning process? We explore the effects of…

人工智能 · 计算机科学 2024-11-11 Andrea Wynn , Ilia Sucholutsky , Thomas L. Griffiths

From its inception, AI has had a rather ambivalent relationship with humans -- swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI…

人工智能 · 计算机科学 2024-05-28 Sarath Sreedharan , Anagha Kulkarni , Subbarao Kambhampati

Modern AI assistants are trained to follow instructions, implicitly assuming that users can clearly articulate their goals and the kind of assistance they need. Decades of behavioral research, however, show that people often engage with AI…

人工智能 · 计算机科学 2026-04-24 Nathanael Jo , Zoe De Simone , Mitchell Gordon , Ashia Wilson

According to canonical negotiation theory, people's success in a negotiation depends on how well they balance competing demands--empathizing and asserting, demonstrating concern for other and concern for self, being soft on the people and…

人工智能 · 计算机科学 2026-05-21 Michelle A. Vaccaro , Jared R. Curhan

Mixed-initiative visual analytics (VA) systems, where human and artificial intelligence (AI) agents collaborate as equal partners during analysis, represented a paradigm shift in human-computer interaction. With recent advances in AI, these…

We study the problem of designing AI agents that can robustly cooperate with people in human-machine partnerships. Our work is inspired by real-life scenarios in which an AI agent, e.g., a virtual assistant, has to cooperate with new users…

机器学习 · 计算机科学 2020-06-17 Ahana Ghosh , Sebastian Tschiatschek , Hamed Mahdavi , Adish Singla

Designing and evaluating personalized and proactive assistant agents remains challenging due to the time, cost, and ethical concerns associated with human-in-the-loop experimentation. Existing Human-Computer Interaction (HCI) methods often…

人机交互 · 计算机科学 2025-11-25 Ziyi Xuan , Yiwen Wu , Xuhai Xu , Vinod Namboodiri , Mooi Choo Chuah , Yu Yang

Artificial Intelligence (AI) has become an important part of our everyday lives, yet user requirements for designing AI-assisted systems in law enforcement remain unclear. To address this gap, we conducted qualitative research on…

Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet…

信息检索 · 计算机科学 2026-01-06 Nicolas Bougie , Gian Maria Marconi , Tony Yip , Narimasa Watanabe

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

人工智能 · 计算机科学 2026-01-06 Bin Xu

Balancing user agency and system automation is essential for effective human-AI interactions. Fully automated systems can deliver efficiency but risk undermining usability and user autonomy, while purely manual tools are often inefficient…

人机交互 · 计算机科学 2025-02-20 Thomas Langerak