English
Related papers

Related papers: Collaborating with AI Agents: Field Experiments on…

200 papers

Saving, or checkpointing, intermediate results during interactive data exploration can potentially boost user productivity. However, existing studies on this topic are limited, as they primarily rely on small-scale experiments with human…

Human-Computer Interaction · Computer Science 2025-04-03 Hanxi Fang , Supawit Chockchowwat , Hari Sundaram , Yongjoo Park

Agentic AI systems that autonomously perform service tasks are entering customer service operations. However, limited evidence exists on how human interventions shape service outcomes when agentic AI failures create both cognitive and…

Human-Computer Interaction · Computer Science 2026-05-15 Yiwei Wang , Chuan Zhu , Tianjun Feng , Lauren Xiaoyuan Lu , Bingxin Jia

Measuring developer productivity is a topic that has attracted attention from both academic research and industrial practice. In the age of AI coding assistants, it has become even more important for both academia and industry to understand…

Software Engineering · Computer Science 2026-02-04 Valerie Chen , Jasmyn He , Behnjamin Williams , Jason Valentino , Ameet Talwalkar

The emergence of Generative AI (Gen AI) has motivated an interest in understanding how it could be used to enhance productivity across various tasks. We add to research results for the performance impact of Gen AI on complex knowledge-based…

General Finance · Quantitative Finance 2025-02-14 Trevor Fitzpatrick , Seamus Kelly , Patrick Carey , David Walsh , Ruairi Nugent

Recently, large language models have facilitated the emergence of highly intelligent conversational AI capable of engaging in human-like dialogues. However, a notable distinction lies in the fact that these AI models predominantly generate…

Human-Computer Interaction · Computer Science 2025-10-13 Jijie Zhou , Yuhan Hu

Resolving team conflicts requires not only task-specific competence, but also social intelligence to find common ground and build consensus. As AI agents increasingly collaborate on complex work, they must develop coordination capabilities…

AI is increasingly deployed in multi-agent systems; however, most research considers only the behavior of individual models. We experimentally show that multi-agent "AI organizations" are simultaneously more effective at achieving business…

As generative AI tools like ChatGPT become integral to everyday writing, critical questions arise about how to preserve writers' sense of agency and ownership when using these tools. Yet, a systematic understanding of how AI assistance…

Human-Computer Interaction · Computer Science 2025-08-19 Mohi Reza , Jeb Thomas-Mitchell , Peter Dushniku , Nathan Laundry , Joseph Jay Williams , Anastasia Kuzminykh

The benefits of artificial intelligence (AI) human partnerships-evaluating how AI agents enhance expert human performance-are increasingly studied. Though rarely evaluated in healthcare, an inverse approach is possible: AI benefiting from…

With recent advancements in multi-agent generative AI (Gen AI), technology organizations like Microsoft are adopting these complex tools, redefining AI agents as active collaborators in complex workflows rather than as passive tools. In…

Human-Computer Interaction · Computer Science 2025-10-09 Suchismita Naik , Austin L. Toombs , Amanda Snellinger , Scott Saponas , Amanda K. Hall

State-of-the-art methods for Human-AI Teaming and Zero-shot Cooperation focus on task completion, i.e., task rewards, as the sole evaluation metric while being agnostic to how the two agents work with each other. Furthermore, subjective…

Multiagent Systems · Computer Science 2026-01-21 Upasana Biswas , Vardhan Palod , Siddhant Bhambri , Subbarao Kambhampati

Improving our understanding of how humans perceive AI teammates is an important foundation for our general understanding of human-AI teams. Extending relevant work from cognitive science, we propose a framework based on item response theory…

Machine Learning · Computer Science 2023-05-17 Markelle Kelly , Aakriti Kumar , Padhraic Smyth , Mark Steyvers

Despite recent advances in the field of explainable artificial intelligence systems, a concrete quantitative measure for evaluating the usability of such systems is nonexistent. Ensuring the success of an explanatory interface in…

Human-Computer Interaction · Computer Science 2020-10-26 Byung Hyung Kim , Seunghun Koh , Sejoon Huh , Sungho Jo , Sunghee Choi

For effective human-agent teaming, robots and other artificial intelligence (AI) agents must infer their human partner's abilities and behavioral response patterns and adapt accordingly. Most prior works make the unrealistic assumption that…

Robotics · Computer Science 2024-03-26 Manisha Natarajan , Chunyue Xue , Sanne van Waveren , Karen Feigh , Matthew Gombolay

Human and AI are increasingly interacting and collaborating to accomplish various complex tasks in the context of diverse application domains (e.g., healthcare, transportation, and creative design). Two dynamic, learning entities (AI and…

Human-Computer Interaction · Computer Science 2019-10-29 Yi-Ching Huang , Yu-Ting Cheng , Lin-Lin Chen , Jane Yung-jen Hsu

Behavioral analysis of tutoring dialogues is essential for understanding student learning, yet manual coding remains a bottleneck. We present a methodology where LLM coding agents autonomously improve the prompts used by LLM classifiers to…

Human-Computer Interaction · Computer Science 2026-03-31 Eason Chen , Isabel Wang , Nina Yuan , Sophia Judicke , Kayla Beigh , Xinyi Tang

AI-based interactive assistants are advancing human-augmenting technology, yet their effects on users' mental and physiological states remain under-explored. We address this gap by analyzing how Copilot for Microsoft Word, a LLM-based…

Human-Computer Interaction · Computer Science 2025-06-05 Matthew Russell , Aman Shah , Giles Blaney , Judith Amores , Mary Czerwinski , Robert J. K. Jacob

Generative artificial intelligence (AI) agents are increasingly embedded in collaborative learning environments, yet their impact on the processes of argumentative knowledge construction remains insufficiently understood. Emerging…

Human-Computer Interaction · Computer Science 2025-12-11 Lixiang Yan , Yueqiao Jin , Linxuan Zhao , Roberto Martinez-Maldonado , Xinyu Li , Xiu Guan , Wenxin Guo , Xibin Han , Dragan Gašević

Explainable AI techniques that describe agent reward functions can enhance human-robot collaboration in a variety of settings. One context where human understanding of agent reward functions is particularly beneficial is in the value…

Robotics · Computer Science 2021-10-11 Lindsay Sanneman , Julie Shah

Developers now have access to a growing array of increasingly autonomous AI tools for software development. While many studies examine copilots that provide chat assistance or code completions, evaluations of coding agents -- which can…

Software Engineering · Computer Science 2025-09-16 Valerie Chen , Ameet Talwalkar , Robert Brennan , Graham Neubig