English
Related papers

Related papers: A Wizard of Oz Study Simulating API Usage Dialogue…

200 papers

With the emergence of conversational artificial intelligence (AI) agents, it is important to understand the mechanisms that influence users' experiences of these agents. We study a common tool in the designer's toolkit: conceptual…

Human-Computer Interaction · Computer Science 2020-08-07 Pranav Khadpe , Ranjay Krishna , Li Fei-Fei , Jeffrey Hancock , Michael Bernstein

We explore natural user interactions using a virtual reality simulation of a robot arm for assembly tasks. Using a Wizard-of-Oz study, participants completed collaborative LEGO and instructive PCB assembly tasks, with the robot responding…

Human-Computer Interaction · Computer Science 2025-08-26 Ryan Ghamandi , Yahya Hmaiti , Mykola Maslych , Ravi Kiran Kattoju , Joseph J. LaViola

Virtual assistants such as Amazon's Alexa, Apple's Siri, Google Home, and Microsoft's Cortana, are becoming ubiquitous in our daily lives and successfully help users in various daily tasks, such as making phone calls or playing music. Yet,…

Human-Computer Interaction · Computer Science 2021-05-13 Chen Shani , Alexander Libov , Sofia Tolmach , Liane Lewin-Eytan , Yoelle Maarek , Dafna Shahaf

Conversational AI interfaces powered by large language models (LLMs) are increasingly used as coding assistants. However, questions remain about how programmers interact with LLM-based conversational agents, the challenges they encounter,…

Human-Computer Interaction · Computer Science 2025-03-24 Mehmet Akhoroz , Caglar Yildirim

When designing Machine Learning (ML) enabled solutions, designers often need to simulate ML behavior through the Wizard of Oz (WoZ) approach to test the user experience before the ML model is available. Although reproducing ML errors is…

Human-Computer Interaction · Computer Science 2023-02-20 Anniek Jansen , Sara Colombo

Large corpora of task-based and open-domain conversational dialogues are hugely valuable in the field of data-driven dialogue systems. Crowdsourcing platforms, such as Amazon Mechanical Turk, have been an effective method for collecting…

Human-Computer Interaction · Computer Science 2020-03-16 Francisco J. Chiyah Garcia , José Lopes , Xingkun Liu , Helen Hastie

Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is…

Software Engineering · Computer Science 2025-05-14 Glaucia Melo , Paulo Alencar , Donald Cowan

IDE-integrated AI coding assistants, which operate conversationally within developers' working codebases with access to project context and multi-file editing, are rapidly reshaping software development. However, empirical investigation of…

Software Engineering · Computer Science 2026-04-02 Ningzhi Tang , Chaoran Chen , Zihan Fang , Gelei Xu , Maria Dhakal , Yiyu Shi , Collin McMillan , Yu Huang , Toby Jia-Jun Li

Modern conversational agents such as Alexa and Google Assistant represent significant progress in speech recognition, natural language processing, and speech synthesis. But as these agents have grown more realistic, concerns have been…

Human-Computer Interaction · Computer Science 2021-08-05 William Seymour , Max Van Kleek

Human-AI collaboration is on the rise with the deployment of AI-enabled intelligent assistants (e.g. Amazon Echo, Cortana, Siri, etc.) across organizational contexts. It is claimed that intelligent assistants can help people achieve more in…

Human-Computer Interaction · Computer Science 2020-01-01 Sonia Jawaid Shaikh , Ignacio Cruz

This abstract presents a scenario for human-robot action in a home setting involving an older adult and a robot. The scenario is designed to explore the envisioned modelling of memory for communication with a socially assistive robots…

Computation and Language · Computer Science 2024-01-18 Yanzhe Li , Frank Broz , Mark Neerincx

While current chat-based AI assistants primarily operate reactively, responding only when prompted by users, there is significant potential for these systems to proactively assist in tasks without explicit invocation, enabling a…

Human-Computer Interaction · Computer Science 2025-03-03 Valerie Chen , Alan Zhu , Sebastian Zhao , Hussein Mozannar , David Sontag , Ameet Talwalkar

Developers now have access to a growing array of increasingly autonomous AI tools for software development. While many studies examine copilots that provide chat assistance or code completions, evaluations of coding agents -- which can…

Software Engineering · Computer Science 2025-09-16 Valerie Chen , Ameet Talwalkar , Robert Brennan , Graham Neubig

Software automation has long been a central goal of software engineering, striving for software development that proceeds without human intervention. Recent efforts have leveraged Artificial Intelligence (AI) to advance software automation…

Software Engineering · Computer Science 2025-10-02 Liyi Cai , Yijie Ren , Yitong Zhang , Jia Li

Intelligent conversational assistants, such as Apple's Siri, Microsoft's Cortana, and Amazon's Echo, have quickly become a part of our digital life. However, these assistants have major limitations, which prevents users from conversing with…

Human-Computer Interaction · Computer Science 2017-08-11 Ting-Hao Kenneth Huang , Walter S. Lasecki , Amos Azaria , Jeffrey P. Bigham

This article describes creating algorithmic support for the functioning of a personal virtual assistant, which allows automating the processing of customer requests. The study aims to reduce errors and processing time for a client request…

Human-Computer Interaction · Computer Science 2022-03-29 Konstantin Dobratulin , Marina Nezhurina

Conversational agents, such as chatbots and virtual assistants, have become essential in software development, boosting productivity, collaboration, and automating various tasks. This paper examines the role of adaptive AI-powered…

Software Engineering · Computer Science 2025-07-16 Omar Elsisi , Glaucia Melo

The growing demand for software developers and the increasing development complexity have emphasized the need for support in software engineering projects. This is especially relevant in light of advancements in artificial intelligence,…

Software Engineering · Computer Science 2023-05-02 Glaucia Melo

A common vision from science fiction is that robots will one day inhabit our physical spaces, sense the world as we do, assist our physical labours, and communicate with us through natural language. Here we study how to design artificial…

About 32% of a software practitioners' day involves seeking and using information to support task completion. Although the information needs of software practitioners have been studied extensively, the impact of AI-assisted tools on their…

Software Engineering · Computer Science 2025-04-28 Ebtesam Al Haque , Chris Brown , Thomas D. LaToza , Brittany Johnson