English

Overhearing LLM Agents: A Survey, Taxonomy, and Roadmap

Computation and Language 2025-09-23 v1 Artificial Intelligence Human-Computer Interaction

Abstract

Imagine AI assistants that enhance conversations without interrupting them: quietly providing relevant information during a medical consultation, seamlessly preparing materials as teachers discuss lesson plans, or unobtrusively scheduling meetings as colleagues debate calendars. While modern conversational LLM agents directly assist human users with tasks through a chat interface, we study this alternative paradigm for interacting with LLM agents, which we call "overhearing agents." Rather than demanding the user's attention, overhearing agents continuously monitor ambient activity and intervene only when they can provide contextual assistance. In this paper, we present the first analysis of overhearing LLM agents as a distinct paradigm in human-AI interaction and establish a taxonomy of overhearing agent interactions and tasks grounded in a survey of works on prior LLM-powered agents and exploratory HCI studies. Based on this taxonomy, we create a list of best practices for researchers and developers building overhearing agent systems. Finally, we outline the remaining research gaps and reveal opportunities for future research in the overhearing paradigm.

Keywords

Cite

@article{arxiv.2509.16325,
  title  = {Overhearing LLM Agents: A Survey, Taxonomy, and Roadmap},
  author = {Andrew Zhu and Chris Callison-Burch},
  journal= {arXiv preprint arXiv:2509.16325},
  year   = {2025}
}

Comments

8 pages, 1 figure

R2 v1 2026-07-01T05:46:31.496Z