English

Task-Aware Delegation Cues for LLM Agents

Human-Computer Interaction 2026-03-12 v1

Abstract

LLM agents increasingly present as conversational collaborators, yet human--agent teamwork remains brittle due to information asymmetry: users lack task-specific reliability cues, and agents rarely surface calibrated uncertainty or rationale. We propose a task-aware collaboration signaling layer that turns offline preference evaluations into online, user-facing primitives for delegation. Using Chatbot Arena pairwise comparisons, we induce an interpretable task taxonomy via semantic clustering, then derive (i) Capability Profiles as task-conditioned win-rate maps and (ii) Coordination-Risk Cues as task-conditioned disagreement (tie-rate) priors. These signals drive a closed-loop delegation protocol that supports common-ground verification, adaptive routing (primary vs.\ primary+auditor), explicit rationale disclosure, and privacy-preserving accountability logs. Two predictive probes validate that task typing carries actionable structure: cluster features improve winner prediction accuracy and reduce difficulty prediction error under stratified 5-fold cross-validation. Overall, our framework reframes delegation from an opaque system default into a visible, negotiable, and auditable collaborative decision, providing a principled design space for adaptive human--agent collaboration grounded in mutual awareness and shared accountability.

Keywords

Cite

@article{arxiv.2603.11011,
  title  = {Task-Aware Delegation Cues for LLM Agents},
  author = {Xingrui Gu},
  journal= {arXiv preprint arXiv:2603.11011},
  year   = {2026}
}

Comments

Accepeted by CHI'26 Workshop on Developing Standards and Documentation For LLM Use as Simulated Research Participants

R2 v1 2026-07-01T11:15:05.989Z