English

DarwinTOD: LLM-driven Lifelong Self-evolution for Task-oriented Dialog Systems

Multiagent Systems 2026-04-15 v2 Human-Computer Interaction

Abstract

Traditional task-oriented dialog systems are unable to evolve from ongoing interactions or adapt to new domains after deployment, that is a critical limitation in real-world dynamic environments. Continual learning approaches depend on episodic retraining with human curated data, failing to achieve autonomy lifelong improvement. While evolutionary computation and LLM driven self improvement offer promising mechanisms for dialog optimization, they lack a unified framework for holistic, iterative strategy refinement. To bridge this gap, we propose DarwinTOD, a lifelong self evolving dialog framework that systematically integrates these two paradigms, enabling continuous strategy optimization from a zero-shot base without task specific fine-tuning. DarwinTOD maintains an Evolvable Strategy Bank and operates through a dual-loop process: online multi-agent dialog execution with peer critique, and offline structured evolutionary operations that refine the strategy bank using accumulated feedback. This closed-loop design enables autonomous continuous improvement without human intervention. Extensive experiments show that DarwinTOD surpasses previous state-of-the-art methods and exhibits continuous performance gains throughout evolution. Our work provides a novel framework for building dialog systems with lifelong self evolution capabilities.

Keywords

Cite

@article{arxiv.2601.07248,
  title  = {DarwinTOD: LLM-driven Lifelong Self-evolution for Task-oriented Dialog Systems},
  author = {Shuyu Zhang and Yujie Liu and Xinru Wang and Cheng Zhang and Yanmin Zhu and Bin Li},
  journal= {arXiv preprint arXiv:2601.07248},
  year   = {2026}
}

Comments

Accepted in ACL2026 main

R2 v1 2026-07-01T09:00:10.323Z