English

AudioToolAgent: An Agentic Framework for Audio-Language Models

Sound 2026-02-16 v2

Abstract

Large Audio-Language Models (LALMs) perform well on audio understanding tasks but lack multistep reasoning and tool-calling found in recent Large Language Models (LLMs). This paper presents AudioToolAgent, a framework that coordinates audio-language models as tools via a central LLM agent that accesses tool adapters for audio question answering and speech-to-text. The agent reasons about which tools to invoke, how to formulate follow-up queries, and how to arbitrate conflicting tool outputs, without accessing the audio. Experiments with MMAU, MMAR, and MMAU-Pro show state-of-the-art accuracy: up to 77.50% in MMAU, 77.00% in MMAR, and 61.90% in MMAU-Pro. Shapley-based analysis identifies effective agent-tool combinations. The code and reproduction materials are available at https://github.com/GLJS/AudioToolAgent.

Keywords

Cite

@article{arxiv.2510.02995,
  title  = {AudioToolAgent: An Agentic Framework for Audio-Language Models},
  author = {Gijs Wijngaard and Elia Formisano and Michel Dumontier and Jenia Jitsev},
  journal= {arXiv preprint arXiv:2510.02995},
  year   = {2026}
}
R2 v1 2026-07-01T06:15:16.183Z