English
Related papers

Related papers: Audio-Maestro: Enhancing Large Audio-Language Mode…

200 papers

Multimodal large language models can exhibit text dominance, over-relying on linguistic priors instead of grounding predictions in non-text inputs. One example is large audio-language models (LALMs) where decisive audio evidence can be…

Sound · Computer Science 2026-03-10 Neta Glazer , Lenny Aharon , Ethan Fetaya

Large Audio-Language Models (LALMs) perform well on audio understanding tasks but lack multistep reasoning and tool-calling found in recent Large Language Models (LLMs). This paper presents AudioToolAgent, a framework that coordinates…

Sound · Computer Science 2026-02-16 Gijs Wijngaard , Elia Formisano , Michel Dumontier , Jenia Jitsev

Large Audio Language Models (LALMs) excel at perception but struggle with complex reasoning requiring precise acoustic measurements. While external tools can extract fine-grained features like exact tempo or pitch, effective integration…

Sound · Computer Science 2026-02-17 Siqian Tong , Xuan Li , Yiwei Wang , Baolong Bi , Yujun Cai , Shenghua Liu , Yuchen He , Chengpeng Hao

Audio agents extend large audio-language models (LALMs) by decomposing audio questions into tool calls, intermediate evidence, and iterative reasoning steps. However, as LALMs become stronger, the key challenge shifts from enabling tool use…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-28 Yucheng Wang , Jing Peng , Hanqi Li , Chenghao Wang , Wenming Tu , Yu Xi , Zhaokai Sun , Kai Yu , Shuai Wang

Audio-aware large language models (ALLMs) can understand the textual and non-textual information in the audio input. In this paper, we explore using ALLMs as an automatic judge to assess the speaking styles of speeches. We use ALLM judges…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-09 Cheng-Han Chiang , Xiaofei Wang , Chung-Ching Lin , Kevin Lin , Linjie Li , Radu Kopetz , Yao Qian , Zhendong Wang , Zhengyuan Yang , Hung-yi Lee , Lijuan Wang

Recent advances in reasoning models have demonstrated remarkable success in text and vision domains through extended chain-of-thought deliberation. However, a perplexing phenomenon persists in audio language models: they consistently…

The ability to comprehend audio--which includes speech, non-speech sounds, and music--is crucial for AI agents to interact effectively with the world. We present MMAU, a novel benchmark designed to evaluate multimodal audio understanding…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-28 S Sakshi , Utkarsh Tyagi , Sonal Kumar , Ashish Seth , Ramaneswaran Selvakumar , Oriol Nieto , Ramani Duraiswami , Sreyan Ghosh , Dinesh Manocha

Large language models (LLMs) are increasingly explored as general-purpose reasoners, particularly in agentic contexts. However, their outputs remain prone to mathematical and logical errors. This is especially challenging in open-ended…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi

The ability of artificial intelligence (AI) systems to perceive and comprehend audio signals is crucial for many applications. Although significant progress has been made in this area since the development of AudioSet, most existing models…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-21 Yuan Gong , Hongyin Luo , Alexander H. Liu , Leonid Karlinsky , James Glass

Recent advancements in multimodal reasoning have largely overlooked the audio modality. We introduce Audio-Reasoner, a large-scale audio language model for deep reasoning in audio tasks. We meticulously curated a large-scale and diverse…

Sound · Computer Science 2025-09-23 Zhifei Xie , Mingbao Lin , Zihang Liu , Pengcheng Wu , Shuicheng Yan , Chunyan Miao

Recent advancements in large language models, multimodal large language models, and large audio language models (LALMs) have significantly improved their reasoning capabilities through reinforcement learning with rule-based rewards.…

Sound · Computer Science 2025-11-05 Shu Wu , Chenxing Li , Wenfu Wang , Hao Zhang , Hualei Wang , Meng Yu , Dong Yu

Large Audio Language Models (LALMs) have demonstrated strong capabilities in audio understanding and reasoning. However, their performance on fine grained auditory perception remains unreliable, and existing approaches largely rely on data…

Sound · Computer Science 2026-02-12 Liyang Chen , Hongkai Chen , Yujun Cai , Sifan Li , Qingwen Ye , Yiwei Wang

We introduce ASTRO, the "Autoregressive Search-Taught Reasoner", a framework for training language models to reason like search algorithms, explicitly leveraging self-reflection, backtracking, and exploration in their outputs. Recently,…

Artificial Intelligence · Computer Science 2025-07-02 Joongwon Kim , Anirudh Goyal , Liang Tan , Hannaneh Hajishirzi , Srinivasan Iyer , Tianlu Wang

Multimodal Audio-Language Models (ALMs) can understand and reason over both audio and text. Typically, reasoning performance correlates with model size, with the best results achieved by models exceeding 8 billion parameters. However, no…

Sound · Computer Science 2025-03-12 Soham Deshmukh , Satvik Dixit , Rita Singh , Bhiksha Raj

The proliferation of large language models (LLMs) and modular skills has endowed autonomous agents with increasingly powerful capabilities. Existing frameworks typically rely on monolithic LLMs and fixed logic to interface with these…

Machine Learning · Computer Science 2026-05-22 Jinyang Wu , Guocheng Zhai , Ruihan Jin , Yuhao Shen , Zhengxi Lu , Fan Zhang , Haoran Luo , Zheng Lian , Zhengqi Wen , Jianhua Tao

We introduce DeSTA2.5-Audio, a general-purpose Large Audio Language Model (LALM) designed for robust auditory perception and instruction-following. Recent LALMs augment Large Language Models (LLMs) with auditory capabilities by training on…

Perceiving and understanding non-speech sounds and non-verbal speech is essential to making decisions that help us interact with our surroundings. In this paper, we propose GAMA, a novel General-purpose Large Audio-Language Model (LALM)…

In the era of large language models (LLMs) and artificial general intelligence (AGI), computer audition must evolve beyond traditional paradigms to fully leverage the capabilities of foundation models, towards more comprehensive…

Augmenting large language models (LLMs) to understand audio -- including non-speech sounds and non-verbal speech -- is critically important for diverse real-world applications of LLMs. In this paper, we propose Audio Flamingo, a novel audio…

Sound · Computer Science 2024-05-29 Zhifeng Kong , Arushi Goel , Rohan Badlani , Wei Ping , Rafael Valle , Bryan Catanzaro

Recent advances in reasoning models have driven significant progress in text and multimodal domains, yet audio reasoning remains relatively limited. Only a few Large Audio Language Models (LALMs) incorporate explicit Chain-of-Thought (CoT)…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Longhao Li , Hongjie Chen , Zehan Li , Qihan Hu , Jian Kang , Jie Li , Lei Xie , Yongxiang Li
‹ Prev 1 2 3 10 Next ›