English
Related papers

Related papers: Audio-Reasoner: Improving Reasoning Capability in …

200 papers

Recent advances in reasoning models have driven significant progress in text and multimodal domains, yet audio reasoning remains relatively limited. Only a few Large Audio Language Models (LALMs) incorporate explicit Chain-of-Thought (CoT)…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Longhao Li , Hongjie Chen , Zehan Li , Qihan Hu , Jian Kang , Jie Li , Lei Xie , Yongxiang Li

Multimodal Audio-Language Models (ALMs) can understand and reason over both audio and text. Typically, reasoning performance correlates with model size, with the best results achieved by models exceeding 8 billion parameters. However, no…

Sound · Computer Science 2025-03-12 Soham Deshmukh , Satvik Dixit , Rita Singh , Bhiksha Raj

Recent Large Audio-Language Models (LALMs) have shown strong performance on various audio understanding tasks such as speech translation and Audio Q\&A. However, they exhibit significant limitations on challenging audio reasoning tasks in…

Computation and Language · Computer Science 2025-09-29 Zhen Xiong , Yujun Cai , Zhecheng Li , Junsong Yuan , Yiwei Wang

Large Audio Language Models (LALMs) have demonstrated strong capabilities in audio understanding and reasoning. However, their performance on fine grained auditory perception remains unreliable, and existing approaches largely rely on data…

Sound · Computer Science 2026-02-12 Liyang Chen , Hongkai Chen , Yujun Cai , Sifan Li , Qingwen Ye , Yiwei Wang

While large language models have demonstrated impressive reasoning abilities, their extension to the audio modality, particularly within large audio-language models (LALMs), remains underexplored. Addressing this gap requires a systematic…

Computation and Language · Computer Science 2025-09-23 Xingjian Diao , Chunhui Zhang , Keyi Kong , Weiyi Wu , Chiyu Ma , Zhongyu Ouyang , Peijun Qing , Soroush Vosoughi , Jiang Gui

The role of reasoning in Audio Large Language Models remains widely underexplored, as introducing a reasoning process often degrades rather than improves performance during inference, a phenomenon we term test-time inverse scaling, where…

Machine Learning · Computer Science 2025-10-27 Jiajun Fan , Roger Ren , Jingyuan Li , Rahul Pandey , Prashanth Gurunath Shivakumar , Ivan Bulyko , Ankur Gandhe , Ge Liu , Yile Gu

Large Audio-Language Models (LALMs) have made significant progress in audio understanding, yet they primarily operate as perception-and-answer systems without explicit reasoning processes. Existing methods for enhancing audio reasoning rely…

Sound · Computer Science 2026-04-21 Xiang He , Chenxing Li , Jinting Wang , Yan Rong , Tianxin Xie , Wenfu Wang , Li Liu , Dong Yu

Large Audio-Language Models (LALMs) have demonstrated remarkable performance in tasks involving audio perception and understanding, such as speech recognition and audio captioning. However, their reasoning capabilities - critical for…

Sound · Computer Science 2025-01-14 Ziyang Ma , Zhuo Chen , Yuping Wang , Eng Siong Chng , Xie Chen

The ability of artificial intelligence (AI) systems to perceive and comprehend audio signals is crucial for many applications. Although significant progress has been made in this area since the development of AudioSet, most existing models…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-21 Yuan Gong , Hongyin Luo , Alexander H. Liu , Leonid Karlinsky , James Glass

Reasoning has become a defining capability of modern foundation models, yet its development in the audio modality remains limited. Audio poses challenges that are distinct from those of text and vision. It is continuous, temporally dense,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Zhihan Guo , Wenqian Cui , Guan-Ting Lin , Daxin Tan , Jingyao Li , Qiyong Zheng , Dingdong Wang , Jing Xiong , Han Shi , Jiaya Jia , Irwin King

Recent advancements in large language models, multimodal large language models, and large audio language models (LALMs) have significantly improved their reasoning capabilities through reinforcement learning with rule-based rewards.…

Sound · Computer Science 2025-11-05 Shu Wu , Chenxing Li , Wenfu Wang , Hao Zhang , Hualei Wang , Meng Yu , Dong Yu

Chain-of-thought reasoning has demonstrated significant improvements in large language models and vision language models, yet its potential for audio language models remains largely unexplored. In this technical report, we take a…

Audio deep reasoning is a challenging task that requires expert-level perception, multi-step logical inference, and the integration of contextual knowledge. However, existing models suffer from a gap between audio perception and reasoning…

Sound · Computer Science 2025-10-16 Yan Rong , Chenxing Li , Dong Yu , Li Liu

Open-source multimodal large language models (MLLMs) have shown significant potential in a broad range of multimodal tasks. However, their reasoning capabilities remain constrained by existing instruction-tuning datasets, which were…

Computation and Language · Computer Science 2025-06-05 Jarvis Guo , Tuney Zheng , Yuelin Bai , Bo Li , Yubo Wang , King Zhu , Yizhi Li , Graham Neubig , Wenhu Chen , Xiang Yue

The present benchmarks for testing the audio modality of multimodal large language models concentrate on testing various audio tasks such as speaker diarization or gender identification in isolation. Whether a multimodal model can answer…

Perceiving and understanding non-speech sounds and non-verbal speech is essential to making decisions that help us interact with our surroundings. In this paper, we propose GAMA, a novel General-purpose Large Audio-Language Model (LALM)…

Recent advancements in large multimodal models (LMMs) have shown strong capabilities in audio understanding. However, most systems rely solely on end-to-end reasoning, limiting interpretability and accuracy for tasks that require structured…

Sound · Computer Science 2025-10-14 Kuan-Yi Lee , Tsung-En Lin , Hung-Yi Lee

Existing audio question answering benchmarks largely emphasize sound event classification or caption-grounded queries, often enabling models to succeed through shortcut strategies, short-duration cues, lexical priors, dataset-specific…

Computation and Language · Computer Science 2026-04-24 Tasnim Kabir , Dmytro Kurdydyk , Aadi Palnitkar , Liam Dorn , Ahmed Haj Ahmed , Jordan Lee Boyd-Graber

While reasoning-enhanced large language models perform strongly on English medical tasks, a persistent multilingual gap remains, with substantially weaker reasoning in local languages, limiting equitable global medical deployment. To bridge…

Audio-language models have shown promising results in various sound understanding tasks, yet they remain limited in their ability to reason over the fine-grained semantics of sound. In this paper, we present AudSemThinker, a model whose…

Sound · Computer Science 2025-10-01 Gijs Wijngaard , Elia Formisano , Michele Esposito , Michel Dumontier
‹ Prev 1 2 3 10 Next ›