English
Related papers

Related papers: Audio-Mind: An Auditable Agentic Framework for Aud…

200 papers

Large Audio-Language Models (LALMs) are enhanced with audio perception capabilities, enabling them to effectively process and understand multimodal inputs that combine audio and text. However, their performance in handling conflicting…

Computation and Language · Computer Science 2025-08-22 Cheng Wang , Gelei Deng , Xianglin Yang , Han Qiu , Tianwei Zhang

Large Audio-Language Models (LALMs), such as GPT-4o, have recently unlocked audio dialogue capabilities, enabling direct spoken exchanges with humans. The potential of LALMs broadens their applicability across a wide range of practical…

Artificial Intelligence · Computer Science 2025-07-29 Kuofeng Gao , Shu-Tao Xia , Ke Xu , Philip Torr , Jindong Gu

Large Audio-Language Models (LALMs) have recently shown impressive progress in speech recognition, audio captioning, and auditory question answering. Yet, whether these models can perceive spatial dynamics, particularly the motion of sound…

Sound · Computer Science 2026-01-23 Zhe Sun , Yujun Cai , Jiayu Yao , Yiwei Wang

While Large Audio-Language Models (LALMs) have been shown to exhibit degraded instruction-following capabilities, their ability to infer task patterns from in-context examples under audio conditioning remains unstudied. To address this gap,…

Large Audio Language Models (LALMs) excel at semantic and paralinguistic tasks, yet their ability to perceive the fundamental physical attributes of audio such as pitch, loudness, and spatial location remains under-explored. To bridge this…

Large Audio-Language Models (LALMs) have made significant progress in audio understanding, yet they primarily operate as perception-and-answer systems without explicit reasoning processes. Existing methods for enhancing audio reasoning rely…

Sound · Computer Science 2026-04-21 Xiang He , Chenxing Li , Jinting Wang , Yan Rong , Tianxin Xie , Wenfu Wang , Li Liu , Dong Yu

Large audio language models (LALMs) can answer questions about speech, music, and environmental sounds, yet their internal reasoning is largely opaque and difficult to validate. We describe TalTech's solution to the Agent Track of the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Aivo Olev , Tanel Alumäe

While multi-audio understanding is critical for large audio-language models (LALMs), it remains underexplored. We introduce MUGEN, a comprehensive benchmark evaluating this capability across speech, general audio, and music. Our experiments…

Large Audio Language Models (LALMs) represent an important frontier in multimodal AI, addressing diverse audio tasks. Recently, post-training of LALMs has received increasing attention due to significant performance improvements over…

Joint audio-visual reasoning is essential for omnimodal understanding, yet current multimodal large language models (MLLMs) still struggle when reasoning requires fine-grained evidence from both modalities. A central limitation is that…

Efficient audio quality assessment is vital for streamlining audio codec development. Objective assessment tools have been developed over time to algorithmically predict quality ratings from subjective assessments, the gold standard for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-28 Pablo M. Delgado , Jürgen Herre

Real-world multimodal applications often require any-to-any capabilities, enabling both understanding and generation across modalities including text, image, audio, and video. However, integrating the strengths of autoregressive language…

Machine Learning · Computer Science 2025-08-15 Jiulin Li , Ping Huang , Yexin Li , Shuo Chen , Juewen Hu , Ye Tian

Large Language Model (LLM) agents have shown great potential in addressing real-world data science problems. LLM-driven data science agents promise to automate the entire machine learning pipeline, yet their real-world effectiveness remains…

Computation and Language · Computer Science 2025-10-09 Yixin Ou , Yujie Luo , Jingsheng Zheng , Lanning Wei , Zhuoyun Yu , Shuofei Qiao , Jintian Zhang , Da Zheng , Yuren Mao , Yunjun Gao , Huajun Chen , Ningyu Zhang

Large Audio-Language Models (LALMs) have demonstrated remarkable performance in tasks involving audio perception and understanding, such as speech recognition and audio captioning. However, their reasoning capabilities - critical for…

Sound · Computer Science 2025-01-14 Ziyang Ma , Zhuo Chen , Yuping Wang , Eng Siong Chng , Xie Chen

Audio-language models have shown promising results in various sound understanding tasks, yet they remain limited in their ability to reason over the fine-grained semantics of sound. In this paper, we present AudSemThinker, a model whose…

Sound · Computer Science 2025-10-01 Gijs Wijngaard , Elia Formisano , Michele Esposito , Michel Dumontier

Recent Large Audio-Language Models (LALMs) have shown strong performance on various audio understanding tasks such as speech translation and Audio Q\&A. However, they exhibit significant limitations on challenging audio reasoning tasks in…

Computation and Language · Computer Science 2025-09-29 Zhen Xiong , Yujun Cai , Zhecheng Li , Junsong Yuan , Yiwei Wang

Large Language Models (LLMs) suffer from hallucinations and factual inaccuracies, especially in complex reasoning and fact verification tasks. Multi-Agent Debate (MAD) systems aim to improve answer accuracy by enabling multiple LLM agents…

Computation and Language · Computer Science 2026-01-09 Seyeon Jeong , Yeonjun Choi , JongWook Kim , Beakcheol Jang

In this paper, we introduce Audiopedia, a novel task called Audio Question Answering with Knowledge, which requires both audio comprehension and external knowledge reasoning. Unlike traditional Audio Question Answering (AQA) benchmarks that…

Machine Learning · Computer Science 2024-12-31 Abhirama Subramanyam Penamakuri , Kiran Chhatre , Akshat Jain

Recent Audio Large Language Models (AudioLLMs) exhibit a striking performance inversion: while excelling at complex reasoning tasks, they consistently underperform on fine-grained acoustic perception. We attribute this gap to a fundamental…

Computation and Language · Computer Science 2026-04-15 Linhao Zhang , Yuhan Song , Aiwei Liu , Chuhan Wu , Sijun Zhang , Wei Jia , Yuan Liu , Houfeng Wang , Xiao Zhou

Deep neural networks have recently achieved breakthroughs in sound generation. Despite the outstanding sample quality, current sound generation models face issues on small-scale datasets (e.g., overfitting), significantly limiting…

Sound · Computer Science 2024-07-30 Yi Yuan , Haohe Liu , Jinhua Liang , Xubo Liu , Mark D. Plumbley , Wenwu Wang