English
Related papers

Related papers: AudioTrust: Benchmarking the Multifaceted Trustwor…

200 papers

Large Language Models generate complex reasoning chains that reveal their decision-making, yet verifying the faithfulness and harmlessness of these intermediate steps remains a critical unsolved problem. Existing auditing methods are…

Artificial Intelligence · Computer Science 2025-10-24 Morris Yu-Chao Huang , Zhen Tan , Mohan Zhang , Pingzhi Li , Zhuo Zhang , Tianlong Chen

Audio deepfake detection (ADD) has grown increasingly important due to the rise of high-fidelity audio generative models and their potential for misuse. Given that audio large language models (ALLMs) have made significant progress in…

Sound · Computer Science 2025-07-09 Hao Gu , Jiangyan Yi , Chenglong Wang , Jianhua Tao , Zheng Lian , Jiayi He , Yong Ren , Yujie Chen , Zhengqi Wen

Large Audio-Language Models (LALMs) as judges have emerged as a prominent approach for evaluating speech generation quality, yet their ability to assess speaker consistency across multi-turn dialogues remains unexplored. We present…

Computation and Language · Computer Science 2026-04-21 Jonggeun Lee , Junseong Pyo , Gyuhyeon Seo , Yohan Jo

Audio-Language Models (ALMs), trained on paired audio-text data, are designed to process, understand, and reason about audio-centric multimodal content. Unlike traditional supervised approaches that use predefined labels, ALMs leverage…

Sound · Computer Science 2026-03-13 Yi Su , Jisheng Bai , Qisheng Xu , Kele Xu , Yong Dou

As Large Language Models (LLMs) continue to revolutionize Natural Language Processing (NLP) applications, critical concerns about their trustworthiness persist, particularly in safety and robustness. To address these challenges, we…

Software Engineering · Computer Science 2025-10-16 Ruoyu Sun , Da Song , Jiayang Song , Yuheng Huang , Lei Ma

While Audio Large Models (ALMs) have achieved remarkable proficiency, their robustness remains brittle in real-world deployment. Existing evaluations largely rely on synthetic Gaussian noise or simplistic single-source interference, failing…

Large Audio-Language Models (LALMs), such as GPT-4o, have recently unlocked audio dialogue capabilities, enabling direct spoken exchanges with humans. The potential of LALMs broadens their applicability across a wide range of practical…

Artificial Intelligence · Computer Science 2025-07-29 Kuofeng Gao , Shu-Tao Xia , Ke Xu , Philip Torr , Jindong Gu

Recent Audio Multimodal Large Language Models (Audio MLLMs) demonstrate impressive performance on speech benchmarks, yet it remains unclear whether these models genuinely process acoustic signals or rely on text-based semantic inference. To…

Artificial Intelligence · Computer Science 2026-03-23 Jiaqi Xiong , Yunjia Qi , Qi Cao , Yu Zheng , Yutong Zhang , Ziteng Wang , Ruofan Liao , Weisheng Xu , Sichen Liu

Various audio-LLMs (ALLMs) have been explored recently for tackling different audio tasks simultaneously using a single, unified model. While existing evaluations of ALLMs primarily focus on single-audio tasks, real-world applications often…

Sound · Computer Science 2024-11-07 Yiming Chen , Xianghu Yue , Xiaoxue Gao , Chen Zhang , Luis Fernando D'Haro , Robby T. Tan , Haizhou Li

Ensuring alignment, which refers to making models behave in accordance with human intentions [1,2], has become a critical task before deploying large language models (LLMs) in real-world applications. For instance, OpenAI devoted six months…

Artificial Intelligence · Computer Science 2024-03-22 Yang Liu , Yuanshun Yao , Jean-Francois Ton , Xiaoying Zhang , Ruocheng Guo , Hao Cheng , Yegor Klochkov , Muhammad Faaiz Taufiq , Hang Li

Large Audio Language Models (LALMs) integrate audio encoders with pretrained Large Language Models to perform complex multimodal reasoning tasks. While these models can generate Chain-of-Thought (CoT) explanations, the faithfulness of these…

Machine Learning · Computer Science 2026-03-20 Pooneh Mousavi , Lovenya Jain , Mirco Ravanelli , Cem Subakan

Audio deepfake detection has recently garnered public concern due to its implications for security and reliability. Traditional deep learning methods have been widely applied to this task but often lack generalisability when confronted with…

Sound · Computer Science 2025-12-16 Yupei Li , Li Wang , Yuxiang Wang , Lei Wang , Rizhao Cai , Jie Shi , Björn W. Schuller , Zhizheng Wu

Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal…

Sound · Computer Science 2026-05-29 Bo-Han Feng , Yu-Hsuan Li Liang , Chien-Feng Liu , You-Hsuan Chang , Yun-Nung Chen

Large Audio-Language Models (LALMs) are increasingly deployed in real-world applications, yet their robustness against malicious audio injection attacks remains underexplored. This study systematically evaluates five leading LALMs across…

Computation and Language · Computer Science 2025-07-11 Guanyu Hou , Jiaming He , Yinhang Zhou , Ji Guo , Yitong Qiao , Rui Zhang , Wenbo Jiang

Audio Language Models (ALMs) have recently shown strong capabilities in unified reasoning over speech, sound, and natural language; yet they inherit behavioral issues observed in Large Language Models, including sycophancy--the tendency to…

Large Audio-Language Models (LALMs) have recently achieved strong performance across various audio-centric tasks. However, hallucination, where models generate responses that are semantically incorrect or acoustically unsupported, remains…

Sound · Computer Science 2026-04-22 Feiyu Zhao , Yiming Chen , Wenhuan Lu , Daipeng Zhang , Xianghu Yue , Jianguo Wei

Processing long-form audio is a major challenge for Large Audio Language models (LALMs). These models struggle with the quadratic cost of attention ($O(N^2)$) and with modeling long-range temporal dependencies. Existing audio benchmarks are…

Large Language Model-based Multi-Agent Systems (LLM-MAS) have demonstrated strong capabilities in solving complex tasks but remain vulnerable when agents receive unreliable messages. This vulnerability stems from a fundamental gap: LLM…

Cryptography and Security · Computer Science 2026-04-15 Pengfei He , Zhenwei Dai , Xianfeng Tang , Yue Xing , Hui Liu , Jingying Zeng , Qiankun Peng , Shrivats Agrawal , Samarth Varshney , Suhang Wang , Jiliang Tang , Qi He

The rapid advancement of Audio Large Language Models (ALLMs) has enabled cost-effective, high-fidelity generation and manipulation of both speech and non-speech audio, including sound effects, singing voices, and music. While these…

The popular success of text-based large language models (LLM) has streamlined the attention of the multimodal community to combine other modalities like vision and audio along with text to achieve similar multimodal capabilities. In this…

Computation and Language · Computer Science 2025-05-20 Debarpan Bhattacharya , Apoorva Kulkarni , Sriram Ganapathy