中文
相关论文

相关论文: Not in Sync: Unveiling Temporal Bias in Audio Chat…

200 篇论文

Despite the advanced capabilities of large language models (LLMs), their temporal reasoning ability remains underdeveloped. Prior works have highlighted this limitation, particularly in maintaining temporal consistency when understanding…

计算与语言 · 计算机科学 2025-06-18 Jongho Kim , Seung-won Hwang

Multimodal large language models can exhibit text dominance, over-relying on linguistic priors instead of grounding predictions in non-text inputs. One example is large audio-language models (LALMs) where decisive audio evidence can be…

声音 · 计算机科学 2026-03-10 Neta Glazer , Lenny Aharon , Ethan Fetaya

The popular success of text-based large language models (LLM) has streamlined the attention of the multimodal community to combine other modalities like vision and audio along with text to achieve similar multimodal capabilities. In this…

计算与语言 · 计算机科学 2025-05-20 Debarpan Bhattacharya , Apoorva Kulkarni , Sriram Ganapathy

Large Audio-Language Models (LALMs) as judges have emerged as a prominent approach for evaluating speech generation quality, yet their ability to assess speaker consistency across multi-turn dialogues remains unexplored. We present…

计算与语言 · 计算机科学 2026-04-21 Jonggeun Lee , Junseong Pyo , Gyuhyeon Seo , Yohan Jo

Large audio-language models (LALMs) are often used in tasks that involve reasoning over ordered options. An open question is whether their predictions are influenced by the order of answer choices, which would indicate a form of position…

声音 · 计算机科学 2026-02-25 Yu-Xiang Lin , Chen-An Li , Sheng-Lun Wei , Po-Chun Chen , Hsin-Hsi Chen , Hung-yi Lee

While advances in fairness and alignment have helped mitigate overt biases exhibited by large language models (LLMs) when explicitly prompted, we hypothesize that these models may still exhibit implicit biases when simulating human…

计算与语言 · 计算机科学 2025-01-30 Yuxuan Li , Hirokazu Shirado , Sauvik Das

Conversational Spoken Language Models (SLMs) are emerging as a promising paradigm for real-time speech interaction. However, their capacity of temporal dynamics, including the ability to manage timing, tempo and simultaneous speaking,…

音频与语音处理 · 电气工程与系统科学 2026-05-04 Kai-Wei Chang , En-Pei Hu , Chun-Yi Kuan , Wenze Ren , Wei-Chih Chen , Guan-Ting Lin , Yu Tsao , Shao-Hua Sun , Hung-yi Lee , James Glass

Large Language Models (LLMs) often struggle to use information across long inputs effectively. Prior work has identified positional biases, such as the Lost in the Middle (LiM) effect, where models perform better when information appears at…

计算与语言 · 计算机科学 2025-08-12 Blerta Veseli , Julian Chibane , Mariya Toneva , Alexander Koller

As large language models transition from text-based interfaces to audio interactions in clinical settings, they might introduce new vulnerabilities through paralinguistic cues in audio. We evaluated these models on 170 clinical cases, each…

计算与语言 · 计算机科学 2025-11-11 Zhi Rui Tam , Yun-Nung Chen

Large Language Models (LLMs) have demonstrated impressive performance in time series analysis and seems to understand the time temporal relationship well than traditional transformer-based approaches. However, since LLMs are not designed…

机器学习 · 计算机科学 2025-05-27 Liangwei Nathan Zheng , Chang George Dong , Wei Emma Zhang , Lin Yue , Miao Xu , Olaf Maennel , Weitong Chen

Large Language Models (LLMs) are increasingly used in Spoken Language Understanding (SLU), where effective multimodal learning depends on the alignment between audio and text. Despite various fusion methods, no standard metric exists to…

计算与语言 · 计算机科学 2025-07-08 Pooneh Mousavi , Yingzhi Wang , Mirco Ravanelli , Cem Subakan

When deploying LLMs in agentic architectures requiring real-time decisions under temporal constraints, we assume they reliably determine whether action windows remain open or have closed. This assumption is untested. We characterize…

计算与语言 · 计算机科学 2025-11-17 Javier Marín

Large Language Models (LLMs) exhibit position bias systematically underweighting information based on its location in the context but how this bias varies across languages and models remains unclear. We conduct a multilingual study across…

Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data,…

机器学习 · 计算机科学 2024-05-08 Xiyuan Zhang , Ranak Roy Chowdhury , Rajesh K. Gupta , Jingbo Shang

Time series data is fundamental to decision-making across many domains including healthcare, finance, power systems, and logistics. However, analyzing this data correctly often requires incorporating unstructured contextual information,…

机器学习 · 计算机科学 2026-03-17 Felix Parker , Nimeesha Chan , Chi Zhang , Kimia Ghobadi

As AI chatbots become ubiquitous, voice interaction presents a compelling way to enable rapid, high-bandwidth communication for both semantic and social signals. This has driven research into Large Audio Models (LAMs) to power voice-native…

计算与语言 · 计算机科学 2025-02-25 Minzhi Li , William Barr Held , Michael J Ryan , Kunat Pipatanakul , Potsawee Manakul , Hao Zhu , Diyi Yang

Understanding the internal mechanisms of large audio-language models (LALMs) is crucial for interpreting their behavior and improving performance. This work presents the first in-depth analysis of how LALMs internally perceive and recognize…

计算与语言 · 计算机科学 2025-08-26 Chih-Kai Yang , Neo Ho , Yi-Jyun Lee , Hung-yi Lee

Large Audio Language Models (LALMs) have emerged as powerful tools for speech-related tasks but remain underexplored for fine-tuning, especially with limited speech data. To bridge this gap, we systematically examine how different…

声音 · 计算机科学 2026-01-22 Youngwon Choi , Jaeyoon Jung , Hyeonyu Kim , Huu-Kim Nguyen , Hwayeon Kim

Large Language Models (LLMs) have demonstrated remarkable generalization across diverse tasks, leading individuals to increasingly use them as personal assistants and universal computing engines. Nevertheless, a notable obstacle emerges…

机器学习 · 计算机科学 2023-09-13 Dimitris Spathis , Fahim Kawsar

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…