中文
相关论文

相关论文: HearSay Benchmark: Do Audio LLMs Leak What They He…

200 篇论文

The rise of multimodal large language models has introduced innovative human-machine interaction paradigms but also significant challenges in machine learning safety. Audio-Language Models (ALMs) are especially relevant due to the intuitive…

机器学习 · 计算机科学 2025-07-11 Isha Gupta , David Khachaturov , Robert Mullins

Large language models (LLMs) are primarily accessed via commercial APIs, but this often requires users to expose their data to service providers. In this paper, we explore how users can stay in control of their data by using privacy…

计算与语言 · 计算机科学 2025-10-21 Guillem Ramírez , Alexandra Birch , Ivan Titov

As large language models (LLMs) become ubiquitous in our daily tasks and digital interactions, associated privacy risks are increasingly in focus. While LLM privacy research has primarily focused on the leakage of model training data, it…

人工智能 · 计算机科学 2024-11-05 Batuhan Tömekçe , Mark Vero , Robin Staab , Martin Vechev

Large audio language models (LALMs) leverage multimodal representations to generate open-ended answers to natural language queries about audio. In this paper, we (1) provide empirical evidence that assessment of LALMs using the popular…

声音 · 计算机科学 2026-05-28 Daniel Chenyu Lin , Michael Freeman , John Thickstun

Recent advances in multi-modal Large Language Models (M-LLMs) have demonstrated a powerful ability to synthesize implicit information from disparate sources, including images and text. These resourceful data from social media also introduce…

密码学与安全 · 计算机科学 2025-11-11 Junhao Li , Jiahao Chen , Zhou Feng , Chunyi Zhou

Audio signals can reveal intimate details about a person's life, including their conversations, health status, emotions, location, and personal preferences. Unauthorized access or misuse of this information can have profound personal and…

声音 · 计算机科学 2024-06-10 Bhawana Chhaglani , Jeremy Gummeson , Prashant Shenoy

In an age of voice-enabled technology, voice anonymization offers a solution to protect people's privacy, provided these systems work equally well across subgroups. This study investigates bias in voice anonymization systems within the…

音频与语音处理 · 电气工程与系统科学 2023-11-28 Anna Leschanowsky , Ünal Ege Gaznepoglu , Nils Peters

Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal…

声音 · 计算机科学 2026-05-29 Bo-Han Feng , Yu-Hsuan Li Liang , Chien-Feng Liu , You-Hsuan Chang , Yun-Nung Chen

Large language models (LLMs) learn statistical associations from massive training corpora and user interactions, and deployed systems can surface or infer information about individuals. Yet people lack practical ways to inspect what a model…

人机交互 · 计算机科学 2026-03-13 Dimitri Staufer , Kirsten Morehouse , David Hartmann , Bettina Berendt

Audio deepfake detection has recently garnered public concern due to its implications for security and reliability. Traditional deep learning methods have been widely applied to this task but often lack generalisability when confronted with…

声音 · 计算机科学 2025-12-16 Yupei Li , Li Wang , Yuxiang Wang , Lei Wang , Rizhao Cai , Jie Shi , Björn W. Schuller , Zhizheng Wu

The rise of Large Audio Language Models (LAMs) brings both potential and risks, as their audio outputs may contain harmful or unethical content. However, current research lacks a systematic, quantitative evaluation of LAM safety especially…

Recently, instruction-following audio-language models have received broad attention for human-audio interaction. However, the absence of benchmarks capable of evaluating audio-centric interaction capabilities has impeded advancements in…

音频与语音处理 · 电气工程与系统科学 2024-07-29 Qian Yang , Jin Xu , Wenrui Liu , Yunfei Chu , Ziyue Jiang , Xiaohuan Zhou , Yichong Leng , Yuanjun Lv , Zhou Zhao , Chang Zhou , Jingren Zhou

Current privacy research on large language models (LLMs) primarily focuses on the issue of extracting memorized training data. At the same time, models' inference capabilities have increased drastically. This raises the key question of…

人工智能 · 计算机科学 2024-05-07 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

The rapid proliferation of large audio models (LAMs) demands efficient approaches for model comparison, yet comprehensive benchmarks are costly. To fill this gap, we investigate whether minimal subsets can reliably evaluate LAMs while…

计算与语言 · 计算机科学 2026-05-04 Woody Haosheng Gan , William Held , Diyi Yang

Recent audio-aware large language models (ALLMs) have demonstrated strong capabilities across diverse audio understanding and reasoning tasks, but they still frequently produce hallucinated or overly confident outputs. While uncertainty…

音频与语音处理 · 电气工程与系统科学 2026-04-29 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

With the rapid development of artificial intelligence, large language models (LLMs) have made remarkable advancements in natural language processing. These models are trained on vast datasets to exhibit powerful language understanding and…

密码学与安全 · 计算机科学 2025-09-22 Shang Wang , Tianqing Zhu , Bo Liu , Ming Ding , Dayong Ye , Wanlei Zhou , Philip S. Yu

The imposing evolution of artificial intelligence systems and, specifically, of Large Language Models (LLM) makes it necessary to carry out assessments of their level of risk and the impact they may have in the area of privacy, personal…

计算机与社会 · 计算机科学 2024-04-03 Nicola Fabiano

Large Language Models (LLMs) are gaining increasing attention due to their exceptional performance across numerous tasks. As a result, the general public utilize them as an influential tool for boosting their productivity while natural…

密码学与安全 · 计算机科学 2023-06-16 Zhigang Kan , Linbo Qiao , Hao Yu , Liwen Peng , Yifu Gao , Dongsheng Li

While robots have previously utilized rule-based systems or probabilistic models for user interaction, the rapid evolution of large language models (LLMs) presents new opportunities to develop LLM-powered robots for enhanced human-robot…

机器人学 · 计算机科学 2025-11-18 Dakota Sullivan , Shirley Zhang , Jennica Li , Heather Kirkorian , Bilge Mutlu , Kassem Fawaz

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

计算与语言 · 计算机科学 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu