English
Related papers

Related papers: Towards Probing Speech-Specific Risks in Large Mul…

200 papers

The exponential growth of social media has profoundly transformed how information is created, disseminated, and absorbed, exceeding any precedent in the digital age. Regrettably, this explosion has also spawned a significant increase in the…

Computation and Language · Computer Science 2025-03-03 Hongzhan Lin , Ziyang Luo , Bo Wang , Ruichao Yang , Jing Ma

Multimodal Large Language Models (MLLMs) have expanded the capabilities of traditional language models by enabling interaction through both text and images. However, ensuring the safety of these models remains a significant challenge,…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Xiaoyuan Liu , Kuiyi Gao , Jen-tse Huang , Youliang Yuan , Pinjia He , Shuai Wang , Zhaopeng Tu

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Large Language Models (LLMs) are transforming education by enabling personalization, feedback, and knowledge access, while also raising concerns about risks to students and learning systems. Yet empirical evidence on these risks remains…

Computers and Society · Computer Science 2025-11-04 Iris Delikoura , Yi. R Fung , Pan Hui

Recent technological advancements in multimodal machine learning--including the rise of large language models (LLMs)--have improved our ability to collect, process, and analyze diverse multimodal data such as speech, video, and eye gaze in…

Large Language Models have seen rapid progress in capability in recent years; this progress has been accelerating and their capabilities, measured by various benchmarks, are beginning to approach those of humans. There is a strong demand to…

Computation and Language · Computer Science 2023-12-07 Brett Israelsen , Soumalya Sarkar

Social categories and stereotypes are embedded in language and can introduce data bias into Large Language Models (LLMs). Despite safeguards, these biases often persist in model behavior, potentially leading to representational harm in…

Computation and Language · Computer Science 2025-02-27 Rebekka Görge , Michael Mock , Héctor Allende-Cid

With the rapid development of artificial intelligence, large language models (LLMs) have made remarkable advancements in natural language processing. These models are trained on vast datasets to exhibit powerful language understanding and…

Cryptography and Security · Computer Science 2025-09-22 Shang Wang , Tianqing Zhu , Bo Liu , Ming Ding , Dayong Ye , Wanlei Zhou , Philip S. Yu

Large Language Models (LLMs) are acquiring a wider range of capabilities, including understanding and responding in multiple languages. While they undergo safety training to prevent them from answering illegal questions, imbalances in…

Computation and Language · Computer Science 2025-03-18 Likai Tang , Niruth Bogahawatta , Yasod Ginige , Jiarui Xu , Shixuan Sun , Surangika Ranathunga , Suranga Seneviratne

As modern Large Language Models (LLMs) shatter many state-of-the-art benchmarks in a variety of domains, this paper investigates their behavior in the domains of ethics and fairness, focusing on protected group bias. We conduct a two-part…

Computers and Society · Computer Science 2024-03-25 Hadas Kotek , David Q. Sun , Zidi Xiu , Margit Bowler , Christopher Klein

Hate speech is a harmful form of online expression, often manifesting as derogatory posts. It is a significant risk in digital environments. With the rise of Large Language Models (LLMs), there is concern about their potential to replicate…

Computation and Language · Computer Science 2025-06-10 Paloma Piot , Javier Parapar

As the volume of video content online grows exponentially, the demand for moderation of unsafe videos has surpassed human capabilities, posing both operational and mental health challenges. While recent studies demonstrated the merits of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Adi Levi , Or Levi , Sardhendu Mishra , Jonathan Morra

Large language models are rapidly transforming social science research by enabling the automation of labor-intensive tasks like data annotation and text analysis. However, LLM outputs vary significantly depending on the implementation…

Computation and Language · Computer Science 2025-10-07 Joachim Baumann , Paul Röttger , Aleksandra Urman , Albert Wendsjö , Flor Miriam Plaza-del-Arco , Johannes B. Gruber , Dirk Hovy

Multimodal Large Language Models (MLLMs) have demonstrated exceptional performance in artificial intelligence by facilitating integrated understanding across diverse modalities, including text, images, video, audio, and speech. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chengze Jiang , Zhuangzhuang Wang , Minjing Dong , Jie Gui

Mental health disorders are increasingly prevalent worldwide, creating an urgent need for innovative tools to support early diagnosis and intervention. This study explores the potential of Large Language Models (LLMs) in multimodal mental…

Computation and Language · Computer Science 2025-08-14 Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

As large language models (LLMs) are increasingly embedded in everyday decision-making, their safety responsibilities extend beyond reacting to explicit harmful intent toward anticipating unintended but consequential risks. In this work, we…

Computation and Language · Computer Science 2026-02-25 Xuan Luo , Yubin Chen , Zhiyu Hou , Linpu Yu , Geng Tu , Jing Li , Ruifeng Xu

Large Audio Language Models (LALMs) expand jailbreak risks from token-level prompting to the full speech perception-to-reasoning pipeline, where unsafe behavior can be induced through semantics, acoustic style, signal artifacts, or internal…

Sound · Computer Science 2026-05-29 Bo-Han Feng , Yu-Hsuan Li Liang , Chien-Feng Liu , You-Hsuan Chang , Yun-Nung Chen

Multimodal language analysis is a rapidly evolving field that leverages multiple modalities to enhance the understanding of high-level semantics underlying human conversational utterances. Despite its significance, little research has…

Computation and Language · Computer Science 2025-04-25 Hanlei Zhang , Zhuohang Li , Yeshuang Zhu , Hua Xu , Peiwu Wang , Haige Zhu , Jie Zhou , Jinchao Zhang

Predicting human behavior in shared environments is crucial for safe and efficient human-robot interaction. Traditional data-driven methods to that end are pre-trained on domain-specific datasets, activity types, and prediction horizons. In…

Robotics · Computer Science 2025-06-24 Yuchen Liu , Lino Lerch , Luigi Palmieri , Andrey Rudenko , Sebastian Koch , Timo Ropinski , Marco Aiello

Large Language Models(LLMs) are increasingly explored for cybersecurity applications such as vulnerability detection. In the domain of threat modelling, prior work has primarily evaluated a number of general-purpose Large Language Models…

Cryptography and Security · Computer Science 2026-05-12 Saba Pourhanifeh , AbdulAziz AbdulGhaffar , Ashraf Matrawy