English
Related papers

Related papers: Unveiling Trust in Multimodal Large Language Model…

200 papers

The rapid advancement of multi-modal large reasoning models (MLRMs) -- enhanced versions of multimodal language models (MLLMs) equipped with reasoning capabilities -- has revolutionized diverse applications. However, their safety…

Machine Learning · Computer Science 2025-04-15 Junfeng Fang , Yukai Wang , Ruipeng Wang , Zijun Yao , Kun Wang , An Zhang , Xiang Wang , Tat-Seng Chua

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

Large language models (LLMs) are rapidly transitioning into medical clinical use, yet their reliability under realistic, multi-turn interactions remains poorly understood. Existing evaluation frameworks typically assess single-turn question…

Computation and Language · Computer Science 2025-10-15 Blazej Manczak , Eric Lin , Francisco Eiras , James O' Neill , Vaikkunth Mugunthan

Large language models (LLMs) have demonstrated remarkable capabilities across a broad spectrum of tasks. They have attracted significant attention and been deployed in numerous downstream applications. Nevertheless, akin to a double-edged…

Computation and Language · Computer Science 2023-11-28 Zishan Guo , Renren Jin , Chuang Liu , Yufei Huang , Dan Shi , Supryadi , Linhao Yu , Yan Liu , Jiaxuan Li , Bojian Xiong , Deyi Xiong

The foundational capabilities established by Large Language Models (LLMs) have paved the way for Multimodal Large Language Models (MLLMs), within which Large Audio Language Models (LALMs) are essential for realizing universal auditory…

The application of large language models (LLMs) in healthcare holds significant promise for enhancing clinical decision-making, medical research, and patient care. However, their integration into real-world clinical settings raises critical…

Computers and Society · Computer Science 2025-09-18 Manar Aljohani , Jun Hou , Sindhura Kommu , Xuan Wang

While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy…

Artificial Intelligence · Computer Science 2025-01-17 Huandong Wang , Wenjie Fu , Yingzhou Tang , Zhilong Chen , Yuxi Huang , Jinghua Piao , Chen Gao , Fengli Xu , Tao Jiang , Yong Li

Large Language Models (LLMs) excel in various natural language processing tasks but remain vulnerable to generating harmful content or being exploited for malicious purposes. Although safety alignment datasets have been introduced to…

Computation and Language · Computer Science 2026-04-20 Xiaorui Wu , Xiaofeng Mao , Fei Li , Xin Zhang , Xuanhong Li , Chong Teng , Donghong Ji , Zhuang Li

As Vision-Language Models (VLMs) move into interactive, multi-turn use, safety concerns intensify for multimodal multi-turn dialogue, which is characterized by concealment of malicious intent, contextual risk accumulation, and cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Guolei Huang , Qinzhi Peng , Gan Xu , Yao Huang , Yuxuan Lu , Yongjun Shen

Multimodal Large Language Models (MLLMs) have expanded the capabilities of traditional language models by enabling interaction through both text and images. However, ensuring the safety of these models remains a significant challenge,…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Xiaoyuan Liu , Kuiyi Gao , Jen-tse Huang , Youliang Yuan , Pinjia He , Shuai Wang , Zhaopeng Tu

Since Multimodal Large Language Models (MLLMs) are increasingly being integrated into everyday tools and intelligent agents, growing concerns have arisen regarding their possible output of unsafe contents, ranging from toxic language and…

Machine Learning · Computer Science 2026-04-08 Yuping Yan , Yuhan Xie , Yuanshuai Li , Yingchao Yu , Lingjuan Lyu , Yaochu Jin

Despite their advanced reasoning capabilities, state-of-the-art Multimodal Large Language Models (MLLMs) demonstrably lack a core component of human intelligence: the ability to `read the room' and assess deception in complex social…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Caixin Kang , Yifei Huang , Liangyang Ouyang , Mingfang Zhang , Ruicong Liu , Yoichi Sato

Mental health disorders affect hundreds of millions globally, and the Web now serves as a primary medium for accessing support, information, and assessment. Large language models (LLMs) offer scalable and accessible assistance, yet their…

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

Machine Learning · Computer Science 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Ensuring alignment, which refers to making models behave in accordance with human intentions [1,2], has become a critical task before deploying large language models (LLMs) in real-world applications. For instance, OpenAI devoted six months…

Artificial Intelligence · Computer Science 2024-03-22 Yang Liu , Yuanshun Yao , Jean-Francois Ton , Xiaoying Zhang , Ruocheng Guo , Hao Cheng , Yegor Klochkov , Muhammad Faaiz Taufiq , Hang Li

Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale:…

With the rapid advancement of Multi-modal Large Language Models (MLLMs), several diagnostic benchmarks have recently been developed to assess these models' multi-modal reasoning proficiency. However, these benchmarks are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Sanjoy Chowdhury , Sayan Nag , Subhrajyoti Dasgupta , Yaoting Wang , Mohamed Elhoseiny , Ruohan Gao , Dinesh Manocha

Toxicity detection in multimodal text-image content faces growing challenges, especially with multimodal implicit toxicity, where each modality appears benign on its own but conveys hazard when combined. Multimodal implicit toxicity appears…

Multimedia · Computer Science 2025-05-21 Shiyao Cui , Qinglin Zhang , Xuan Ouyang , Renmiao Chen , Zhexin Zhang , Yida Lu , Hongning Wang , Han Qiu , Minlie Huang

Large Language Models (LLMs) have exploded a new heatwave of AI for their ability to engage end-users in human-level conversations with detailed and articulate answers across many knowledge domains. In response to their fast adoption in…