中文
相关论文

相关论文: Consistent but Dangerous: Per-Sample Safety Classi…

200 篇论文

The use of children's drawings to examining their conceptual understanding has been proven to be an effective method, but there are two major problems with previous research: 1. The content of the drawings heavily relies on the task, and…

计算与语言 · 计算机科学 2025-08-28 Yi Zhang , Fan Wei , Jingyi Li , Yan Wang , Yanyan Yu , Jianli Chen , Zipo Cai , Xinyu Liu , Wei Wang , Sensen Yao , Peng Wang , Zhong Wang

Large language models (LLMs) are increasingly consulted by parents for pediatric guidance, yet their safety under real-world adversarial pressures is poorly understood. Anxious parents often use urgent language that can compromise model…

人工智能 · 计算机科学 2025-12-19 Vahideh Zolfaghari

Safety alignment of Large Language Models (LLMs) is extremely fragile, as fine-tuning on a small number of benign samples can erase safety behaviors learned from millions of preference examples. Existing studies attempt to explain this…

人工智能 · 计算机科学 2026-05-07 Xiao Wang , Yifei Zhang , YongKang Liu , Xiaocui Yang , Zihan Wang , Shi Feng , Daling Wang

Medical image diagnosis is challenging because many diseases resemble normal anatomy and exhibit substantial interpatient variability. Clinicians routinely rely on comparative diagnosis, such as referencing cross-patient healthy control…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Ruinan Jin , Gexin Huang , Xinwei Shen , Qiong Zhang , Yan Shuo Tan , Xiaoxiao Li

Vision-Language adaptation (VL adaptation) transforms Large Language Models (LLMs) into Large Vision-Language Models (LVLMs) for multimodal tasks, but this process often compromises the inherent safety capabilities embedded in the original…

计算与语言 · 计算机科学 2024-11-18 Seongyun Lee , Geewook Kim , Jiyeon Kim , Hyunji Lee , Hoyeon Chang , Sue Hyun Park , Minjoon Seo

Medical vision-language models (VLMs) have demonstrated unprecedented transfer capabilities and are being increasingly adopted for data-efficient image classification. Despite its growing popularity, its reliability aspect remains largely…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Julio Silva-Rodríguez , Ismail Ben Ayed , Jose Dolz

Medical vision-language models (Med-VLMs) trained on large datasets of medical image-text pairs and later fine-tuned for specific tasks have emerged as a mainstream paradigm in medical image analysis. However, recent studies have…

计算机视觉与模式识别 · 计算机科学 2024-08-30 Noor Hussein , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar

Fine-tuning Large Language Models (LLMs) has emerged as a common practice for tailoring models to individual needs and preferences. The choice of datasets for fine-tuning can be diverse, introducing safety concerns regarding the potential…

计算与语言 · 计算机科学 2024-10-15 Hyeong Kyu Choi , Xuefeng Du , Yixuan Li

Fine-tuning large language models (LLMs) on additional datasets is often necessary to optimize them for specific downstream tasks. However, existing safety alignment measures, which restrict harmful behavior during inference, are…

计算与语言 · 计算机科学 2024-10-15 Minjun Zhu , Linyi Yang , Yifan Wei , Ningyu Zhang , Yue Zhang

Accurately gauging the confidence level of Large Language Models' (LLMs) predictions is pivotal for their reliable application. However, LLMs are often uncalibrated inherently and elude conventional calibration techniques due to their…

Language Confusion is a phenomenon where Large Language Models (LLMs) generate text that is neither in the desired language, nor in a contextually appropriate language. This phenomenon presents a critical challenge in text generation by…

计算与语言 · 计算机科学 2025-02-11 Yiyi Chen , Qiongxiu Li , Russa Biswas , Johannes Bjerva

Large language models (LLMs) undergo safety alignment to ensure safe conversations with humans. However, this paper introduces a training-free attack method capable of reversing safety alignment, converting the outcomes of stronger…

计算与语言 · 计算机科学 2024-06-07 Zhanhui Zhou , Jie Liu , Zhichen Dong , Jiaheng Liu , Chao Yang , Wanli Ouyang , Yu Qiao

Generative medical vision-language models~(Med-VLMs) are primarily designed to generate complex textual information~(e.g., diagnostic reports) from multimodal inputs including vision modality~(e.g., medical images) and language…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Zhiyu Xue , Reza Abbasi-Asl , Ramtin Pedarsani

Medical vision-language models (VLMs) are strong zero-shot recognizers for medical imaging, but their reliability under domain shift hinges on calibrated uncertainty with guarantees. Split conformal prediction (SCP) offers finite-sample…

计算机视觉与模式识别 · 计算机科学 2026-02-20 Behzad Bozorgtabar , Dwarikanath Mahapatra , Sudipta Roy , Muzammal Naseer , Imran Razzak , Zongyuan Ge

Recent progress in large language models (LLMs) has led to their widespread adoption in various domains. However, these advancements have also introduced additional safety risks and raised concerns regarding their detrimental impact on…

Large language models (LLMs) hallucinate with confidence: their outputs can be fluent, authoritative, and simply wrong. In medical, legal, and scientific applications this failure causes direct harm, and detecting it from internal model…

计算与语言 · 计算机科学 2026-05-19 Khizar Hussain , Murat Kantarcioglu

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

软件工程 · 计算机科学 2026-04-07 Rabia Iftikhar , Andreas Rausch

Prompt-based verification is widely used to mitigate hallucinations in large vision-language models (LVLMs), yet when it helps remains poorly understood. We systematically study verification prompting across two representative LVLM…

计算与语言 · 计算机科学 2026-05-28 Yuang Huang , Yafeng Zhang , Yu Zilan

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

机器人学 · 计算机科学 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

To leverage the full potential of Large Language Models (LLMs) it is crucial to have some information on their answers' uncertainty. This means that the model has to be able to quantify how certain it is in the correctness of a given…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Mirko Borszukovszki , Ivo Pascal de Jong , Matias Valdenegro-Toro