中文
相关论文

相关论文: On the Adversarial Robustness of 3D Large Vision-L…

200 篇论文

Vision language models (VLMs) can flexibly address various vision tasks through text interactions. Although successful in semantic understanding, state-of-the-art VLMs including GPT-5 still struggle in understanding 3D from 2D inputs. On…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Zhipeng Cai , Ching-Feng Yeh , Hu Xu , Zhuang Liu , Gregory Meyer , Xinjie Lei , Changsheng Zhao , Shang-Wen Li , Vikas Chandra , Yangyang Shi

The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and images. Existing evaluation datasets heavily lean towards…

计算与语言 · 计算机科学 2026-03-05 Gabriel Downer , Sean Craven , Damian Ruck , Jake Thomas

Vision-Language Models (VLMs) have shown remarkable performance, yet their security remains insufficiently understood. Existing adversarial studies focus almost exclusively on the digital setting, leaving physical-world threats largely…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Yingying Zhao , Chengyin Hu , Qike Zhang , Xin Li , Xin Wang , Yiwei Wei , Jiujiang Guo , Jiahuan Long , Tingsong Jiang , Wen Yao

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversarial training, while…

人工智能 · 计算机科学 2025-12-23 A. A. Gde Yogi Pramana , Jason Ray , Anthony Jaya , Michael Wijaya

The increasing reliance on large language models (LLMs) for diverse applications necessitates a thorough understanding of their robustness to adversarial perturbations and out-of-distribution (OOD) inputs. In this study, we investigate the…

计算与语言 · 计算机科学 2024-12-17 April Yang , Jordan Tab , Parth Shah , Paul Kotchavong

Vision language models (VLMs) have shown remarkable capabilities in integrating linguistic and visual reasoning but remain fundamentally limited in understanding dynamic spatiotemporal interactions. Humans effortlessly track and reason…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Shijie Zhou , Alexander Vilesov , Xuehai He , Ziyu Wan , Shuwang Zhang , Aditya Nagachandra , Di Chang , Dongdong Chen , Xin Eric Wang , Achuta Kadambi

Recent years have witnessed significant advancements in deep learning-based 3D object detection, leading to its widespread adoption in numerous applications. As 3D object detectors become increasingly crucial for security-critical tasks, it…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Yifan Zhang , Junhui Hou , Yixuan Yuan

Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in cross-modal understanding, but remain vulnerable to adversarial attacks through visual inputs despite robust textual safety mechanisms. These…

密码学与安全 · 计算机科学 2025-11-21 Wei Zhao , Zhe Li , Yige Li , Jun Sun

Adversarial attacks exploit vulnerabilities in a model's decision boundaries through small, carefully crafted perturbations that lead to significant mispredictions. In 3D vision, the high dimensionality and sparsity of data greatly expand…

计算机视觉与模式识别 · 计算机科学 2024-09-20 Nastaran Darabi , Dinithi Jayasuriya , Devashri Naik , Theja Tulabandhula , Amit Ranjan Trivedi

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Jiaheng Liu , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

Robust verbal confidence generated by large language models (LLMs) is crucial for the deployment of LLMs to help ensure transparency, trust, and safety in many applications, including those involving human-AI interactions. In this paper, we…

计算与语言 · 计算机科学 2025-12-19 Stephen Obadinma , Xiaodan Zhu

Large Language Models (LLMs) have become vital tools in software development tasks such as code generation, completion, and analysis. As their integration into workflows deepens, ensuring robustness against vulnerabilities especially those…

软件工程 · 计算机科学 2025-07-21 Yang Liu , Armstrong Foundjem , Foutse Khomh , Heng Li

Recent advancements in generative AI have led to the widespread adoption of large language models (LLMs) in software engineering, addressing numerous long-standing challenges. However, a comprehensive study examining the capabilities of…

Vision-Language Models (VLMs) extend the capabilities of Large Language Models (LLMs) by incorporating visual information, yet they remain vulnerable to jailbreak attacks, especially when processing noisy or corrupted images. Although…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Jiawei Wang , Yushen Zuo , Yuanjun Chai , Zhendong Liu , Yicheng Fu , Yichun Feng , Kin-Man Lam

Vision-Language Models (VLMs) are increasingly deployed in real-world applications, but their high inference cost makes them vulnerable to resource consumption attacks. Prior attacks attempt to extend VLM output sequences by optimizing…

密码学与安全 · 计算机科学 2025-08-27 Rui Zhang , Zihan Wang , Tianli Yang , Hongwei Li , Wenbo Jiang , Qingchuan Zhao , Yang Liu , Guowen Xu

The choice of a suitable visual language projector (VLP) is critical to the successful training of large visual language models (LVLMs). Mainstream VLPs can be broadly categorized into compressed and uncompressed projectors, and each offers…

密码学与安全 · 计算机科学 2025-10-07 Yudong Zhang , Ruobing Xie , Xingwu Sun , Jiansheng Chen , Zhanhui Kang , Di Wang , Yu Wang

Large Vision-Language Models (LVLMs), such as GPT-4o and LLaVA, have recently witnessed remarkable advancements and are increasingly being deployed in real-world applications. However, inheriting the sensitivity of visual neural networks,…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Chaohu Liu , Tianyi Gui , Yu Liu , Linli Xu

Large Vision-Language Models (LVLMs), trained on multimodal big datasets, have significantly advanced AI by excelling in vision-language tasks. However, these models remain vulnerable to adversarial attacks, particularly jailbreak attacks,…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Md Zarif Hossain , Ahmed Imteaj

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

Vision-language models (VLMs) are increasingly used in autonomous driving because they combine visual perception with language-based reasoning, supporting more interpretable decision-making, yet their robustness to physical adversarial…

计算机视觉与模式识别 · 计算机科学 2026-05-01 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Mert D. Pese