中文
相关论文

相关论文: Comparative Analysis of Patch Attack on VLM-Based …

200 篇论文

Large Language Models (LLMs) are increasingly used in agentic systems, where their interactions with diverse tools and environments create complex, multi-stage safety challenges. However, existing benchmarks mostly rely on static,…

密码学与安全 · 计算机科学 2026-02-03 Liming Lu , Xiang Gu , Junyu Huang , Jiawei Du , Xu Zheng , Yunhuai Liu , Yongbin Zhou , Shuchao Pang

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

人工智能 · 计算机科学 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Open-source software vulnerability patch detection is a critical component for maintaining software security and ensuring software supply chain integrity. Traditional manual detection methods face significant scalability challenges when…

软件工程 · 计算机科学 2025-09-30 Haoran Xu , Chen Zhi , Junxiao Han , Xinkui Zhao , Jianwei Yin , Shuiguang Deng

Vision-Language Models (VLMs) can perform zero-shot classification but are susceptible to adversarial attacks. While robust fine-tuning improves their robustness, existing approaches align fixed text embeddings with an image embedding,…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Junhao Dong , Yifei Zhang , Hao Zhu , Yew-Soon Ong , Piotr Koniusz

Vision-Language-Action (VLA) models have recently emerged in autonomous driving, with the promise of leveraging rich world knowledge to improve the cognitive capabilities of driving systems. However, adapting such models for driving tasks…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Yongkang Li , Lijun Zhou , Sixu Yan , Bencheng Liao , Tianyi Yan , Kaixin Xiong , Long Chen , Hongwei Xie , Bing Wang , Guang Chen , Hangjun Ye , Wenyu Liu , Haiyang Sun , Xinggang Wang

Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However, securing these models against jailbreak attacks continues to be a substantial challenge.…

密码学与安全 · 计算机科学 2025-10-14 Aofan Liu , Lulu Tang

Building on the unprecedented capabilities of large language models for command understanding and zero-shot recognition of multi-modal vision-language transformers, visual language navigation (VLN) has emerged as an effective way to address…

机器人学 · 计算机科学 2024-07-11 Chashi Mahiul Islam , Shaeke Salman , Montasir Shams , Xiuwen Liu , Piyush Kumar

Robotic manipulation policies are increasingly empowered by \textit{large language models} (LLMs) and \textit{vision-language models} (VLMs), leveraging their understanding and perception capabilities. Recently, inference-time attacks…

Vision-Large-Language-models(VLMs) have great application prospects in autonomous driving. Despite the ability of VLMs to comprehend and make decisions in complex scenarios, their integration into safety-critical autonomous driving systems…

密码学与安全 · 计算机科学 2024-04-23 Zhenyang Ni , Rui Ye , Yuxi Wei , Zhen Xiang , Yanfeng Wang , Siheng Chen

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

机器人学 · 计算机科学 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Recent developments in vision language models (VLM) have shown great potential for diverse applications related to image understanding. In this study, we have explored state-of-the-art VLM models for vision-based transportation engineering…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Sanjita Prajapati , Tanu Singh , Chinmay Hegde , Pranamesh Chakraborty

Autonomous driving represents a prominent application of artificial intelligence. Recent approaches have shifted from focusing solely on common scenarios to addressing complex, long-tail situations such as subtle human behaviors, traffic…

机器人学 · 计算机科学 2025-11-26 Dapeng Zhang , Fei Shen , Rui Zhao , Yinda Chen , Peng Zhi , Chenyang Li , Rui Zhou , Qingguo Zhou

Autonomous agents powered by large vision and language models (VLM) have demonstrated significant potential in completing daily computer tasks, such as browsing the web to book travel and operating desktop software, which requires agents to…

计算与语言 · 计算机科学 2025-05-27 Yanzhe Zhang , Tao Yu , Diyi Yang

Large Language Models increasingly power critical infrastructure from healthcare to finance, yet their vulnerability to adversarial manipulation threatens system integrity and user safety. Despite growing deployment, no comprehensive…

密码学与安全 · 计算机科学 2026-03-19 Taiwo Onitiju , Iman Vakilinia

Autonomous driving is a complex and challenging task that aims at safe motion planning through scene understanding and reasoning. While vision-only autonomous driving methods have recently achieved notable performance, through enhanced…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Chenbin Pan , Burhaneddin Yaman , Tommaso Nesti , Abhirup Mallik , Alessandro G Allievi , Senem Velipasalar , Liu Ren

With the increase in deep learning, it becomes increasingly difficult to understand the model in which AI systems can identify objects. Thus, an adversary could aim to modify an image by adding unseen elements, which will confuse the AI in…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Jonathon Fox , William J Buchanan , Pavlos Papadopoulos

Multimodal Large Language Models (MLLMs) have achieved remarkable performance across vision-language tasks. Recent advancements allow these models to process multiple images as inputs. However, the vulnerabilities of multi-image MLLMs…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Alvi Md Ishmam , Najibul Haque Sarker , Zaber Ibn Abdul Hakim , Chris Thomas

While vision and multimodal foundation models underpin critical tasks from perception to complex reasoning, they remain highly vulnerable to adversarial attacks. However, traditional adversarial attacks are typically limited to single,…

密码学与安全 · 计算机科学 2026-05-20 Ye Sun , Xin Wang , Jiaming Zhang , Yifeng Gao , Yixu Wang , Yifan Ding , Qixian Zhang , Henghui Ding , Xingjun Ma , Yu-Gang Jiang

Recent advancements in large vision language models (VLMs) tailored for autonomous driving (AD) have shown strong scene understanding and reasoning capabilities, making them undeniable candidates for end-to-end driving systems. However,…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Shuo Xing , Hongyuan Hua , Xiangbo Gao , Shenzhe Zhu , Renjie Li , Kexin Tian , Xiaopeng Li , Heng Huang , Tianbao Yang , Zhangyang Wang , Yang Zhou , Huaxiu Yao , Zhengzhong Tu

Drivers are becoming increasingly reliant on advanced driver assistance systems (ADAS) as autonomous driving technology becomes more popular and developed with advanced safety features to enhance road safety. However, the increasing…

密码学与安全 · 计算机科学 2025-06-23 Cheng Chen , Grant Xiao , Daehyun Lee , Lishan Yang , Evgenia Smirni , Homa Alemzadeh , Xugui Zhou