中文
相关论文

相关论文: JECA^2: Judgment-Explanation Consistent Adversaria…

200 篇论文

Vision-language models (VLMs) have made significant progress in recent visual-question-answering (VQA) benchmarks that evaluate complex visio-linguistic reasoning. However, are these models truly effective? In this work, we show that VLMs…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Baiqi Li , Zhiqiu Lin , Wenxuan Peng , Jean de Dieu Nyandwi , Daniel Jiang , Zixian Ma , Simran Khanuja , Ranjay Krishna , Graham Neubig , Deva Ramanan

The recent developments in deep learning led to the integration of natural language processing (NLP) with computer vision, resulting in powerful integrated Vision and Language Models (VLMs). Despite their remarkable capabilities, these…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Harshit , Tolga Tasdizen

Vision-Language Models (VLMs), with their strong reasoning and planning capabilities, are widely used in embodied decision-making (EDM) tasks in embodied agents, such as autonomous driving and robotic manipulation. Recent research has…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Yichen Wang , Hangtao Zhang , Hewen Pan , Ziqi Zhou , Xianlong Wang , Peijin Guo , Lulu Xue , Shengshan Hu , Minghui Li , Leo Yu Zhang

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

密码学与安全 · 计算机科学 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

机器人学 · 计算机科学 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

The advancement of Large Language Models (LLMs) has greatly improved our ability to process complex language. However, accurately detecting logical fallacies remains a significant challenge. This study presents a novel and effective prompt…

人工智能 · 计算机科学 2025-04-01 Jiwon Jeong , Hyeju Jang , Hogun Park

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Amirhosein Chahe , Lifeng Zhou

The proliferation of deepfake technologies poses urgent challenges and serious risks to digital integrity, particularly within critical sectors such as forensics, journalism, and the legal system. While existing detection systems have made…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Shahroz Tariq , Simon S. Woo , Priyanka Singh , Irena Irmalasari , Saakshi Gupta , Dev Gupta

With the increasing prevalence of synthetic images, evaluating image authenticity and locating forgeries accurately while maintaining human interpretability remains a challenging task. Existing detection models primarily focus on simple…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Zhuokang Shen , Kaisen Zhang , Bohan Jia , Heming Jia , Yuan Fang , Zhou Yu , Shaohui Lin

With the increase in deep learning, it becomes increasingly difficult to understand the model in which AI systems can identify objects. Thus, an adversary could aim to modify an image by adding unseen elements, which will confuse the AI in…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Jonathon Fox , William J Buchanan , Pavlos Papadopoulos

Vision-language models (VLMs) such as CLIP demonstrate strong generalization in zero-shot classification but remain highly vulnerable to adversarial perturbations. Existing methods primarily focus on adversarial fine-tuning or prompt…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Xingyu Zhu , Beier Zhu , Shuo Wang , Kesen Zhao , Hanwang Zhang

Large vision-language models (VLMs) often rely on familiar semantic priors, but existing evaluations do not cleanly separate perception failures from rule-mapping failures. We study this behavior as semantic fixation: preserving a default…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Md Tanvirul Alam

The emergence of vision-language-action models (VLAs) for end-to-end control is reshaping the field of robotics by enabling the fusion of multimodal sensory inputs at the billion-parameter scale. The capabilities of VLAs stem primarily from…

Vision-Language Models (VLMs) can perform zero-shot classification but are susceptible to adversarial attacks. While robust fine-tuning improves their robustness, existing approaches align fixed text embeddings with an image embedding,…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Junhao Dong , Yifei Zhang , Hao Zhu , Yew-Soon Ong , Piotr Koniusz

We introduce VL-JEPA, a vision-language model built on a Joint Embedding Predictive Architecture (JEPA). Instead of autoregressively generating tokens as in classical VLMs, VL-JEPA predicts continuous embeddings of the target texts. By…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Delong Chen , Mustafa Shukor , Theo Moutakanni , Willy Chung , Jade Yu , Tejaswi Kasarla , Yejin Bang , Allen Bolourchi , Yann LeCun , Pascale Fung

The widespread practice of fine-tuning open-source Vision-Language Models (VLMs) raises a critical security concern: jailbreak vulnerabilities in base models may persist in downstream variants, enabling transferable attacks across…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Ruofan Wang , Xin Wang , Yang Yao , Juncheng Li , Xuan Tong , Xingjun Ma

Vision-Language Models (VLMs) exhibit impressive performance, yet the integration of powerful vision encoders has significantly broadened their attack surface, rendering them increasingly susceptible to jailbreak attacks. However, lacking…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Jiaxin Song , Yixu Wang , Jie Li , Rui Yu , Yan Teng , Xingjun Ma , Yingchun Wang

The rapid evolution of generative adversarial networks (GANs) and diffusion models has made synthetic media increasingly realistic, raising societal concerns around misinformation, identity fraud, and digital trust. Existing deepfake…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Sales Aribe

End-to-end Vision-language Models (VLMs) often answer visual questions by exploiting spurious correlations instead of causal visual evidence, and can become more shortcut-prone when fine-tuned. We introduce VISTA (Visual-Information…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Zhaonan Li , Shijie Lu , Fei Wang , Jacob Dineen , Xiao Ye , Zhikun Xu , Siyi Liu , Young Min Cho , Bangzheng Li , Daniel Chang , Kenny Nguyen , Qizheng Yang , Muhao Chen , Ben Zhou

Recent advances in large vision-language models (LVLMs) have amplified concerns about fairness, yet existing evaluations remain confined to demographic attributes and often conflate fairness with refusal behavior. This paper broadens the…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Zaiying Zhao , Toshihiko Yamasaki