English
Related papers

Related papers: Resource Consumption Red-Teaming for Large Vision-…

200 papers

VLMs (Vision-Language Models) extend the capabilities of LLMs (Large Language Models) to accept multimodal inputs. Since it has been verified that LLMs can be induced to generate harmful or inaccurate content through specific test cases…

Artificial Intelligence · Computer Science 2024-01-24 Mukai Li , Lei Li , Yuwei Yin , Masood Ahmed , Zhenguang Liu , Qi Liu

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Large Language Models (LLMs) have been augmented with web search to overcome the limitations of the static knowledge boundary by accessing up-to-date information from the open Internet. While this integration enhances model capability, it…

Cryptography and Security · Computer Science 2026-04-20 Haoran Ou , Kangjie Chen , Xingshuo Han , Gelei Deng , Jie Zhang , Han Qiu , Tianwei Zhang

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

Robotics · Computer Science 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

The rapid advancement of Vision-Language Models (VLMs) has brought their safety vulnerabilities into sharp focus. However, existing red teaming methods are fundamentally constrained by an inherent linear exploration paradigm, confining them…

Machine Learning · Computer Science 2026-03-25 Chunxiao Li , Lijun Li , Jing Shao

Long-context large language models (LLMs)-for example, Gemini-3.1-Pro and Qwen-3.5-are widely used to empower many real-world applications, such as retrieval-augmented generation, autonomous agents, and AI assistants. However, security…

Cryptography and Security · Computer Science 2026-05-01 Yanting Wang , Chenlong Yin , Ying Chen , Jinyuan Jia

While tool learning significantly enhances the capabilities of large language models (LLMs), it also introduces substantial security risks. Prior research has revealed various vulnerabilities in traditional LLMs during tool learning.…

Computation and Language · Computer Science 2025-05-26 Yifei Liu , Yu Cui , Haibin Zhang

Vision-Language Models (VLMs) with multimodal reasoning capabilities are high-value attack targets, given their potential for handling complex multimodal harmful tasks. Mainstream black-box jailbreak attacks on VLMs work by distributing…

Cryptography and Security · Computer Science 2026-02-12 Yu Yan , Sheng Sun , Shengjia Cheng , Teli Liu , Mingfeng Li , Min Liu

As large language models (LLMs) are increasingly deployed as black-box components in real-world applications, red teaming has become essential for identifying potential risks. It tests LLMs with adversarial prompts to uncover…

Machine Learning · Computer Science 2026-03-25 Jiale Ding , Xiang Zheng , Yutao Wu , Cong Wang , Wei-Bin Lee , Ling Pan , Xingjun Ma , Yu-Gang Jiang

Large Reasoning Models (LRMs) employ reasoning to address complex tasks. Such explicit reasoning requires extended context lengths, resulting in substantially higher resource consumption. Prior work has shown that adversarially crafted…

Artificial Intelligence · Computer Science 2026-02-10 Ziwei Wang , Yuanhe Zhang , Jing Chen , Zhenhong Zhou , Ruichao Liang , Ruiying Du , Ju Jia , Cong Wu , Yang Liu

Given limited and costly computational infrastructure, resource efficiency is a key requirement for large language models (LLMs). Efficient LLMs increase service capacity for providers and reduce latency and API costs for users. Recent…

Cryptography and Security · Computer Science 2026-04-14 Yuanhe Zhang , Xinyue Wang , Zhican Chen , Weiliu Wang , Zilu Zhang , Zhengshuo Gong , Zhenhong Zhou , Kun Wang , Li Sun , Yang Liu , Sen Su

Large Language Models (LLMs) deployed on edge devices learn through fine-tuning and updating a certain portion of their parameters. Although such learning methods can be optimized to reduce resource utilization, the overall required…

Machine Learning · Computer Science 2024-05-09 Ruiyang Qin , Zheyu Yan , Dewen Zeng , Zhenge Jia , Dancheng Liu , Jianbo Liu , Zhi Zheng , Ningyuan Cao , Kai Ni , Jinjun Xiong , Yiyu Shi

Large Language Model (LLM) safeguards, which implement request refusals, have become a widely adopted mitigation strategy against misuse. At the intersection of adversarial machine learning and AI safety, safeguard red teaming has…

Cryptography and Security · Computer Science 2025-06-10 Zifan Wang , Christina Q. Knight , Jeremy Kritz , Willow E. Primack , Julian Michael

Large language models (LLMs) have shown promise in assisting cybersecurity tasks, yet existing approaches struggle with automatic vulnerability discovery and exploitation due to limited interaction, weak execution grounding, and a lack of…

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Large Language Models (LLMs) have gained increasing attention for their remarkable capacity, alongside concerns about safety arising from their potential to produce harmful content. Red teaming aims to find prompts that could elicit harmful…

Computation and Language · Computer Science 2025-02-25 Rui Li , Peiyi Wang , Jingyuan Ma , Di Zhang , Lei Sha , Zhifang Sui

Vision-Language Models (VLMs) are increasingly deployed in real-world applications, but their high inference cost makes them vulnerable to resource consumption attacks. Prior attacks attempt to extend VLM output sequences by optimizing…

Cryptography and Security · Computer Science 2025-08-27 Rui Zhang , Zihan Wang , Tianli Yang , Hongwei Li , Wenbo Jiang , Qingchuan Zhao , Yang Liu , Guowen Xu

Automated red-teaming has become a crucial approach for uncovering vulnerabilities in large language models (LLMs). However, most existing methods focus on isolated safety flaws, limiting their ability to adapt to dynamic defenses and…

Cryptography and Security · Computer Science 2025-01-06 Yanjiang Liu , Shuhen Zhou , Yaojie Lu , Huijia Zhu , Weiqiang Wang , Hongyu Lin , Ben He , Xianpei Han , Le Sun

Large language models (LLMs) have demonstrated impressive capabilities in code generation by leveraging retrieval-augmented generation (RAG) methods. However, the computational costs associated with LLM inference, particularly in terms of…

Software Engineering · Computer Science 2026-02-03 Yanlin Wang , Jiadong Wu , Tianyue Jiang , Mingwei Liu , Jiachi Chen , Chong Wang , Ensheng Shi , Xilin Liu , Yuchi Ma , Zibin Zheng

Recent work has proposed automated red-teaming methods for testing the vulnerabilities of a given target large language model (LLM). These methods use red-teaming LLMs to uncover inputs that induce harmful behavior in a target LLM. In this…

Machine Learning · Computer Science 2025-01-15 Jonathan Nöther , Adish Singla , Goran Radanović
‹ Prev 1 2 3 10 Next ›