中文
相关论文

相关论文: Physical Prompt Injection Attacks on Large Vision-…

200 篇论文

The rapid development of large language models (LLMs) gives rise to ethical concerns about their performance, while opening new avenues for developing toxic language detection techniques. However, LLMs' unethical output and their capability…

计算与语言 · 计算机科学 2025-08-22 Xi Chen , Shuo Wang

Large language models (LLMs) achieve strong performance across many tasks but remain vulnerable to hallucinations, motivating the need for realistic adversarial prompts that elicit such failures. We formulate hallucination elicitation as a…

Natural language interfaces to structured databases are becoming increasingly common, largely due to advances in large language models (LLMs) that enable users to query data using conversational input rather than formal query languages such…

Non-intrusive load monitoring (NILM) aims to disaggregate total electricity consumption into individual appliance usage, thus enabling more effective energy management. While deep learning has advanced NILM, it remains limited by its…

机器学习 · 计算机科学 2025-08-05 Junyu Xue , Xudong Wang , Xiaoling He , Shicheng Liu , Yi Wang , Guoming Tang

LLM-based chatbot agents increasingly process user requests by combining natural-language reasoning with external tools such as web browsing. These capabilities improve usability, but they also create attack surfaces when untrusted external…

密码学与安全 · 计算机科学 2026-05-19 Hongjang Yang , Hyunsik Na , Daeseon Choi

The generalization capabilities of Large Language Models (LLMs) have led to their widespread deployment across various applications. However, this increased adoption has introduced several security threats, notably in the forms of…

密码学与安全 · 计算机科学 2025-08-04 Francesco Panebianco , Stefano Bonfanti , Francesco Trovò , Michele Carminati

Inspired by the superior language abilities of large language models (LLM), large vision-language models (LVLM) have been recently explored by integrating powerful LLMs for improving the performance on complex multimodal tasks. Despite the…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Yifan Li , Yifan Du , Kun Zhou , Jinpeng Wang , Wayne Xin Zhao , Ji-Rong Wen

Membership inference attacks (MIAs) have been extensively studied in large language models (LLMs) and vision-language models (VLMs), yet their implications for vision-language-action (VLA) models remain largely unexplored. VLA models differ…

密码学与安全 · 计算机科学 2026-05-11 Yuefeng Peng , Mingzhe Li , Kejing Xia , Renhao Zhang , Amir Houmansadr

The recent trend in the Large Vision and Language model has brought a new change in how information extraction systems are built. VLMs have set a new benchmark with their State-of-the-art techniques in understanding documents and building…

计算机视觉与模式识别 · 计算机科学 2024-08-08 Dipankar Medhi

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing tasks across various domains without needing explicit retraining. This capability, known as In-Context Learning (ICL), while impressive, exposes LLMs to a…

计算与语言 · 计算机科学 2024-10-16 Bibek Upadhayay , Vahid Behzadan , Amin Karbasi

Large language model-powered sequential recommender systems (LLM-SRSs) have recently demonstrated remarkable performance, enabling recommendations through prompt-driven inference over user interaction sequences. However, this paradigm also…

信息检索 · 计算机科学 2026-04-28 Yuchuan Zhao , Tong Chen , Junliang Yu , Zongwei Wang , Lizhen Cui , Hongzhi Yin

Large language models (LLMs) have demonstrated impressive performance and have come to dominate the field of natural language processing (NLP) across various tasks. However, due to their strong instruction-following capabilities and…

密码学与安全 · 计算机科学 2026-04-10 Yulin Chen , Haoran Li , Yuan Sui , Yue Liu , Yufei He , Xiaoling Bai , Chi Fei , Yabo Li , Haozhe Ma , Yangqiu Song , Bryan Hooi

Vision-Large-Language-models(VLMs) have great application prospects in autonomous driving. Despite the ability of VLMs to comprehend and make decisions in complex scenarios, their integration into safety-critical autonomous driving systems…

密码学与安全 · 计算机科学 2024-04-23 Zhenyang Ni , Rui Ye , Yuxi Wei , Zhen Xiang , Yanfeng Wang , Siheng Chen

Web agents powered by vision-language models (VLMs) enable autonomous interaction with web environments by perceiving and acting on both visual and textual webpage content to accomplish user-specified tasks. However, they are highly…

密码学与安全 · 计算机科学 2026-04-15 Yulin Chen , Tri Cao , Haoran Li , Yue Liu , Yibo Li , Yufei He , Le Minh Khoi , Yangqiu Song , Shuicheng Yan , Bryan Hooi

Transformer-based large language models (LLMs) provide a powerful foundation for natural language tasks in large-scale customer-facing applications. However, studies that explore their vulnerabilities emerging from malicious user…

计算与语言 · 计算机科学 2022-11-18 Fábio Perez , Ian Ribeiro

While Large Language Models (LLMs) are increasingly being used in real-world applications, they remain vulnerable to prompt injection attacks: malicious third party prompts that subvert the intent of the system designer. To help researchers…

Multimodal large language models (MLLMs) enable powerful cross-modal reasoning capabilities. However, the expanded input space introduces new attack surfaces. Previous jailbreak attacks often inject malicious instructions from text into…

机器学习 · 计算机科学 2025-05-23 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as prompts, to enhance…

人工智能 · 计算机科学 2025-03-18 Pranab Sahoo , Ayush Kumar Singh , Sriparna Saha , Vinija Jain , Samrat Mondal , Aman Chadha

Large Language Models (LLMs) deployed in enterprise settings (e.g., as Microsoft 365 Copilot) face novel security challenges. One critical threat is prompt inference attacks: adversaries chain together seemingly benign prompts to gradually…

密码学与安全 · 计算机科学 2025-07-22 Andrii Balashov , Olena Ponomarova , Xiaohua Zhai

When large language model (LLM) systems interact with external data to perform complex tasks, a new attack, namely prompt injection, becomes a significant threat. By injecting instructions into the data accessed by the system, the attacker…

密码学与安全 · 计算机科学 2025-08-26 Sizhe Chen , Yizhu Wang , Nicholas Carlini , Chawin Sitawarin , David Wagner