中文
相关论文

相关论文: STaR-Attack: A Spatio-Temporal and Narrative Reaso…

200 篇论文

Diffusion Language Models (DLMs) provide a promising alternative to autoregressive language models by generating text through iterative denoising and bidirectional refinement. However, this iterative generation paradigm also introduces…

计算与语言 · 计算机科学 2026-05-14 Yejin Lee , Yo-Sub Han

Multimodal large language models (MLLMs) have revolutionized vision-language understanding but remain vulnerable to multimodal jailbreak attacks, where adversarial inputs are meticulously crafted to elicit harmful or inappropriate…

计算与语言 · 计算机科学 2025-02-03 Sejoon Oh , Yiqiao Jin , Megha Sharma , Donghyun Kim , Eric Ma , Gaurav Verma , Srijan Kumar

This paper introduces MetaDefense, a novel framework for defending against finetuning-based jailbreak attacks in large language models (LLMs). We observe that existing defense mechanisms fail to generalize to harmful queries disguised by…

机器学习 · 计算机科学 2025-10-10 Weisen Jiang , Sinno Jialin Pan

Autonomous agentic AI systems powered by vision-language models (VLMs) are rapidly advancing toward real-world deployment, yet their cross-modal reasoning capabilities introduce new attack surfaces for adversarial manipulation that exploit…

人工智能 · 计算机科学 2025-11-25 Hangoo Kang , Jehyeok Yeon , Gagandeep Singh

Large Language Models have shown impressive generative capabilities across diverse tasks, but their safety remains a critical concern. Existing post-training alignment methods, such as SFT and RLHF, reduce harmful outputs yet leave LLMs…

密码学与安全 · 计算机科学 2025-10-21 Zhengyue Zhao , Yingzi Ma , Somesh Jha , Marco Pavone , Patrick McDaniel , Chaowei Xiao

As Spoken Language Models (SLMs) integrate speech and text modalities, they inherit the safety vulnerabilities of their LLM backbone and an expanded attack surface. SLMs have been previously shown to be susceptible to jailbreaking, where…

机器学习 · 计算机科学 2026-03-20 Aravind Krishnan , Karolina Stańczak , Dietrich Klakow

Machine learning (ML) on graph-structured data has recently received deepened interest in the context of intrusion detection in the cybersecurity domain. Due to the increasing amounts of data generated by monitoring tools as well as more…

密码学与安全 · 计算机科学 2023-08-25 Anna Himmelhuber , Dominik Dold , Stephan Grimm , Sonja Zillner , Thomas Runkler

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to mitigate LLM hallucinations and enhance their performance in knowledge-intensive domains. However, these systems are vulnerable to adversarial poisoning…

信息检索 · 计算机科学 2025-07-29 Jinyan Su , Jin Peng Zhou , Zhengxin Zhang , Preslav Nakov , Claire Cardie

Current research on Multimodal Retrieval-Augmented Generation (MRAG) enables diverse multimodal inputs but remains limited to single-modality outputs, restricting expressive capacity and practical utility. In contrast, real-world…

信息检索 · 计算机科学 2025-08-11 Zhiyou Xiao , Qinhan Yu , Binghui Li , Geng Chen , Chong Chen , Wentao Zhang

Unified multimodal models are envisioned to bridge the gap between understanding and generation. Yet, to achieve competitive performance, state-of-the-art models adopt largely decoupled understanding and generation components. This design,…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Zeyu Liu , Zanlin Ni , Yang Yue , Cheng Da , Huan Yang , Di Zhang , Kun Gai , Gao Huang

Reasoning-augmented machine learning systems have shown improved performance in various domains, including image generation. However, existing reasoning-based methods for image generation either restrict reasoning to a single modality…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Yapeng Mi , Yanpeng Zhao , Hengli Li , Chenxi Li , Huimin Wu , Xiaojian Ma , Song-Chun Zhu , Ying Nian Wu , Qing Li

Large Language Models (LLMs) have been equipped with safety mechanisms to prevent harmful outputs, but these guardrails can often be bypassed through "jailbreak" prompts. This paper introduces a novel graph-based approach to systematically…

密码学与安全 · 计算机科学 2025-04-18 Sinan He , An Wang

Recent time series modeling faces a sharp divide between numerical generation and semantic understanding, with research showing that generation models often rely on superficial pattern matching, while understanding-oriented models struggle…

机器学习 · 计算机科学 2026-02-20 Tong Guan , Sheng Pan , Johan Barthelemy , Zhao Li , Yujun Cai , Cesare Alippi , Ming Jin , Shirui Pan

Safety alignment of Large Language Models (LLMs) can be compromised with manual jailbreak attacks and (automatic) adversarial attacks. Recent studies suggest that defending against these attacks is possible: adversarial attacks generate…

密码学与安全 · 计算机科学 2023-12-15 Sicheng Zhu , Ruiyi Zhang , Bang An , Gang Wu , Joe Barrow , Zichao Wang , Furong Huang , Ani Nenkova , Tong Sun

Multimodal Generative Models (MGMs) have rapidly evolved beyond text generation, now spanning diverse output modalities including images, music, video, human motion, and 3D objects, by integrating language with other sensory modalities…

多媒体 · 计算机科学 2025-11-25 Longzhen Han , Awes Mubarak , Almas Baimagambetov , Nikolaos Polatidis , Thar Baker

Recent multimodal large language models (MLLMs) still struggle with long document understanding due to two fundamental challenges: information interference from abundant irrelevant content, and the quadratic computational cost of…

计算与语言 · 计算机科学 2025-11-14 Yongxin Shi , Jiapeng Wang , Zeyu Shan , Dezhi Peng , Zening Lin , Lianwen Jin

Augmented Reality (AR) enriches human perception by overlaying virtual elements onto the physical world. However, this tight coupling between virtual and real content makes AR vulnerable to cognitive attacks: manipulations that distort…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Rongqian Chen , Allison Andreyev , Yanming Xiu , Joshua Chilukuri , Shunav Sen , Mahdi Imani , Bin Li , Maria Gorlatova , Gang Tan , Tian Lan

Unified multimodal models can encode visual understanding and image generation within a shared backbone, yet understanding does not automatically translate into control: models may infer objects, relations, or knowledge cues but fail to…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Fuxiang Zhai , Sixiang Chen , Yingjin Li , Shuaibo Li , Jianyu Lai , Tengjun Huang , Lei Zhu

Retrieval-augmented generation (RAG) systems can effectively mitigate the hallucination problem of large language models (LLMs),but they also possess inherent vulnerabilities. Identifying these weaknesses before the large-scale real-world…

信息检索 · 计算机科学 2025-05-23 Hongru Song , Yu-an Liu , Ruqing Zhang , Jiafeng Guo , Yixing Fan

Prompting large language models has enabled significant recent progress in multi-step reasoning over text. However, when applied to text generation from semi-structured data (e.g., graphs or tables), these methods typically suffer from low…

计算与语言 · 计算机科学 2022-12-19 Swarnadeep Saha , Xinyan Velocity Yu , Mohit Bansal , Ramakanth Pasunuru , Asli Celikyilmaz