English
Related papers

Related papers: TwoHamsters: Benchmarking Multi-Concept Compositio…

200 papers

Recent advances in Text-to-3D (T23D) generative models have enabled the synthesis of diverse, high-fidelity 3D assets from textual prompts. However, existing challenges restrict the development of reliable T23D quality assessment (T23DQA).…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Bingyang Cui , Yujie Zhang , Qi Yang , Zhu Li , Yiling Xu

Multimodal Large Language Models (MLLMs) have enabled transformative advancements across diverse applications but remain susceptible to safety threats, especially jailbreak attacks that induce harmful outputs. To systematically evaluate and…

Text-to-image diffusion models (T2I DMs) have achieved remarkable success in generating high-quality and diverse images from text prompts, yet recent studies have revealed their vulnerability to backdoor attacks. Existing attack methods…

Cryptography and Security · Computer Science 2025-08-05 Haoran Dai , Jiawen Wang , Ruo Yang , Manali Sharma , Zhonghao Liao , Yuan Hong , Binghui Wang

Decompositional jailbreaks pose a critical threat to large language models (LLMs) by allowing adversaries to fragment a malicious objective into a sequence of individually benign queries that collectively reconstruct prohibited content. In…

Cryptography and Security · Computer Science 2026-05-01 Bowen Sun , Chaozhuo Li , Yaodong Yang , Yiwei Wang , Chaowei Xiao

Jailbreak attacks can circumvent model safety guardrails and reveal critical blind spots. Prior attacks on text-to-video (T2V) models typically add adversarial perturbations to obviously unsafe prompts, which are often easy to detect and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zonghao Ying , Moyang Chen , Nizhang Li , Zhiqiang Wang , Wenxin Zhang , Quanchen Zou , Zonglei Jing , Aishan Liu , Xianglong Liu

This paper addresses the critical challenge of deriving interpretable confidence scores from generative language models (LLMs) when applied to multi-label content safety classification. While models like LLaMA Guard are effective for…

Computation and Language · Computer Science 2025-12-01 Anjaneya Praharaj , Jaykumar Kasundra

The deployment of multimodal large language models (MLLMs) has brought forth a unique vulnerability: susceptibility to malicious attacks through visual inputs. This paper investigates the novel challenge of defending MLLMs against such…

Cryptography and Security · Computer Science 2024-06-18 Renjie Pi , Tianyang Han , Jianshu Zhang , Yueqi Xie , Rui Pan , Qing Lian , Hanze Dong , Jipeng Zhang , Tong Zhang

As foundation models become more sophisticated, ensuring their trustworthiness becomes increasingly critical; yet, unlike text and image, the video modality still lacks comprehensive trustworthiness benchmarks. We introduce VMDT…

Text-to-image (T2I) models can generate not-safe-for-work (NSFW) content, motivating multi-stage safety pipelines with both text and image filters. Newer LLM-based filters detect latent intent beyond keywords, making token-level…

Machine Learning · Computer Science 2026-05-26 Zixuan Chen , Hao Lin , Ke Xu , Xinghao Jiang , Tanfeng Sun

Multi-modal Large Language Models (MLLMs) have emerged as a powerful paradigm for integrating visual and textual information, supporting a wide range of multi-modal tasks. However, these models often suffer from hallucination, producing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Zhiyuan Chen , Yuecong Min , Jie Zhang , Bei Yan , Jiahao Wang , Xiaozhen Wang , Shiguang Shan

Text-to-image (T2I) models are capable of generating visually impressive images, yet they often fail to accurately capture specific attributes in user prompts, such as the correct number of objects with the specified colors. The diversity…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kevin David Hayes , Micah Goldblum , Vikash Sehwag , Gowthami Somepalli , Ashwinee Panda , Tom Goldstein

Multimodal contrastive learning (MCL) has shown remarkable advances in zero-shot classification by learning from millions of image-caption pairs crawled from the Internet. However, this reliance poses privacy risks, as hackers may…

Multimedia · Computer Science 2024-07-29 Xinwei Liu , Xiaojun Jia , Yuan Xun , Siyuan Liang , Xiaochun Cao

Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities that increasingly influence various aspects of our daily lives, constantly defining the new boundary of Artificial General Intelligence (AGI). Image modalities,…

Cryptography and Security · Computer Science 2024-08-13 Yihe Fan , Yuxin Cao , Ziyu Zhao , Ziyao Liu , Shaofeng Li

Multimodal Large Language Models (MLLMs) have expanded the capabilities of traditional language models by enabling interaction through both text and images. However, ensuring the safety of these models remains a significant challenge,…

Computation and Language · Computer Science 2025-06-04 Wenxuan Wang , Xiaoyuan Liu , Kuiyi Gao , Jen-tse Huang , Youliang Yuan , Pinjia He , Shuai Wang , Zhaopeng Tu

In recent years, fueled by the rapid advancement of diffusion models, text-to-video (T2V) generation models have achieved remarkable progress, with notable examples including Pika, Luma, Kling, and Open-Sora. Although these models exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Jiayang Liu , Siyuan Liang , Shiqian Zhao , Rongcheng Tu , Wenbo Zhou , Aishan Liu , Dacheng Tao , Siew Kei Lam

While text-to-image (T2I) generation models have achieved remarkable progress in recent years, existing evaluation methodologies for vision-language alignment still struggle with the fine-grained semantic matching. Current approaches based…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Zijian Zhang , Xuhui Zheng , Xuecheng Wu , Chong Peng , Xuezhi Cao

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

Safety evaluation and red-teaming of large language models remain predominantly text-centric, and existing frameworks lack the infrastructure to systematically test whether alignment generalizes to audio, image, and video inputs. We present…

Machine Learning · Computer Science 2026-03-04 Zhongxi Wang , Yueqian Lin , Jingyang Zhang , Hai Helen Li , Yiran Chen

Despite the rapid advances in Text-to-Image (T2I) generation models, their evaluation remains challenging in domains like fashion, involving complex compositional generation. Recent automated T2I evaluation methods leverage pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Ziyue Liu , Federico Girella , Yiming Wang , Davide Talon

Modern text-to-image (T2I) models can now render legible, paragraph-length text, enabling a fundamentally new class of misuse. We identify and formalize the inscriptive jailbreak, where an adversary coerces a T2I system into generating…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Zonghao Ying , Haowen Dai , Lianyu Hu , Zonglei Jing , Quanchen Zou , Yaodong Yang , Aishan Liu , Xianglong Liu