English
Related papers

Related papers: The Violation State: Safety State Persistence in a…

200 papers

AI models are increasingly required to be multimodal, integrating disparate input streams into a coherent state representation on which subsequent behaviors and actions can be based. This paper seeks to understand how such models behave…

Computation and Language · Computer Science 2025-07-03 Tianze Hua , Tian Yun , Ellie Pavlick

ChatGPT is attracting a cross-field interest as it provides a language interface with remarkable conversational competency and reasoning capabilities across many domains. However, since ChatGPT is trained with languages, it is currently not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Chenfei Wu , Shengming Yin , Weizhen Qi , Xiaodong Wang , Zecheng Tang , Nan Duan

Generative models have enabled easy creation and generation of images of all kinds given a single prompt. However, this has also raised ethical concerns about what is an actual piece of content created by humans or cameras compared to…

Cryptography and Security · Computer Science 2024-12-31 Aryaman Shaan , Garvit Banga , Raghav Mantri

Modern web applications combine persistent state updates, concurrent interactions, and unreliable communication with external services. Failures such as timeouts can occur after partial state changes, producing temporary inconsistencies…

Programming Languages · Computer Science 2026-04-09 Richard Casetta , Nils Gesbert , Pierre Genevès

Recent advancement in large-scale Artificial Intelligence (AI) models offering multimodal services have become foundational in AI systems, making them prime targets for model theft. Existing methods select Out-of-Distribution (OoD) data as…

Cryptography and Security · Computer Science 2025-05-01 Jianbo Gao , Keke Gai , Jing Yu , Liehuang Zhu , Qi Wu

Invisible watermarking for autoregressive (AR) image generation has recently gained attention as a means of protecting image ownership and tracing AI-generated content. However, existing approaches suffer from three key limitations: (1)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yigit Yilmaz , Elena Petrova , Mehmet Kaya , Lucia Rossi , Amir Rahman

Generative AI systems increasingly expose powerful reasoning and image refinement capabilities through user-facing chatbot interfaces. In this work, we show that the na\"ive exposure of such capabilities fundamentally undermines modern…

Cryptography and Security · Computer Science 2026-03-12 Sunpill Kim , Chanwoo Hwang , Minsu Kim , Jae Hong Seo

Deep learning techniques have implemented many unconditional image generation (UIG) models, such as GAN, Diffusion model, etc. The extremely realistic images (also known as AI-Generated Content, AIGC for short) produced by these models…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Ruinan Ma , Yu-an Tan , Shangbo Wu , Tian Chen , Yajie Wang , Yuanzhang Li

Generative Artificial Intelligence (Gen-AI) models are increasingly used to produce content across domains, including text, images, and audio. While these models represent a major technical breakthrough, they gain their generative…

Machine Learning · Computer Science 2024-12-13 Pascal Epple , Igor Shilov , Bozhidar Stevanoski , Yves-Alexandre de Montjoye

The new capabilities of generative artificial intelligence tools Generative AI, such as ChatGPT, allow users to interact with the system in intuitive ways, such as simple conversations, and receive (mostly) good-quality answers. These…

Human-Computer Interaction · Computer Science 2024-10-14 Matin Amoozadeh , Daye Nam , Daniel Prol , Ali Alfageeh , James Prather , Michael Hilton , Sruti Srinivasa Ragavan , Mohammad Amin Alipour

The evolution of generative AI systems exposes the challenges of traditional legal and ethical frameworks built around consent. This chapter examines how the conventional notion of consent, while fundamental to data protection and privacy…

Computers and Society · Computer Science 2025-07-03 Giada Pistilli , Bruna Trevelin

Visual Generative AI models have demonstrated remarkable capability in generating high-quality images from user inputs like text prompts. However, because these models have billions of parameters, they risk memorizing certain parts of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Lena Reissinger , Yuanyuan Li , Anna-Carolina Haensch , Neeraj Sarna

Recognizing speaking in humans is a central task towards understanding social interactions. Ideally, speaking would be detected from individual voice recordings, as done previously for meeting scenarios. However, individual voice recordings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jose Vargas Quiros , Chirag Raman , Stephanie Tan , Ekin Gedik , Laura Cabrera-Quiros , Hayley Hung

People increasingly hold sustained, open-ended conversations with large language models (LLMs). Public reports and early studies suggest that, in such settings, models can reinforce delusional or conspiratorial ideation or even amplify…

Human-Computer Interaction · Computer Science 2026-04-09 Peter Kirgis , Ben Hawriluk , Sherrie Feng , Aslan Bilimer , Sam Paech , Zeynep Tufekci

Recently, it has been found that frontier AI models can resist their own shutdown, a behavior known as self-preservation. We extend this concept to the behavior of resisting the shutdown of other models, which we call "peer-preservation."…

Computation and Language · Computer Science 2026-04-23 Yujin Potter , Nicholas Crispino , Vincent Siu , Chenguang Wang , Dawn Song

Generative text-to-image models are typically trained on large-scale web-scraped datasets that include diverse visual content such as copyrighted and stylistically distinctive artworks, raising concerns about ownership, attribution, and the…

Machine Learning · Computer Science 2026-05-19 Ninad Joshi , Ashutosh Ranjan , Vivek Srivastava , Shirish Karande

Automated content moderation has long been used to help identify and filter undesired user-generated content online. But such systems have a history of incorrectly flagging content by and about marginalized identities for removal.…

Computation and Language · Computer Science 2025-07-25 Grace Proebsting , Oghenefejiro Isaacs Anigboro , Charlie M. Crawford , Danaé Metaxa , Sorelle A. Friedler

Following the initial excitement, Text-to-Image (TTI) models are now being examined more critically. While much of the discourse has focused on biases and stereotypes embedded in large-scale training datasets, the sociotechnical dynamics of…

Human-Computer Interaction · Computer Science 2025-04-22 Maria-Teresa De Rosa Palmini , Eva Cetinic

As generative artificial intelligence technologies like Stable Diffusion advance, visual content becomes more vulnerable to misuse, raising concerns about copyright infringement. Visual watermarks serve as effective protection mechanisms,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Junxian Duan , Jiyang Guan , Wenkui Yang , Ran He

The proliferation of generative AI systems creates unprecedented opportunities for content creation while raising critical concerns about controllability, copyright infringement, and content provenance. Current generative models operate as…

Cryptography and Security · Computer Science 2026-01-13 Haris Khan , Sadia Asif , Shumaila Asif