English
Related papers

Related papers: Personalized Safety Alignment for Text-to-Image Di…

200 papers

This paper introduces PersonaAI, a cutting-edge application that leverages Retrieval-Augmented Generation (RAG) and the LLAMA model to create highly personalized digital avatars capable of accurately mimicking individual personalities.…

Human-Computer Interaction · Computer Science 2025-03-21 Elvis Kimara , Kunle S. Oguntoye , Jian Sun

Text-to-image generative models have made remarkable progress in producing high-quality visual content from textual descriptions, yet concerns remain about how they represent social groups. While characteristics like gender and race have…

Computation and Language · Computer Science 2026-03-03 Yang Tian , Yu Fan , Liudmila Zavolokina , Sarah Ebling

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jiyoon Myung , Jihyeon Park

Sparse attention reduces the quadratic complexity of full self-attention but faces two challenges: (1) an attention gap, where applying sparse attention to full-attention-trained models causes performance degradation due to train-inference…

Computation and Language · Computer Science 2026-02-02 Zhenyi Shen , Junru Lu , Lin Gui , Jiazheng Li , Yulan He , Di Yin , Xing Sun

Vision-language-action models (VLAs) show potential as generalist robot policies. However, these models pose extreme safety challenges during real-world deployment, including the risk of harm to the environment, the robot itself, and…

Robotics · Computer Science 2026-04-21 Borong Zhang , Yuhao Zhang , Jiaming Ji , Yingshan Lei , Yishuai Cai , Josef Dai , Yuanpei Chen , Yaodong Yang

End-to-end autonomous driving systems excel in common scenarios but struggle with safety-critical long-tail cases. Vision-Language-Action (VLA) models are promising due to their strong reasoning capabilities. However, most VLA-based…

Robotics · Computer Science 2026-05-20 Kefei Tian , Yuansheng Lian , Kai Yang , Xiangdong Chen , Shen Li

Modern ultra-high-resolution image synthesis relies heavily on the robust generative capacity of large-scale pre-trained Latent Diffusion Models (LDMs). While recent representation alignment methods have proven effective by distilling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jinjin Zhang , Xiefan Guo , Di Huang

Modern generative models are usually designed to match target distributions directly in the data space, where the intrinsic dimension of data can be much lower than the ambient dimension. We argue that this discrepancy may contribute to the…

Machine Learning · Computer Science 2020-07-02 Zijun Zhang , Ruixiang Zhang , Zongpeng Li , Yoshua Bengio , Liam Paull

Personalized image generation via text prompts has great potential to improve daily life and professional work by facilitating the creation of customized visual content. The aim of image personalization is to create images based on a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mingxiao Li , Tingyu Qu , Tinne Tuytelaars , Marie-Francine Moens

Text-to-image (T2I) generative models have achieved remarkable visual fidelity, yet remain vulnerable to generating unsafe content. Existing safety defenses typically intervene internally within the generative model, but suffer from severe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xiangtao Meng , Yingkai Dong , Ning Yu , Li Wang , Zheng Li , Shanqing Guo

Text-to-image (T2I) diffusion models are widely used in image editing due to their powerful generative capabilities. However, achieving fine-grained control over specific object attributes, such as color and material, remains a considerable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xingxi Yin , Jingfeng Zhang , Yue Deng , Zhi Li , Yicheng Li , Yin Zhang

The emerging technologies for large scale data analysis raise new challenges to the security and privacy of sensitive user data. In this work we investigate the problem of private statistical analysis of time-series data in the distributed…

Cryptography and Security · Computer Science 2017-12-05 Filipp Valovich , Francesco Aldà

Text-to-image diffusion models are pushing the boundaries of what generative AI can achieve in our lives. Beyond their ability to generate general images, new personalization techniques have been proposed to customize the pre-trained base…

Computers and Society · Computer Science 2024-10-15 Boheng Li , Yanhao Wei , Yankai Fu , Zhenting Wang , Yiming Li , Jie Zhang , Run Wang , Tianwei Zhang

Recent advances in Diffusion Models have enabled the generation of images from text, with powerful closed-source models like DALL-E and Midjourney leading the way. However, open-source alternatives, such as StabilityAI's Stable Diffusion,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Massine El Khader , Elias Al Bouzidi , Abdellah Oumida , Mohammed Sbaihi , Eliott Binard , Jean-Philippe Poli , Wassila Ouerdane , Boussad Addad , Katarzyna Kapusta

Traditional safety-critical control methods, such as control barrier functions, suffer from semantic blindness, exhibiting the same behavior around obstacles regardless of contextual significance. This limitation leads to the uniform…

The need for large amounts of training and validation data is a huge concern in scaling AI algorithms for autonomous driving. Semantic Image Synthesis (SIS), or label-to-image translation, promises to address this issue by translating…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 George Eskandar , Diandian Guo , Karim Guirguis , Bin Yang

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

Companies increasingly expose machine learning (ML) models trained over sensitive user data to untrusted domains, such as end-user devices and wide-access model stores. We present Sage, a differentially private (DP) ML platform that bounds…

Machine Learning · Statistics 2019-09-10 Mathias Lecuyer , Riley Spahn , Kiran Vodrahalli , Roxana Geambasu , Daniel Hsu

Sleep is vital for health, yet access to data alone does not guarantee improvement. While wearables and health apps enable tracking, users face a "Data-Action Gap," struggling to interpret metrics and translate them into action. Current…

Human-Computer Interaction · Computer Science 2026-04-21 Hansoo Lee , Yoonjae Cho , Sonya S. Kwak , Rafael A. Calvo