English
Related papers

Related papers: Exploring the Boundaries of Content Moderation in …

200 papers

Social media platforms have been establishing content moderation guidelines and employing various moderation policies to counter hate speech and misinformation. The goal of this paper is to study these community guidelines and moderation…

Computers and Society · Computer Science 2023-08-10 Mohit Singhal , Chen Ling , Pujan Paudel , Poojitha Thota , Nihal Kumarswamy , Gianluca Stringhini , Shirin Nilizadeh

Text-to-Image (T2I) generation is enabling new applications that support creators, designers, and general end users of productivity software by generating illustrative content with high photorealism starting from a given descriptive text as…

Computers and Society · Computer Science 2023-04-14 Ranjita Naik , Besmira Nushi

In recent years, text-to-image (T2I) generation models have made significant progress in generating high-quality images that align with text descriptions. However, these models also face the risk of unsafe generation, potentially producing…

Cryptography and Security · Computer Science 2025-04-16 Huming Qiu , Guanxu Chen , Mi Zhang , Xiaohan Zhang , Xiaoyu You , Min Yang

Text-to-Image (T2I) models have demonstrated impressive capabilities in generating high-quality and diverse visual content from natural language prompts. However, uncontrolled reproduction of sensitive, copyrighted, or harmful imagery poses…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yiwei Xie , Ping Liu , Zheng Zhang

Text-to-Image (T2I) generative models have revolutionized content creation, yet they inherently risk amplifying societal biases. While sociological research provides systematic classifications of bias, existing T2I benchmarks largely…

Computers and Society · Computer Science 2026-04-15 Hanjun Luo , Zhimu Huang , Haoyu Huang , Ziye Deng , Ruizhe Chen , Xinfeng Li , Zuozhu Liu , Hanan Salam

AI systems crucially rely on human ratings, but these ratings are often aggregated, obscuring the inherent diversity of perspectives in real-world phenomenon. This is particularly concerning when evaluating the safety of generative AI,…

Text-guided image manipulation with diffusion models enables flexible and precise editing based on prompts, but raises ethical and copyright concerns due to potential unauthorized modifications. To address this, we propose SecureT2I, a…

Cryptography and Security · Computer Science 2025-07-08 Xiaodong Wu , Xiangman Li , Qi Li , Jianbing Ni , Rongxing Lu

Our research investigates the impact of Generative Artificial Intelligence (GAI) models, specifically text-to-image generators (T2Is), on the representation of non-Western cultures, with a focus on Indian contexts. Despite the…

Computers and Society · Computer Science 2024-08-06 Sourojit Ghosh , Pranav Narayanan Venkit , Sanjana Gautam , Shomir Wilson , Aylin Caliskan

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian

Diffusion models have recently achieved remarkable advancements in terms of image quality and fidelity to textual prompts. Concurrently, the safety of such generative models has become an area of growing concern. This work introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Tong Liu , Zhixin Lai , Jiawen Wang , Gengyuan Zhang , Shuo Chen , Philip Torr , Vera Demberg , Volker Tresp , Jindong Gu

Content moderation is the process of flagging content based on pre-defined platform rules. There has been a growing need for AI moderators to safeguard users as well as protect the mental health of human moderators from traumatic content.…

Computation and Language · Computer Science 2023-02-21 Meng Ye , Karan Sikka , Katherine Atwell , Sabit Hassan , Ajay Divakaran , Malihe Alikhani

Generative artificial intelligence (AI) is a widely popular technology that will have a profound impact on society and individuals. Less than a decade ago, it was thought that creative work would be among the last to be automated - yet…

Human-Computer Interaction · Computer Science 2023-08-21 Jonas Oppenlaender , Johanna Silvennoinen , Ville Paananen , Aku Visuri

Generative AI is an emerging technology that will have a profound impact on society and individuals. Only a decade ago, it was thought that creative work would be among the last to be automated - yet today, we see AI encroaching on creative…

Human-Computer Interaction · Computer Science 2023-05-03 Jonas Oppenlaender , Aku Visuri , Ville Paananen , Rhema Linder , Johanna Silvennoinen

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Text-to-image (T2I) models, such as Stable Diffusion, have exhibited remarkable performance in generating high-quality images from text descriptions in recent years. However, text-to-image models may be tricked into generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xinfeng Li , Yuchen Yang , Jiangyi Deng , Chen Yan , Yanjiao Chen , Xiaoyu Ji , Wenyuan Xu

With the increasing use of image generation technology, understanding its social biases, including gender bias, is essential. This paper presents a large-scale study on gender bias in text-to-image (T2I) models, focusing on everyday…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Leander Girrbach , Stephan Alaniz , Genevieve Smith , Zeynep Akata

The widespread dissemination of hate speech, harassment, harmful and sexual content, and violence across websites and media platforms presents substantial challenges and provokes widespread concern among different sectors of society.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Nouar AlDahoul , Myles Joshua Toledo Tan , Harishwar Reddy Kasireddy , Yasir Zaki

Text-to-image (T2I) models are increasingly popular, producing a large share of AI-generated images online. To compare model quality, voting-based leaderboards have become the standard, relying on anonymized model outputs for fairness. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Ali Naseh , Yuefeng Peng , Anshuman Suri , Harsh Chaudhari , Alina Oprea , Amir Houmansadr

Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field of Artificial Intelligence Generative Content (AIGC).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xincheng Shuai , Henghui Ding , Xingjun Ma , Rongcheng Tu , Yu-Gang Jiang , Dacheng Tao

Bias in text-to-image (T2I) models can propagate unfair social representations and may be used to aggressively market ideas or push controversial agendas. Existing T2I model bias evaluation methods only focus on social biases. We look…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian