English
Related papers

Related papers: Safety and Fairness for Content Moderation in Gene…

200 papers

The rapid growth of generative AI has introduced new challenges in content moderation and digital forensics. In particular, benign AI-generated images can be paired with harmful or misleading text, creating difficult-to-detect misuse. This…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xinlei Guan , David Arosemena , Tejaswi Dhandu , Kuan Huang , Meng Xu , Miles Q. Li , Bingyu Shen , Ruiyang Qin , Umamaheswara Rao Tida , Boyang Li

Generative models must ensure both privacy and fairness for Trustworthy AI. While these goals have been pursued separately, recent studies propose to combine existing privacy and fairness techniques to achieve both goals. However, naively…

Machine Learning · Computer Science 2025-03-03 Soyeon Kim , Yuji Roh , Geon Heo , Steven Euijong Whang

Social media platforms have been establishing content moderation guidelines and employing various moderation policies to counter hate speech and misinformation. The goal of this paper is to study these community guidelines and moderation…

Computers and Society · Computer Science 2023-08-10 Mohit Singhal , Chen Ling , Pujan Paudel , Poojitha Thota , Nihal Kumarswamy , Gianluca Stringhini , Shirin Nilizadeh

Visual Generative AI models have demonstrated remarkable capability in generating high-quality images from user inputs like text prompts. However, because these models have billions of parameters, they risk memorizing certain parts of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Lena Reissinger , Yuanyuan Li , Anna-Carolina Haensch , Neeraj Sarna

This study addresses the challenge that generative models struggle to balance flexibility, stability, and controllability in complex interactive scenarios. It proposes a controllable generation framework for dynamic interactive content…

Human-Computer Interaction · Computer Science 2026-02-27 Rui Liu

Responding to the rapid roll-out and large-scale commercialization of foundation models, large language models, and generative AI, an emerging body of work is shedding light on the myriad impacts these technologies are having across…

Content is created for a well-defined purpose, often described by a metric or signal represented in the form of structured information. The relationship between the goal (metrics) of target content and the content itself is non-trivial.…

Computation and Language · Computer Science 2022-03-29 Navita Goyal , Roodram Paneri , Ayush Agarwal , Udit Kalani , Abhilasha Sancheti , Niyati Chhaya

Generative models unfairly penalize data belonging to minority classes, suffer from model autophagy disorder (MADness), and learn biased estimates of the underlying distribution parameters. Our theoretical and empirical results show that…

Machine Learning · Computer Science 2024-10-07 Paul Mayer , Lorenzo Luzi , Ali Siahkoohi , Don H. Johnson , Richard G. Baraniuk

Generative models have achieved impressive results in text to image tasks, significantly advancing visual content creation. However, this progress comes at a cost, as such models rely heavily on large-scale training data and may…

Machine Learning · Computer Science 2025-09-03 Zhipeng Yin , Zichong Wang , Avash Palikhe , Zhen Liu , Jun Liu , Wenbin Zhang

Conversational moderation of online communities is crucial to maintaining civility for a constructive environment, but it is challenging to scale and harmful to moderators. The inclusion of sophisticated natural language generation modules…

Computation and Language · Computer Science 2024-05-07 Hyundong Cho , Shuai Liu , Taiwei Shi , Darpan Jain , Basem Rizk , Yuyang Huang , Zixun Lu , Nuan Wen , Jonathan Gratch , Emilio Ferrara , Jonathan May

Text-to-image (T2I) models have rapidly advanced, enabling the generation of high-quality images from text prompts across various domains. However, these models present notable safety concerns, including the risk of generating harmful,…

Computation and Language · Computer Science 2025-07-28 Lijun Li , Zhelun Shi , Xuhao Hu , Bowen Dong , Yiran Qin , Xihui Liu , Lu Sheng , Jing Shao

Creativity in artificial intelligence is most often addressed through evaluative frameworks that aim to measure novelty, diversity, or usefulness in generated outputs. While such approaches have provided valuable insights into the behavior…

Artificial Intelligence · Computer Science 2026-01-14 Corina Chutaux

As generative models become ubiquitous, there is a critical need for fine-grained control over the generation process. Yet, while controlled generation methods from prompting to fine-tuning proliferate, a fundamental question remains…

Artificial Intelligence · Computer Science 2026-01-12 Emily Cheng , Carmen Amo Alonso , Federico Danieli , Arno Blaas , Luca Zappella , Pau Rodriguez , Xavier Suau

In this paper, we examine computational approaches for measuring the "fairness" of image tagging systems, finding that they cluster into five distinct categories, each with its own analytic foundation. We also identify a range of normative…

Computers and Society · Computer Science 2023-05-04 Jared Katzman , Angelina Wang , Morgan Scheuerman , Su Lin Blodgett , Kristen Laird , Hanna Wallach , Solon Barocas

Generative AI is frequently portrayed as revolutionary or even apocalyptic, prompting calls for novel regulatory approaches. This essay argues that such views are misguided. Instead, generative AI should be understood as an evolutionary…

Computers and Society · Computer Science 2025-03-11 Gilad Abiri

Text-to-image (T2I) generative models are increasingly used to produce content for education, media, and public-facing communication, and are starting to be integrated into higher-impact pipelines. Since generated images tend to reinforce…

Computers and Society · Computer Science 2026-05-14 Jose Luna , Yankun Wu , Xiaofei Xie , Noa Garcia

Content moderation typically combines the efforts of human moderators and machine learning models. However, these systems often rely on data where significant disagreement occurs during moderation, reflecting the subjective nature of…

Computation and Language · Computer Science 2025-09-01 Guillermo Villate-Castillo , Javier Del Ser , Borja Sanz

Text-to-image generation methods produce high-resolution and high-quality images, but these methods should not produce immoral images that may contain inappropriate content from the perspective of commonsense morality. In this paper, we aim…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Seongbeom Park , Suhong Moon , Jinkyu Kim

Growing awareness of the environmental impact of digital technologies has led to several isolated initiatives to promote sustainable practices. However, despite these efforts, the environmental footprint of generative AI, particularly in…

Computers and Society · Computer Science 2024-02-06 Thomas Le Goff

Generative AI is an emerging technology that will have a profound impact on society and individuals. Only a decade ago, it was thought that creative work would be among the last to be automated - yet today, we see AI encroaching on creative…

Human-Computer Interaction · Computer Science 2023-05-03 Jonas Oppenlaender , Aku Visuri , Ville Paananen , Rhema Linder , Johanna Silvennoinen