English
Related papers

Related papers: GMP: A Benchmark for Content Moderation under Co-o…

200 papers

Interest in the concept of AI-driven harmful manipulation is growing, yet current approaches to evaluating it are limited. This paper introduces a framework for evaluating harmful AI manipulation via context-specific human-AI interaction…

The proliferation of harmful content on online platforms is a major societal problem, which comes in many different forms including hate speech, offensive language, bullying and harassment, misinformation, spam, violence, graphic content,…

AI sycophancy has become a prominent concern in large language model (LLM) research. Yet the term lacks a consistent definition and has been applied to behaviors ranging from agreeing with a user's false claim to excessively praising the…

Artificial Intelligence · Computer Science 2026-05-22 Meryl Ye , Lujain Ibrahim , Jessica Y. Bo , Myra Cheng , Ida Mattsson , Daniel Vennemeyer , Robert Kraut , Steve Rathje

Recent advances in Large Language Models (LLMs) have enabled multi-agent systems that simulate real-world interactions with near-human reasoning. While previous studies have extensively examined biases related to protected attributes such…

Artificial Intelligence · Computer Science 2025-06-03 Min Choi , Keonwoo Kim , Sungwon Chae , Sangyeob Baek

Generative Machine Learning models have become central to modern systems, powering applications in creative writing, summarization, multi-hop reasoning, and context-aware dialogue. These models underpin large-scale AI assistants, workflow…

Machine Learning · Computer Science 2025-08-08 Arthur Cho

AI alignment considers how we can encode AI systems in a way that is compatible with human values. The normative side of this problem asks what moral values or principles, if any, we should encode in AI. To this end, we present a framework…

Computers and Society · Computer Science 2023-01-11 Betty Li Hou , Brian Patrick Green

The detection of sensitive content in large datasets is crucial for ensuring that shared and analysed data is free from harmful material. However, current moderation tools, such as external APIs, suffer from limitations in customisation,…

Computation and Language · Computer Science 2025-06-25 Dimosthenis Antypas , Indira Sen , Carla Perez-Almendros , Jose Camacho-Collados , Francesco Barbieri

With peak content moderation seemingly behind us, this paper revisits its punitive side. But instead of focusing on who is being (disproportionately) moderated, it focuses on the punishment itself and explores the question of how content…

Computers and Society · Computer Science 2026-05-14 Robert Grimm

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

This work contributes to the field of Machine Ethics (ME) benchmarking, which develops tests to assess whether intelligent systems accurately represent human values and act accordingly. We identify three major issues with current ME…

Computers and Society · Computer Science 2024-11-11 Kira Sam , Raja Vavekanand

The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have…

Computation and Language · Computer Science 2025-06-12 Matthieu Dubois , François Yvon , Pablo Piantanida

The introduction of artificial intelligence (AI) agents into human group settings raises essential questions about how these novel participants influence cooperative social norms. While previous studies on human-AI cooperation have…

Artificial Intelligence · Computer Science 2026-01-30 Nico Mutzner , Taha Yasseri , Heiko Rauhut

Language models deployed in high-stakes professional settings face conflicting demands from users, institutional authorities, and professional norms. How models act when these demands conflict reveals a principal hierarchy -- an implicit…

Artificial Intelligence · Computer Science 2026-05-13 Fangyi Yu , Nabeel Seedat , Jonathan Richard Schwarz , Andrew M. Bean

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden…

Conversational moderation of online communities is crucial to maintaining civility for a constructive environment, but it is challenging to scale and harmful to moderators. The inclusion of sophisticated natural language generation modules…

Computation and Language · Computer Science 2024-05-07 Hyundong Cho , Shuai Liu , Taiwei Shi , Darpan Jain , Basem Rizk , Yuyang Huang , Zixun Lu , Nuan Wen , Jonathan Gratch , Emilio Ferrara , Jonathan May

Many automated labeling pipelines classify inputs into categories defined by a written specification, content moderation being a prominent use case. Simple category definitions are not detailed enough for labelers to produce the accurate,…

Computation and Language · Computer Science 2026-05-26 Konstantin Berlin , Adam Swanda

Large language models (LLMs) are increasingly being used for emotional support. They are also being developed for formal therapy purposes. However, LLMs like ChaptGPT or Llama are often developed with content moderation guardrails that…

Human-Computer Interaction · Computer Science 2026-05-26 Jiwon Kim , Claire Wang , Taeung Yoon , Sabelle Huang , Koustuv Saha

The rapid adoption of AI across diverse domains has led to the development of organisational guidelines that vary significantly, even within the same sector. This paper examines AI policies in two domains, news organisations and…

Computers and Society · Computer Science 2025-03-11 Lucie-Aimée Kaffee , Pepa Atanasova , Anna Rogers

Now that AI-driven moderation has become pervasive in everyday life, we often hear claims that "the AI is biased". While this is often said jokingly, the light-hearted remark reflects a deeper concern. How can we be certain that an online…

Computation and Language · Computer Science 2026-04-02 Subhojit Ghimire

The equitable assessment of individual contribution in teams remains a persistent challenge, where conflict and disparity in workload can result in unfair performance evaluation, often requiring manual intervention - a costly and…

Artificial Intelligence · Computer Science 2026-05-27 Jakub Slapek , Mir Seyedebrahimi , Jianhua Yang