中文
相关论文

相关论文: Like trainer, like bot? Inheritance of bias in alg…

200 篇论文

Harmful content detection models tend to have higher false positive rates for content from marginalized groups. In the context of marginal abuse modeling on Twitter, such disproportionate penalization poses the risk of reduced visibility,…

计算与语言 · 计算机科学 2022-10-13 Kyra Yee , Alice Schoenauer Sebag , Olivia Redfield , Emily Sheng , Matthias Eck , Luca Belli

With surge in online platforms, there has been an upsurge in the user engagement on these platforms via comments and reactions. A large portion of such textual comments are abusive, rude and offensive to the audience. With machine learning…

计算与语言 · 计算机科学 2021-08-17 Ayush Kumar , Pratik Kumar

The abstract outlines the problem of toxic comments on social media platforms, where individuals use disrespectful, abusive, and unreasonable language that can drive users away from discussions. This behavior is referred to as anti-social…

机器学习 · 计算机科学 2023-04-17 K. Poojitha , A. Sai Charish , M. Arun Kuamr Reddy , S. Ayyasamy

Lack of moderation in online communities enables participants to incur in personal aggression, harassment or cyberbullying, issues that have been accentuated by extremist radicalisation in the contemporary post-truth politics scenario. This…

计算与语言 · 计算机科学 2018-01-08 Nestor Rodriguez , Sergio Rojas-Galeano

Large technology firms face the problem of moderating content on their online platforms for compliance with laws and policies. To accomplish this at the scale of billions of pieces of content per day, a combination of human and machine…

应用统计 · 统计学 2023-06-14 Xuan Yang , Andrew J Smart , Daniel Theron

Growing amount of comments make online discussions difficult to moderate by human moderators only. Antisocial behavior is a common occurrence that often discourages other users from participating in discussion. We propose a neural network…

计算与语言 · 计算机科学 2018-09-20 Andrej Švec , Matúš Pikuliak , Marián Šimko , Mária Bieliková

Now that AI-driven moderation has become pervasive in everyday life, we often hear claims that "the AI is biased". While this is often said jokingly, the light-hearted remark reflects a deeper concern. How can we be certain that an online…

计算与语言 · 计算机科学 2026-04-02 Subhojit Ghimire

The volume of machine-generated content online has grown dramatically due to the widespread use of Large Language Models (LLMs), leading to new challenges for content moderation systems. Conventional content moderation classifiers, which…

计算与语言 · 计算机科学 2026-05-26 Shaz Furniturewala , Arkaitz Zubiaga

To address the widespread problem of uncivil behavior, many online discussion platforms employ human moderators to take action against objectionable content, such as removing it or placing sanctions on its authors. This reactive paradigm of…

计算机与社会 · 计算机科学 2022-12-01 Charlotte Schluger , Jonathan P. Chang , Cristian Danescu-Niculescu-Mizil , Karen Levy

Toxicity detection algorithms, originally designed with reactive content moderation in mind, are increasingly being deployed into proactive end-user interventions to moderate content. Through a socio-technical lens and focusing on contexts…

人机交互 · 计算机科学 2025-02-25 Mark Warner , Angelika Strohmayer , Matthew Higgs , Lynne Coventry

Content moderation and toxicity classification represent critical tasks with significant social implications. However, studies have shown that major classification models exhibit tendencies to magnify or reduce biases and potentially…

We present a holistic approach to building a robust and useful natural language classification system for real-world content moderation. The success of such a system relies on a chain of carefully designed and executed steps, including the…

计算与语言 · 计算机科学 2023-02-16 Todor Markov , Chong Zhang , Sandhini Agarwal , Tyna Eloundou , Teddy Lee , Steven Adler , Angela Jiang , Lilian Weng

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

人工智能 · 计算机科学 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

Personalization is pervasive in the online space as it leads to higher efficiency and revenue by allowing the most relevant content to be served to each user. However, recent studies suggest that personalization methods can propagate…

机器学习 · 计算机科学 2018-02-26 L. Elisa Celis , Sayash Kapoor , Farnood Salehi , Nisheeth K. Vishnoi

Cyberbullying is a pervasive problem in online communities. To identify cyberbullying cases in large-scale social networks, content moderators depend on machine learning classifiers for automatic cyberbullying detection. However, existing…

社会与信息网络 · 计算机科学 2020-04-07 Caleb Ziems , Ymir Vigfusson , Fred Morstatter

What are the limits of automated Twitter sentiment classification? We analyze a large set of manually labeled tweets in different languages, use them as training data, and construct automated classification models. It turns out that the…

计算与语言 · 计算机科学 2021-08-31 Igor Mozetic , Miha Grcar , Jasmina Smailovic

Social bias in language - towards genders, ethnicities, ages, and other social groups - poses a problem with ethical impact for many NLP applications. Recent research has shown that machine learning models trained on respective data may not…

计算与语言 · 计算机科学 2020-11-25 Maximilian Spliethöver , Henning Wachsmuth

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

机器学习 · 计算机科学 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee

We investigate opinion dynamics and information spreading on networks under the influence of content filtering technologies. The filtering mechanism, present in many online social platforms, reduces individuals' exposure to disagreeing…

物理与社会 · 物理学 2024-01-26 Antonio F. Peralta , János Kertész , Gerardo Iñiguez

The popularity of social media platforms such as Twitter has led to the proliferation of automated bots, creating both opportunities and challenges in information dissemination, user engagements, and quality of services. Past works on…

社会与信息网络 · 计算机科学 2018-05-14 Richard Jayadi Oentaryo , Arinto Murdopo , Philips Kokoh Prasetyo , Ee-Peng Lim