中文
相关论文

相关论文: Critical Perspectives: A Benchmark Revealing Pitfa…

200 篇论文

Social media platforms provide an environment where people can freely engage in discussions. Unfortunately, they also enable several problems, such as online harassment. Recently, Google and Jigsaw started a project called Perspective,…

机器学习 · 计算机科学 2017-02-28 Hossein Hosseini , Sreeram Kannan , Baosen Zhang , Radha Poovendran

The ability to quantify incivility online, in news and in congressional debates, is of great interest to political scientists. Computational tools for detecting online incivility for English are now fairly accessible and potentially could…

计算与语言 · 计算机科学 2021-02-09 Anushree Hede , Oshin Agarwal , Linda Lu , Diana C. Mutz , Ani Nenkova

On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area.…

计算与语言 · 计算机科学 2022-02-24 Alyssa Lees , Vinh Q. Tran , Yi Tay , Jeffrey Sorensen , Jai Gupta , Donald Metzler , Lucy Vasserman

The Perspective API, a popular text toxicity assessment service by Google and Jigsaw, has found wide adoption in several application areas, notably content moderation, monitoring, and social media research. We examine its potentials and…

计算与语言 · 计算机科学 2023-10-10 Helena Mihaljević , Elisabeth Steffen

In this work, we demonstrate how existing classifiers for identifying toxic comments online fail to generalize to the diverse concerns of Internet users. We survey 17,280 participants to understand how user expectations for what constitutes…

社会与信息网络 · 计算机科学 2021-06-09 Deepak Kumar , Patrick Gage Kelley , Sunny Consolvo , Joshua Mason , Elie Bursztein , Zakir Durumeric , Kurt Thomas , Michael Bailey

Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic,…

Detecting toxic language including sexism, harassment and abusive behaviour, remains a critical challenge, particularly in its subtle and context-dependent forms. Existing approaches largely focus on isolated message-level classification,…

Social network platforms are generally used to share positive, constructive, and insightful content. However, in recent times, people often get exposed to objectionable content like threat, identity attacks, hate speech, insults, obscene…

计算与语言 · 计算机科学 2021-05-31 Sreyan Ghosh , Sonal Kumar

The censorship of toxic comments is often left to the judgment of imperfect models. Perspective API, a creation of Google technology incubator Jigsaw, is perhaps the most widely used toxicity classifier in industry; the model is employed by…

计算机与社会 · 计算机科学 2020-07-01 Elizabeth Reichert , Helen Qiu , Jasmine Bayrooti

The proliferation of online hate speech has necessitated the creation of algorithms which can detect toxicity. Most of the past research focuses on this detection as a classification task, but assigning an absolute toxicity label is often…

计算与语言 · 计算机科学 2022-06-28 Millon Madhur Das , Punyajoy Saha , Mithun Das

The spectacular expansion of the Internet has led to the development of a new research problem in the field of natural language processing: automatic toxic comment detection, since many countries prohibit hate speech in public media. There…

机器学习 · 计算机科学 2020-09-18 Ashwin Geet D'Sa , Irina Illina , Dominique Fohr

Due to the subtleness, implicity, and different possible interpretations perceived by different people, detecting undesirable content from text is a nuanced difficulty. It is a long-known risk that language models (LMs), once trained on…

计算与语言 · 计算机科学 2022-05-26 Yau-Shian Wang , Yingshan Chang

Background: The existence of toxic conversations in open-source platforms can degrade relationships among software developers and may negatively impact software product quality. To help mitigate this, some initial work has been done to…

软件工程 · 计算机科学 2023-07-10 Jaydeb Saker , Sayma Sultana , Steven R. Wilson , Amiangshu Bosu

To identify and classify toxic online commentary, the modern tools of data science transform raw text into key features from which either thresholding or learning algorithms can make predictions for monitoring offensive conversations. We…

机器学习 · 计算机科学 2018-10-05 David Noever

The rise of cyberbullying in social media platforms involving toxic comments has escalated the need for effective ways to monitor and moderate online interactions. Existing solutions of automated toxicity detection systems, are based on a…

人工智能 · 计算机科学 2026-02-11 Michail S. Alexiou , J. Sukarno Mertoguno

Toxicity detection has become core safety infrastructure for online moderation, dataset filtering, and deployed language-model systems. Yet most detectors still treat toxicity as an intrinsic property of isolated text. This position paper…

机器学习 · 计算机科学 2026-05-13 Sergei Berezin , Reza Farahbakhsh , Noel Crespi

Peer review is crucial for advancing and improving science through constructive criticism. However, toxic feedback can discourage authors and hinder scientific progress. This work explores an important but underexplored area: detecting…

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

社会与信息网络 · 计算机科学 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

The closure of Perspective API at the end of 2026 discards what has functioned as the de facto standard for automated toxicity measurement in NLP, CSS, and LLM evaluation research. We document the structural dependence that the communities…

Proprietary public APIs play a crucial and growing role as research tools among social scientists. Among such APIs, Google's machine learning-based Perspective API is extensively utilized for assessing the toxicity of social media messages,…

社会与信息网络 · 计算机科学 2024-07-18 Gianluca Nogara , Francesco Pierri , Stefano Cresci , Luca Luceri , Petter Törnberg , Silvia Giordano
‹ 上一页 1 2 3 10 下一页 ›