中文
相关论文

相关论文: Handling Bias in Toxic Speech Detection: A Survey

200 篇论文

The rapid growth of social media in recent years has fed into some highly undesirable phenomena such as proliferation of abusive and offensive language on the Internet. Previous research suggests that such hateful content tends to come from…

计算与语言 · 计算机科学 2019-02-19 Pushkar Mishra , Marco Del Tredici , Helen Yannakoudakis , Ekaterina Shutova

With the widespread use of toxic language online, platforms are increasingly using automated systems that leverage advances in natural language processing to automatically flag and remove toxic comments. However, most automated systems --…

User posts whose perceived toxicity depends on the conversational context are rare in current toxicity detection datasets. Hence, toxicity detectors trained on existing datasets will also tend to disregard context, making the detection of…

计算与语言 · 计算机科学 2021-11-22 Alexandros Xenos , John Pavlopoulos , Ion Androutsopoulos , Lucas Dixon , Jeffrey Sorensen , Leo Laugier

The rapid adoption of LLMs in both research and industry highlights the challenges of deploying them safely and reveals a gap in the systematic evaluation of toxicity benchmarks. As organizations increasingly rely on these benchmarks to…

人工智能 · 计算机科学 2026-05-12 Regina Gugg , Selina Niederländer , Andreas Stöckl , Martin Flechl

Collecting annotations from human raters often results in a trade-off between the quantity of labels one wishes to gather and the quality of these labels. As such, it is often only possible to gather a small amount of high-quality labels.…

机器学习 · 计算机科学 2021-10-05 Neel Nanda , Jonathan Uesato , Sven Gowal

While in real life everyone behaves themselves at least to some extent, it is much more difficult to expect people to behave themselves on the internet, because there are few checks or consequences for posting something toxic to others.…

计算与语言 · 计算机科学 2021-12-14 Kehan Wang , Jiaxi Yang , Hongjun Wu

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

计算与语言 · 计算机科学 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

The prevalence of online hate and abuse is a pressing global concern. While tackling such societal harms is a priority for research across the social sciences, it is a difficult task, in part because of the magnitude of the problem. User…

计算机与社会 · 计算机科学 2025-10-08 Florence E. Enock , Helen Z. Margetts , Jonathan Bright

An independent ethical assessment of an artificial intelligence system is an impartial examination of the system's development, deployment, and use in alignment with ethical values. System-level qualitative frameworks that describe…

计算机与社会 · 计算机科学 2021-08-18 Amitoj Singh , Jingshu Chen , Lihao Zhang , Amin Rasekh , Ilana Golbin , Anand Rao

Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering,…

人工智能 · 计算机科学 2024-03-27 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

Debiasing methods that seek to mitigate the tendency of Language Models (LMs) to occasionally output toxic or inappropriate text have recently gained traction. In this paper, we propose a standardized protocol which distinguishes methods…

计算与语言 · 计算机科学 2023-05-24 Robert Morabito , Jad Kabbara , Ali Emami

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

计算与语言 · 计算机科学 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

Technological advancements have resulted in an exponential increase in the use of online social networks (OSNs) worldwide. While online social networks provide a great communication medium, they also increase the user's exposure to…

计算机与社会 · 计算机科学 2024-01-09 Sylvia W Azumah , Nelly Elsayed , Zag ElSayed , Murat Ozer

Abuse on the Internet is an important societal problem of our time. Millions of Internet users face harassment, racism, personal attacks, and other types of abuse across various platforms. The psychological effects of abuse on individuals…

计算与语言 · 计算机科学 2021-04-15 Pushkar Mishra , Helen Yannakoudakis , Ekaterina Shutova

With the ever-increasing cases of hate spread on social media platforms, it is critical to design abuse detection mechanisms to proactively avoid and control such incidents. While there exist methods for hate speech detection, they…

计算与语言 · 计算机科学 2020-01-17 Pinkesh Badjatiya , Manish Gupta , Vasudeva Varma

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Recent advances in text mining and natural language processing technology have enabled researchers to detect an authors identity or demographic characteristics, such as age and gender, in several text genres by automatically analysing the…

密码学与安全 · 计算机科学 2022-11-30 Claudia Peersman , Matthew Edwards , Emma Williams , Awais Rashid

Technology for language generation has advanced rapidly, spurred by advancements in pre-training large models on massive amounts of data and the need for intelligent agents to communicate in a natural manner. While techniques can…

计算与语言 · 计算机科学 2021-06-24 Emily Sheng , Kai-Wei Chang , Premkumar Natarajan , Nanyun Peng

The societal issue of digital hostility has previously attracted a lot of attention. The topic counts an ample body of literature, yet remains prominent and challenging as ever due to its subjective nature. We posit that a better…

计算与语言 · 计算机科学 2021-09-17 Antigoni-Maria Founta , Lucia Specia

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

机器学习 · 计算机科学 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates