中文
相关论文

相关论文: Predictive Biases in Natural Language Processing M…

200 篇论文

Recent breakthroughs in Natural Language Processing (NLP) have been driven by language models trained on a massive amount of plain text. While powerful, deriving supervision from textual resources is still an open question. For example,…

计算与语言 · 计算机科学 2022-07-22 Mingda Chen

The emergence of large-scale pretrained language models has posed unprecedented challenges in deriving explanations of why the model has made some predictions. Stemmed from the compositional nature of languages, spurious correlations have…

计算与语言 · 计算机科学 2023-05-04 Ruochen Zhao , Shafiq Joty , Yongjie Wang , Tan Wang

Natural Language Processing (NLP) is a key technique for developing Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of…

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

计算与语言 · 计算机科学 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

计算与语言 · 计算机科学 2025-03-11 Suvendu Mohanty

Language modeling studies the probability distributions over strings of texts. It is one of the most fundamental tasks in natural language processing (NLP). It has been widely used in text generation, speech recognition, machine…

计算与语言 · 计算机科学 2024-07-18 Chengwei Wei , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Building explainable systems is a critical problem in the field of Natural Language Processing (NLP), since most machine learning models provide no explanations for the predictions. Existing approaches for explainable machine learning…

计算与语言 · 计算机科学 2019-06-12 Hui Liu , Qingyu Yin , William Yang Wang

Much of the world's population experiences some form of disability during their lifetime. Caution must be exercised while designing natural language processing (NLP) systems to prevent systems from inadvertently perpetuating ableist bias…

计算与语言 · 计算机科学 2021-10-04 Saad Hassan , Matt Huenerfauth , Cecilia Ovesdotter Alm

Debiasing language models from unwanted behaviors in Natural Language Understanding tasks is a topic with rapidly increasing interest in the NLP community. Spurious statistical correlations in the data allow models to perform shortcuts and…

计算与语言 · 计算机科学 2022-12-06 Johannes Mario Meissner , Saku Sugawara , Akiko Aizawa

Understanding the importance of the inputs on the output is useful across many tasks. This work provides an information-theoretic framework to analyse the influence of inputs for text classification tasks. Natural language processing (NLP)…

计算与语言 · 计算机科学 2024-02-05 Luran Wang , Mark Gales , Vatsal Raina

Annotator disagreement is widespread in NLP, particularly for subjective and ambiguous tasks such as toxicity detection and stance analysis. While early approaches treated disagreement as noise to be removed, recent work increasingly models…

计算与语言 · 计算机科学 2026-01-21 Yinuo Xu , David Jurgens

The widespread application of pre-trained language models (PLMs) in natural language processing (NLP) has led to increasing concerns about their explainability. Selective rationalization is a self-explanatory framework that selects…

计算与语言 · 计算机科学 2025-01-07 Libing Yuan , Shuaibo Hu , Kui Yu , Le Wu

Predictive processing has become an influential framework in cognitive sciences. This framework turns the traditional view of perception upside down, claiming that the main flow of information processing is realized in a top-down…

机器人学 · 计算机科学 2021-01-25 Alejandra Ciria , Guido Schillaci , Giovanni Pezzulo , Verena V. Hafner , Bruno Lara

Discriminatory gender biases have been found in Pre-trained Language Models (PLMs) for multiple languages. In Natural Language Inference (NLI), existing bias evaluation methods have focused on the prediction results of one specific label…

计算与语言 · 计算机科学 2024-05-21 Panatchakorn Anantaprayoon , Masahiro Kaneko , Naoaki Okazaki

Hate speech detection is a common downstream application of natural language processing (NLP) in the real world. In spite of the increasing accuracy, current data-driven approaches could easily learn biases from the imbalanced data…

计算与语言 · 计算机科学 2022-09-22 Yi Cai , Arthur Zimek , Gerhard Wunder , Eirini Ntoutsi

Language data and models demonstrate various types of bias, be it ethnic, religious, gender, or socioeconomic. AI/NLP models, when trained on the racially biased dataset, AI/NLP models instigate poor model explainability, influence user…

计算与语言 · 计算机科学 2022-11-28 Kinshuk Sengupta , Praveen Ranjan Srivastava

Our work focuses on the biases that emerge in the natural language generation (NLG) task of sentence completion. In this paper, we introduce a framework of fairness for NLG followed by an evaluation of gender biases in two state-of-the-art…

计算与语言 · 计算机科学 2020-08-05 Catherine Yeo , Alyssa Chen

State-of-the-art natural language processing (NLP) models often learn to model dataset biases and surface form correlations instead of features that target the intended underlying task. Previous work has demonstrated effective methods to…

计算与语言 · 计算机科学 2020-12-03 Victor Sanh , Thomas Wolf , Yonatan Belinkov , Alexander M. Rush

Legal judgment prediction (LJP) applies Natural Language Processing (NLP) techniques to predict judgment results based on fact descriptions automatically. Recently, large-scale public datasets and advances in NLP research have led to…

计算与语言 · 计算机科学 2022-04-12 Junyun Cui , Xiaoyu Shen , Feiping Nie , Zheng Wang , Jinglong Wang , Yulong Chen

Large language models (LLMs) have demonstrated impressive capabilities in various tasks using the in-context learning (ICL) paradigm. However, their effectiveness is often compromised by inherent bias, leading to prompt brittleness, i.e.,…

计算与语言 · 计算机科学 2024-12-13 Hanzhang Zhou , Zijian Feng , Zixiao Zhu , Junlang Qian , Kezhi Mao