English
Related papers

Related papers: A Bayesian approach to uncertainty in word embeddi…

200 papers

Compared with word embedding based on point representation, distribution-based word embedding shows more flexibility in expressing uncertainty and therefore embeds richer semantic information when representing words. The Wasserstein…

Computation and Language · Computer Science 2018-09-05 Chi Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

Contextualized word embeddings have been replacing standard embeddings as the representational knowledge source of choice in NLP systems. Since a variety of biases have previously been found in standard word embeddings, it is crucial to…

Computation and Language · Computer Science 2020-10-29 Marion Bartl , Malvina Nissim , Albert Gatt

We investigate the problem of reliably assessing group fairness when labeled examples are few but unlabeled examples are plentiful. We propose a general Bayesian framework that can augment labeled data with unlabeled data to produce more…

Machine Learning · Statistics 2020-10-21 Disi Ji , Padhraic Smyth , Mark Steyvers

Bayesian hierarchical models are well-suited to analyzing the often noisy data from electroencephalography experiments in cognitive neuroscience: these models provide an intuitive framework to account for structures and correlations in the…

Quantitative Methods · Quantitative Biology 2022-08-17 Davide Turco , Conor Houghton

Datasets in engineering applications are often limited and contaminated, mainly due to unavoidable measurement noise and signal distortion. Thus, using conventional data-driven approaches to build a reliable discriminative model, and…

Machine Learning · Statistics 2020-04-14 Xihaier Luo , Ahsan Kareem

In the field of modeling, the word validation refers to simple comparisons between model outputs and experimental data. Usually, this comparison constitutes plotting the model results against data on the same axes to provide a visual…

Applications · Statistics 2021-06-11 Farid Mohammadi

Static word embeddings are ubiquitous in computational social science applications and contribute to practical decision-making in a variety of fields including law and healthcare. However, assessing the statistical uncertainty in downstream…

Computation and Language · Computer Science 2024-06-19 Andrea Vallebueno , Cassandra Handan-Nader , Christopher D. Manning , Daniel E. Ho

Recent research in Natural Language Processing has revealed that word embeddings can encode social biases present in the training data which can affect minorities in real world applications. This paper explores the gender bias implicit in…

Computation and Language · Computer Science 2020-11-05 Rodrigo Alejandro Chávez Mulsa , Gerasimos Spanakis

We explore the notion of uncertainty in the context of modern abstractive summarization models, using the tools of Bayesian Deep Learning. Our approach approximates Bayesian inference by first extending state-of-the-art summarization models…

Computation and Language · Computer Science 2022-05-04 Alexios Gidiotis , Grigorios Tsoumakas

It is often of interest to combine available estimates of a similar quantity from multiple data sources. When the corresponding variances of each estimate are also available, a model should take into account the uncertainty of the estimates…

Methodology · Statistics 2021-09-17 Yujing Yao , R. Todd Ogden , Chubing Zeng , Qixuan Chen

Text corpora are widely used resources for measuring societal biases and stereotypes. The common approach to measuring such biases using a corpus is by calculating the similarities between the embedding vector of a word (like nurse) and the…

Computation and Language · Computer Science 2021-04-28 Navid Rekabsaz , Robert West , James Henderson , Allan Hanbury

With the increased interest in machine learning and big data problems, the need for large amounts of labelled data has also grown. However, it is often infeasible to get experts to label all of this data, which leads many practitioners to…

Machine Learning · Computer Science 2021-05-31 Pierce Burke , Richard Klein

The paper presents a novel approach for unsupervised techniques in the field of clustering. A new method is proposed to enhance existing literature models using the proper Bayesian bootstrap to improve results in terms of robustness and…

Machine Learning · Statistics 2024-09-16 Federico Maria Quetti , Silvia Figini , Elena ballante

Social scientists have recently turned to analyzing text using tools from natural language processing like word embeddings to measure concepts like ideology, bias, and affinity. However, word embeddings are difficult to use in the…

Computation and Language · Computer Science 2019-04-04 Adam M. Lauretig

It has been shown that word embeddings can exhibit gender bias, and various methods have been proposed to quantify this. However, the extent to which the methods are capturing social stereotypes inherited from the data has been debated.…

Computation and Language · Computer Science 2020-10-29 Haiyang Zhang , Alison Sneyd , Mark Stevenson

Counterfactual explanations utilize feature perturbations to analyze the outcome of an original decision and recommend an actionable recourse. We argue that it is beneficial to provide several alternative explanations rather than a single…

Machine Learning · Computer Science 2023-01-24 Natraj Raman , Daniele Magazzeni , Sameena Shah

Word embedding methods (WEMs) are extensively used for representing text data. The dimensionality of these embeddings varies across various tasks and implementations. The effect of dimensionality change on the accuracy of the downstream…

Computation and Language · Computer Science 2024-01-01 Rohit Raj Rai , Amit Awekar

Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using…

Computation and Language · Computer Science 2019-11-27 Sunipa Dev , Tao Li , Jeff Phillips , Vivek Srikumar

Word embeddings are often criticized for capturing undesirable word associations such as gender stereotypes. However, methods for measuring and removing such biases remain poorly understood. We show that for any embedding model that…

Computation and Language · Computer Science 2019-08-20 Kawin Ethayarajh , David Duvenaud , Graeme Hirst

Word embeddings trained on large corpora have shown to encode high levels of unfair discriminatory gender, racial, religious and ethnic biases. In contrast, human-written dictionaries describe the meanings of words in a concise, objective…

Computation and Language · Computer Science 2021-01-26 Masahiro Kaneko , Danushka Bollegala