English
Related papers

Related papers: A Bayesian approach to uncertainty in word embeddi…

200 papers

The project BIAS: Mitigating Diversity Biases of AI in the Labor Market is a four-year project funded by the European commission and supported by the Swiss State Secretariat for Education, Research and Innovation (SERI). As part of the…

Computation and Language · Computer Science 2024-07-29 Alexandre Puttick , Leander Rankwiler , Catherine Ikae , Mascha Kurpicz-Briki

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

By representing words with probability densities rather than point vectors, probabilistic word embeddings can capture rich and interpretable semantic information and uncertainty. The uncertainty information can be particularly meaningful in…

Computation and Language · Computer Science 2018-04-30 Ben Athiwaratkun , Andrew Gordon Wilson

Counterfactual analysis is intuitively performed by humans on a daily basis eg. "What should I have done differently to get the loan approved?". Such counterfactual questions also steer the formulation of scientific hypotheses. More…

Machine Learning · Computer Science 2023-09-18 Juliane Weilbach , Sebastian Gerwinn , Melih Kandemir , Martin Fraenzle

With the starting point that implicit human biases are reflected in the statistical regularities of language, it is possible to measure biases in English static word embeddings. State-of-the-art neural language models generate dynamic word…

Computers and Society · Computer Science 2021-05-20 Wei Guo , Aylin Caliskan

The standard approach to Bayesian inference is based on the assumption that the distribution of the data belongs to the chosen model class. However, even a small violation of this assumption can have a large impact on the outcome of a…

Methodology · Statistics 2015-06-22 Jeffrey W. Miller , David B. Dunson

Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new…

Computation and Language · Computer Science 2019-06-05 Yusu Qian , Urwa Muaz , Ben Zhang , Jae Won Hyun

Word embedding, which converts words into numerical values, is an important natural language processing technique and widely used. One of the serious problems of word embedding is that the bias will be learned and affect the model if the…

Human-Computer Interaction · Computer Science 2025-06-04 Arisa Sugino , Takayuki Itoh

Contextual word embeddings such as BERT have achieved state of the art performance in numerous NLP tasks. Since they are optimized to capture the statistical properties of training data, they tend to pick up on and amplify social…

Computation and Language · Computer Science 2019-06-19 Keita Kurita , Nidhi Vyas , Ayush Pareek , Alan W Black , Yulia Tsvetkov

Uncertainty quantification in image retrieval is crucial for downstream decisions, yet it remains a challenging and largely unexplored problem. Current methods for estimating uncertainties are poorly calibrated, computationally expensive,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Frederik Warburg , Martin Jørgensen , Javier Civera , Søren Hauberg

Confidence estimation can improve the reliability of melody estimation by indicating which predictions are likely incorrect. The existing classification-based approach provides confidence for predicted pitch classes but fails to capture the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-07 Kavya Ranjan Saxena , Vipul Arora

Real-world data contains aleatoric uncertainty - irreducible noise arising from imperfect measurements or from incomplete knowledge about the data generation process. Mean-variance estimation networks can learn this type of uncertainty but…

Machine Learning · Computer Science 2026-05-29 Jiaxiang Yi , Miguel A. Bessa

We combine Bayesian prediction and weighted inference as a unified approach to survey inference. The general principles of Bayesian analysis imply that models for survey outcomes should be conditional on all variables that affect the…

Methodology · Statistics 2020-06-24 Yajuan Si , Rob Trangucci , Jonah Sol Gabry , Andrew Gelman

Subjective bias detection is critical for applications like propaganda detection, content recommendation, sentiment analysis, and bias neutralization. This bias is introduced in natural language via inflammatory words and phrases, casting…

Computation and Language · Computer Science 2020-06-16 Tanvi Dadu , Kartikey Pant , Radhika Mamidi

Comparing competing mathematical models of complex natural processes is a shared goal among many branches of science. The Bayesian probabilistic framework offers a principled way to perform model comparison and extract useful metrics for…

Knowledge bases often consist of facts which are harvested from a variety of sources, many of which are noisy and some of which conflict, resulting in a level of uncertainty for each triple. Knowledge bases are also often incomplete,…

Artificial Intelligence · Computer Science 2021-04-13 Xuelu Chen , Michael Boratko , Muhao Chen , Shib Sankar Dasgupta , Xiang Lorraine Li , Andrew McCallum

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

Online texts -- across genres, registers, domains, and styles -- are riddled with human stereotypes, expressed in overt or subtle ways. Word embeddings, trained on these texts, perpetuate and amplify these stereotypes, and propagate biases…

Computation and Language · Computer Science 2019-07-03 Thomas Manzini , Yao Chong Lim , Yulia Tsvetkov , Alan W Black

A rising topic in computational journalism is how to enhance the diversity in news served to subscribers to foster exploration behavior in news reading. Despite the success of preference learning in personalized news recommendation, their…

Machine Learning · Statistics 2017-07-03 Rikiya Takahashi , Shunan Zhang

Standard Bayesian inference is known to be sensitive to model misspecification, leading to unreliable uncertainty quantification and poor predictive performance. However, finding generally applicable and computationally feasible methods for…

Methodology · Statistics 2020-07-31 Jonathan H. Huggins , Jeffrey W. Miller
‹ Prev 1 4 5 6 7 8 10 Next ›