English
Related papers

Related papers: A Bayesian approach to uncertainty in word embeddi…

200 papers

The counterfactual distribution models the effect of the treatment in the untreated group. While most of the work focuses on the expected values of the treatment effect, one may be interested in the whole counterfactual distribution or…

Machine Learning · Statistics 2022-11-04 Diego Martinez-Taboada , Dino Sejdinovic

Word embeddings have been shown to produce remarkable results in tackling a vast majority of NLP related tasks. Unfortunately, word embeddings also capture the stereotypical biases that are prevalent in society, affecting the predictive…

Computation and Language · Computer Science 2024-11-20 Navya Yarrabelly , Vinay Damodaran , Feng-Guang Su

Meta-analysis is widely used to integrate results from multiple experiments to obtain generalized insights. Since meta-analysis datasets are often heteroscedastic due to varying subgroups and temporal heterogeneity arising from experiments…

Methodology · Statistics 2026-01-19 Kohsuke Kubota , Shonosuke Sugasawa , Keiichi Ochiai , Takahiro Hoshino

Social biases are encoded in word embeddings. This presents a unique opportunity to study society historically and at scale, and a unique danger when embeddings are used in downstream applications. Here, we investigate the extent to which…

Computation and Language · Computer Science 2020-04-28 Kenneth Joseph , Jonathan H. Morgan

As machine learning algorithms are increasingly deployed for high-impact automated decision making, ethical and increasingly also legal standards demand that they treat all individuals fairly, without discrimination based on their age,…

Machine Learning · Computer Science 2021-05-03 Maarten Buyl , Tijl De Bie

An increasing awareness of biased patterns in natural language processing resources, like BERT, has motivated many metrics to quantify `bias' and `fairness'. But comparing the results of different metrics and the works that evaluate with…

Computation and Language · Computer Science 2021-12-15 Pieter Delobelle , Ewoenam Kwaku Tokpo , Toon Calders , Bettina Berendt

Majority of the text modelling techniques yield only point-estimates of document embeddings and lack in capturing the uncertainty of the estimates. These uncertainties give a notion of how well the embeddings represent a document. We…

Computation and Language · Computer Science 2020-08-03 Santosh Kesiraju , Oldřich Plchot , Lukáš Burget , Suryakanth V Gangashetty

Measurement error in multinomial data is a well-known and well-studied inferential problem that is encountered in many fields, including engineering, biomedical and omics research, ecology, finance, official statistics, and social sciences.…

Methodology · Statistics 2024-10-15 Matthew D. Koslovsky , Andee Kaplan , Victoria A. Terranova , Mevin B. Hooten

An important task for any large-scale organization is to prepare forecasts of key performance metrics. Often these organizations are structured in a hierarchical manner and for operational reasons, projections of these metrics may have been…

Applications · Statistics 2017-11-15 Julie Novak , Scott McGarvie , Beatriz Etchegaray Garcia

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias.…

Machine Learning · Computer Science 2019-06-11 Marc-Etienne Brunet , Colleen Alkalay-Houlihan , Ashton Anderson , Richard Zemel

We consider the problem of aggregating predictions or measurements from a set of human forecasters, models, sensors or other instruments which may be subject to bias or miscalibration and random heteroscedastic noise. We propose a Bayesian…

Statistical Finance · Quantitative Finance 2021-01-12 Chirag Nagpal , Robert E. Tillman , Prashant Reddy , Manuela Veloso

We propose a Bayesian generative model for incorporating prior domain knowledge into hierarchical topic modeling. Although embedded topic models (ETMs) and its variants have gained promising performance in text analysis, they mainly focus…

Computation and Language · Computer Science 2022-09-29 Dongsheng Wang , Yishi Xu , Miaoge Li , Zhibin Duan , Chaojie Wang , Bo Chen , Mingyuan Zhou

With the enourmous popularity of large language models, many researchers have raised ethical concerns regarding social biases incorporated in such models. Several methods to measure social bias have been introduced, but apparently these…

Computation and Language · Computer Science 2024-09-13 Sarah Schröder , Alexander Schulz , Barbara Hammer

Boosting methods are widely used in statistical learning to deal with high-dimensional data due to their variable selection feature. However, those methods lack straightforward ways to construct estimators for the precision of the…

Methodology · Statistics 2021-06-10 Boyao Zhang , Colin Griesbach , Cora Kim , Nadia Müller-Voggel , Elisabeth Bergherr

Inferring parameter distributions of complex industrial systems from noisy time series data requires methods to deal with the uncertainty of the underlying data and the used simulation model. Bayesian inference is well suited for these…

Applications · Statistics 2021-06-18 David N. John , Livia Stohrer , Claudia Schillings , Michael Schick , Vincent Heuveline

The word embedding association test (WEAT) is an important method for measuring linguistic biases against social groups such as ethnic minorities in large text corpora. It does so by comparing the semantic relatedness of words prototypical…

Computation and Language · Computer Science 2022-01-24 Austin van Loon , Salvatore Giorgi , Robb Willer , Johannes Eichstaedt

Recent research demonstrates that word embeddings, trained on the human-generated corpus, have strong gender biases in embedding spaces, and these biases can result in the discriminative results from the various downstream tasks. Whereas…

Computation and Language · Computer Science 2020-11-04 Seungjae Shin , Kyungwoo Song , JoonHo Jang , Hyemi Kim , Weonyoung Joo , Il-Chul Moon

When random effects are correlated with sample design variables, the usual approach of employing individual survey weights (constructed to be inversely proportional to the unit survey inclusion probabilities) to form a pseudo-likelihood no…

Methodology · Statistics 2021-08-26 Terrance D. Savitsky , Matthew R. Williams

Unstructured data from diverse sources, such as social media and aerial imagery, can provide valuable up-to-date information for intelligent situation assessment. Mining these different information sources could bring major benefits to…

Machine Learning · Computer Science 2019-04-08 Edwin Simpson , Steven Reece , Stephen J. Roberts

Current advances in Natural Language Processing (NLP) have made it increasingly feasible to build applications leveraging textual data. Generally, the core of these applications rely on having a good semantic representation of text into…

Computation and Language · Computer Science 2024-10-21 Thomas Uriot