English
Related papers

Related papers: Semantics derived automatically from language corp…

200 papers

Humans show language-biased image recognition for a word-embedded image, known as picture-word interference. Such interference depends on hierarchical semantic categories and reflects that human language processing highly interacts with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yoann Lemesle , Masataka Sawayama , Guillermo Valle-Perez , Maxime Adolphe , Hélène Sauzéon , Pierre-Yves Oudeyer

Many modern Artificial Intelligence (AI) systems make use of data embeddings, particularly in the domain of Natural Language Processing (NLP). These embeddings are learnt from data that has been gathered "from the wild" and have been found…

Computation and Language · Computer Science 2018-06-19 Adam Sutton , Thomas Lansdall-Welfare , Nello Cristianini

Due to the implement of guardrails by developers, Large language models (LLMs) have demonstrated exceptional performance in explicit bias tests. However, bias in LLMs may occur not only explicitly, but also implicitly, much like humans who…

Computation and Language · Computer Science 2025-03-05 Xinru Lin , Luyang Li

Human gender bias is reflected in language and text production. Because state-of-the-art machine translation (MT) systems are trained on large corpora of text, mostly generated by humans, gender bias can also be found in MT. For instance…

Computation and Language · Computer Science 2021-07-27 Jonas-Dario Troles , Ute Schmid

Word embedding spaces are powerful tools for capturing latent semantic relationships between terms in corpora, and have become widely popular for building state-of-the-art natural language processing algorithms. However, studies have shown…

Computation and Language · Computer Science 2019-06-21 Inom Mirzaev , Anthony Schulte , Michael Conover , Sam Shah

It has been shown that word embeddings can exhibit gender bias, and various methods have been proposed to quantify this. However, the extent to which the methods are capturing social stereotypes inherited from the data has been debated.…

Computation and Language · Computer Science 2020-10-29 Haiyang Zhang , Alison Sneyd , Mark Stevenson

Recent studies in the field of Machine Translation (MT) and Natural Language Processing (NLP) have shown that existing models amplify biases observed in the training data. The amplification of biases in language technology has mainly been…

Computation and Language · Computer Science 2021-02-02 Eva Vanmassenhove , Dimitar Shterionov , Matthew Gwilliam

Word embeddings are a fixed, distributional representation of the context of words in a corpus learned from word co-occurrences. While word embeddings have proven to have many practical uses in natural language processing tasks, they…

Computation and Language · Computer Science 2020-10-02 James Powell , Kari Sentz

Representing words by vectors, or embeddings, enables computational reasoning and is foundational to automating natural language tasks. For example, if word embeddings of similar words contain similar values, word similarity can be readily…

Computation and Language · Computer Science 2022-02-02 Carl Allen

Humans rely on effective representations to learn from few examples and abstract useful information from sensory data. Inducing such representations in machine learning models has been shown to improve their performance on various…

Machine Learning · Computer Science 2025-02-03 Raja Marjieh , Sreejan Kumar , Declan Campbell , Liyi Zhang , Gianluca Bencomo , Jake Snell , Thomas L. Griffiths

Word embeddings are often criticized for capturing undesirable word associations such as gender stereotypes. However, methods for measuring and removing such biases remain poorly understood. We show that for any embedding model that…

Computation and Language · Computer Science 2019-08-20 Kawin Ethayarajh , David Duvenaud , Graeme Hirst

Detecting biases in artificial intelligence has become difficult because of the impenetrable nature of deep learning. The central difficulty is in relating unobservable phenomena deep inside models with observable, outside quantities that…

Computation and Language · Computer Science 2019-12-24 Lizhen Liang , Daniel E. Acuna

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

Texts like news, encyclopedias, and some social media strive for objectivity. Yet bias in the form of inappropriate subjectivity - introducing attitudes via framing, presupposing truth, and casting doubt - remains ubiquitous. This kind of…

Computation and Language · Computer Science 2019-12-13 Reid Pryzant , Richard Diehl Martinez , Nathan Dass , Sadao Kurohashi , Dan Jurafsky , Diyi Yang

Recent advances in machine learning leverage massive datasets of unlabeled images from the web to learn general-purpose image representations for tasks from image classification to face recognition. But do unsupervised computer vision…

Computers and Society · Computer Science 2021-01-28 Ryan Steed , Aylin Caliskan

We generalize the notion of social biases from language embeddings to grounded vision and language embeddings. Biases are present in grounded embeddings, and indeed seem to be equally or more significant than for ungrounded embeddings. This…

Computation and Language · Computer Science 2023-08-23 Candace Ross , Boris Katz , Andrei Barbu

Static word embeddings are ubiquitous in computational social science applications and contribute to practical decision-making in a variety of fields including law and healthcare. However, assessing the statistical uncertainty in downstream…

Computation and Language · Computer Science 2024-06-19 Andrea Vallebueno , Cassandra Handan-Nader , Christopher D. Manning , Daniel E. Ho

Social biases are encoded in word embeddings. This presents a unique opportunity to study society historically and at scale, and a unique danger when embeddings are used in downstream applications. Here, we investigate the extent to which…

Computation and Language · Computer Science 2020-04-28 Kenneth Joseph , Jonathan H. Morgan

The word embedding association test (WEAT) is an important method for measuring linguistic biases against social groups such as ethnic minorities in large text corpora. It does so by comparing the semantic relatedness of words prototypical…

Computation and Language · Computer Science 2022-01-24 Austin van Loon , Salvatore Giorgi , Robb Willer , Johannes Eichstaedt

Warning: This paper contains several contents that may be toxic, harmful, or offensive. In the last few years, text-to-image generative models have gained remarkable success in generating images with unprecedented quality accompanied by a…

Computation and Language · Computer Science 2023-06-02 Jialu Wang , Xinyue Gabby Liu , Zonglin Di , Yang Liu , Xin Eric Wang