English
Related papers

Related papers: National Origin Discrimination in Deep-learning-po…

200 papers

Artificial intelligence (AI) hiring tools have revolutionized resume screening, and large language models (LLMs) have the potential to do the same. However, given the biases which are embedded within LLMs, it is unclear whether they can be…

Computers and Society · Computer Science 2024-08-22 Kyra Wilson , Aylin Caliskan

The power of machine learning systems not only promises great technical progress, but risks societal harm. As a recent example, researchers have shown that popular word embedding algorithms exhibit stereotypical biases, such as gender bias.…

Machine Learning · Computer Science 2019-06-11 Marc-Etienne Brunet , Colleen Alkalay-Houlihan , Ashton Anderson , Richard Zemel

The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. In fact, many relevant…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Alejandro Peña , Ignacio Serna , Aythami Morales , Julian Fierrez

As artificial intelligence (AI) tools become widely adopted, large language models (LLMs) are increasingly involved on both sides of decision-making processes, ranging from hiring to content moderation. This dual adoption raises a critical…

Computers and Society · Computer Science 2026-02-10 Jiannan Xu , Gujie Li , Jane Yi Jiang

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Studies have shown that some Natural Language Processing (NLP) systems encode and replicate harmful biases with potential adverse ethical effects in our society. In this article, we propose an approach for identifying gender and racial…

Computation and Language · Computer Science 2022-04-13 Sean Matthews , John Hudzina , Dawn Sepehr

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

Computation and Language · Computer Science 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

Recent advances in Generative Artificial Intelligence (GenAI) have transformed educational content creation, particularly in developing tutor training materials. However, biases embedded in AI-generated content--such as gender, racial, or…

Computation and Language · Computer Science 2025-05-20 Jingyang Peng , Wenyuan Shen , Jiarui Rao , Jionghao Lin

Large Language Models (LLMs) offer the potential to automate hiring by matching job descriptions with candidate resumes, streamlining recruitment processes, and reducing operational costs. However, biases inherent in these models may lead…

Computation and Language · Computer Science 2025-03-26 Hayate Iso , Pouya Pezeshkpour , Nikita Bhutani , Estevam Hruschka

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI…

Artificial Intelligence · Computer Science 2025-07-04 Disa Sariola , Patrick Button , Aron Culotta , Nicholas Mattei

As Generative AI rises in adoption, its use has expanded to include domains such as hiring and recruiting. However, without examining the potential of bias, this may negatively impact marginalized populations, including people with…

Computers and Society · Computer Science 2024-05-24 Kate Glazko , Yusuf Mohammed , Ben Kosa , Venkatesh Potluri , Jennifer Mankoff

Job search through online matching engines nowadays are very prominent and beneficial to both job seekers and employers. But the solutions of traditional engines without understanding the semantic meanings of different resumes have not kept…

Computation and Language · Computer Science 2016-07-27 Yiou Lin , Hang Lei , Prince Clement Addo , Xiaoyu Li

The recruitment process significantly impacts an organization's performance, productivity, and culture. Traditionally, human resource experts and industrial-organizational psychologists have developed systematic hiring methods, including…

Computers and Society · Computer Science 2025-05-20 Dena F. Mujtaba , Nihar R. Mahapatra

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

Computation and Language · Computer Science 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

This paper presents an algorithm for enumerating biases in word embeddings. The algorithm exposes a large number of offensive associations related to sensitive features such as race and gender on publicly available embeddings, including a…

Computation and Language · Computer Science 2019-06-21 Nathaniel Swinger , Maria De-Arteaga , Neil Thomas Heffernan , Mark DM Leiserson , Adam Tauman Kalai

Algorithms learned from data are increasingly used for deciding many aspects in our life: from movies we see, to prices we pay, or medicine we get. Yet there is growing evidence that decision making by inappropriately trained algorithms may…

Artificial Intelligence · Computer Science 2017-08-03 Indre Zliobaite

We investigate the potential for nationality biases in natural language processing (NLP) models using human evaluation methods. Biased NLP models can perpetuate stereotypes and lead to algorithmic discrimination, posing a significant…

Computation and Language · Computer Science 2023-08-09 Pranav Narayanan Venkit , Sanjana Gautam , Ruchi Panchanadikar , Ting-Hao `Kenneth' Huang , Shomir Wilson

Large language models (LLMs) are increasingly being introduced in workplace settings, with the goals of improving efficiency and fairness. However, concerns have arisen regarding these models' potential to reflect or exacerbate social…

Computers and Society · Computer Science 2024-11-18 Lena Armstrong , Abbey Liu , Stephen MacNeil , Danaë Metaxa

Artificial intelligence is used at various stages of the recruitment process to automatically select the best candidate for a position, with companies guaranteeing unbiased recruitment. However, the algorithms used are either trained by…

Artificial Intelligence · Computer Science 2025-05-06 Shuyu Wang , Angélique Saillet , Philomène Le Gall , Alain Lacroux , Christelle Martin-Lacroux , Vincent Brault

Recently, some studies have shown that text classification tasks are vulnerable to poisoning and evasion attacks. However, little work has investigated attacks against decision making algorithms that use text embeddings, and their output is…

Computation and Language · Computer Science 2022-01-11 Anahita Samadi , Debapriya Banerjee , Shirin Nilizadeh
‹ Prev 1 2 3 10 Next ›