English
Related papers

Related papers: National Origin Discrimination in Deep-learning-po…

200 papers

Foundation models require fine-tuning to ensure their generative outputs align with intended results for specific tasks. Automating this fine-tuning process is challenging, as it typically needs human feedback that can be expensive to…

There has been rapidly growing interest in the use of algorithms in hiring, especially as a means to address or mitigate bias. Yet, to date, little is known about how these methods are used in practice. How are algorithmic assessments…

Computers and Society · Computer Science 2019-12-10 Manish Raghavan , Solon Barocas , Jon Kleinberg , Karen Levy

The search of information in large text repositories has been plagued by the so-called document-query vocabulary gap, i.e. the semantic discordance between the contents in the stored document entities on the one hand and the human query on…

Information Retrieval · Computer Science 2020-04-22 Bhawani Selvaretnam , Mohammed Belkhatir

Algorithmic hiring has become increasingly necessary in some sectors as it promises to deal with hundreds or even thousands of applicants. At the heart of these systems are algorithms designed to retrieve and rank candidate profiles, which…

Computers and Society · Computer Science 2025-09-01 Jorge Saldivar , Anna Gatzioura , Carlos Castillo

Artificial Intelligence (AI) systems for online recruitment markets have the potential to significantly enhance the efficiency and effectiveness of job placements and even promote fairness or inclusive hiring practices. Neglecting Diversity…

Artificial Intelligence · Computer Science 2024-11-12 Muneera Bano , Didar Zowghi , Fernando Mourao , Sarah Kaur , Tao Zhang

Recruiters usually spend less than a minute looking at each r\'esum\'e when deciding whether it's worth continuing the recruitment process with the candidate. Recruiters focus on keywords, and it's almost impossible to guarantee a fair…

Computation and Language · Computer Science 2016-06-23 Tim Zimmermann , Leo Kotschenreuther , Karsten Schmidt

The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. There is a certain…

Artificial intelligence and machine learning are in a period of astounding growth. However, there are concerns that these technologies may be used, either with or without intention, to perpetuate the prejudice and unfairness that…

Artificial Intelligence · Computer Science 2017-05-26 Aylin Caliskan , Joanna J. Bryson , Arvind Narayanan

Automated recruitment tools are proliferating. While having the promise of improving efficiency, various risks, including bias, challenges the potential of these tools. An in-depth understanding of the perceived risk factors and needs from…

Human-Computer Interaction · Computer Science 2023-01-31 Mitra Lashkari , Jinghui Cheng

Word vector representations are well developed tools for various NLP and Machine Learning tasks and are known to retain significant semantic and syntactic structure of languages. But they are prone to carrying and amplifying bias which can…

Computation and Language · Computer Science 2019-01-24 Sunipa Dev , Jeff Phillips

In this study, we conduct a resume-screening experiment (N=528) where people collaborate with simulated AI models exhibiting race-based preferences (bias) to evaluate candidates for 16 high and low status occupations. Simulated AI bias…

Computers and Society · Computer Science 2025-09-10 Kyra Wilson , Mattea Sim , Anna-Maria Gueorguieva , Aylin Caliskan

Large language models are increasingly used to support organizational decisions from hiring to governance, raising fairness concerns in AI-assisted evaluation. Prior work has focused mainly on demographic bias and broader preference…

Computers and Society · Computer Science 2026-04-14 Shunqi Mao , Wei Guo , Dingxin Zhang , Chaoyi Zhang , Weidong Cai

Embeddings play a pivotal role in the efficacy of Large Language Models. They are the bedrock on which these models grasp contextual relationships and foster a more nuanced understanding of language and consequently perform remarkably on a…

Computation and Language · Computer Science 2025-01-08 Aishik Rakshit , Smriti Singh , Shuvam Keshari , Arijit Ghosh Chowdhury , Vinija Jain , Aman Chadha

The use of machine learning systems in processing job applications has made the process agile and efficient, but at the same time it has created problems in terms of equality, reliability and transparency. In this paper we explain some of…

Computers and Society · Computer Science 2020-08-04 Andrés Páez , Natalia Ramírez-Bustamante

Ranking algorithms are being widely employed in various online hiring platforms including LinkedIn, TaskRabbit, and Fiverr. Prior research has demonstrated that ranking algorithms employed by these platforms are prone to a variety of…

Machine Learning · Computer Science 2021-04-09 Tom Sühr , Sophie Hilgard , Himabindu Lakkaraju

Regulatory efforts to protect against algorithmic bias have taken on increased urgency with rapid advances in large language models (LLMs), which are machine learning models that can achieve performance rivaling human experts on a wide…

Applications · Statistics 2024-04-05 Johann D. Gaebler , Sharad Goel , Aziz Huq , Prasanna Tambe

Word embeddings trained on large corpora have shown to encode high levels of unfair discriminatory gender, racial, religious and ethnic biases. In contrast, human-written dictionaries describe the meanings of words in a concise, objective…

Computation and Language · Computer Science 2021-01-26 Masahiro Kaneko , Danushka Bollegala

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

Computation and Language · Computer Science 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

Language data and models demonstrate various types of bias, be it ethnic, religious, gender, or socioeconomic. AI/NLP models, when trained on the racially biased dataset, AI/NLP models instigate poor model explainability, influence user…

Computation and Language · Computer Science 2022-11-28 Kinshuk Sengupta , Praveen Ranjan Srivastava

This paper investigates algorithmic bias in language-based models for automated depression detection, focusing on socio-demographic disparities related to gender and race/ethnicity. Models trained using deep neural networks (DNN) based…

Computation and Language · Computer Science 2026-01-28 Obed Junias , Prajakta Kini , Theodora Chaspari