English
Related papers

Related papers: Do Neural Ranking Models Intensify Gender Bias?

200 papers

Neural Machine Translation (NMT) models are state-of-the-art for machine translation. However, these models are known to have various social biases, especially gender bias. Most of the work on evaluating gender bias in NMT has focused…

Computation and Language · Computer Science 2024-11-05 Pushpdeep Singh

With the rapid advancements of large language models (LLMs), information retrieval (IR) systems, such as search engines and recommender systems, have undergone a significant paradigm shift. This evolution, while heralding new opportunities,…

Information Retrieval · Computer Science 2024-08-22 Sunhao Dai , Chen Xu , Shicheng Xu , Liang Pang , Zhenhua Dong , Jun Xu

With the advancement of generation models, AI-generated content (AIGC) is becoming more realistic, flooding the Internet. A recent study suggests that this phenomenon causes source bias in text retrieval for web search. Specifically, neural…

Information Retrieval · Computer Science 2024-05-28 Shicheng Xu , Danyang Hou , Liang Pang , Jingcheng Deng , Jun Xu , Huawei Shen , Xueqi Cheng

Music Recommender Systems (mRS) are designed to give personalised and meaningful recommendations of items (i.e. songs, playlists or artists) to a user base, thereby reflecting and further complementing individual users' specific music…

Information Retrieval · Computer Science 2020-10-07 Dougal Shakespeare , Lorenzo Porcaro , Emilia Gómez , Carlos Castillo

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

In this paper, we propose a novel gender bias detection method by utilizing attention map for transformer-based models. We 1) give an intuitive gender bias judgement method by comparing the different relation degree between the genders and…

Computation and Language · Computer Science 2021-11-01 Bingbing Li , Hongwu Peng , Rajat Sainju , Junhuan Yang , Lei Yang , Yueying Liang , Weiwen Jiang , Binghui Wang , Hang Liu , Caiwen Ding

As teachers increasingly turn to GenAI in their educational practice, we need robust methods to benchmark large language models (LLMs) for pedagogical purposes. This article presents an embedding-based benchmarking framework to detect bias…

Computation and Language · Computer Science 2026-04-02 Yishan Du , Conrad Borchers , Mutlu Cukurova

Gender-bias stereotypes have recently raised significant ethical concerns in natural language processing. However, progress in detection and evaluation of gender bias in natural language understanding through inference is limited and…

Computation and Language · Computer Science 2021-05-13 Shanya Sharma , Manan Dey , Koustuv Sinha

As more content generated by large language models (LLMs) floods into the Internet, information retrieval (IR) systems now face the challenge of distinguishing and handling a blend of human-authored and machine-generated texts. Recent…

Information Retrieval · Computer Science 2025-08-26 Wei Huang , Keping Bi , Yinqiong Cai , Wei Chen , Jiafeng Guo , Xueqi Cheng

As Large Language Models (LLMs) continue to evolve, they are increasingly being employed in numerous studies to simulate societies and execute diverse social tasks. However, LLMs are susceptible to societal biases due to their exposure to…

Computation and Language · Computer Science 2024-10-04 Angana Borah , Rada Mihalcea

Pretrained contextualized language models such as BERT and T5 have established a new state-of-the-art for ad-hoc search. However, it is not yet well-understood why these methods are so effective, what makes some variants more effective than…

Computation and Language · Computer Science 2023-07-21 Sean MacAvaney , Sergey Feldman , Nazli Goharian , Doug Downey , Arman Cohan

Accurately measuring gender stereotypical bias in language models is a complex task with many hidden aspects. Current benchmarks have underestimated this multifaceted challenge and failed to capture the full extent of the problem. This…

Computation and Language · Computer Science 2025-09-25 Mahdi Zakizadeh , Mohammad Taher Pilehvar

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

Bias in recommender systems not only distorts user experience but also perpetuates and amplifies existing societal stereotypes, particularly in sectors like fashion e-commerce. This study employs a dynamic modeling approach to scrutinize…

Information Retrieval · Computer Science 2025-10-28 Mahsa Goodarzi , M. Abdullah Canbaz

The use of Large Language Models (LLMs) in hiring has led to legislative actions to protect vulnerable demographic groups. This paper presents a novel framework for benchmarking hierarchical gender hiring bias in Large Language Models…

Computation and Language · Computer Science 2025-01-20 Ze Wang , Zekun Wu , Xin Guan , Michael Thaler , Adriano Koshiyama , Skylar Lu , Sachin Beepath , Ediz Ertekin , Maria Perez-Ortiz

Sense embedding learning methods learn different embeddings for the different senses of an ambiguous word. One sense of an ambiguous word might be socially biased while its other senses remain unbiased. In comparison to the numerous prior…

Computation and Language · Computer Science 2022-03-17 Yi Zhou , Masahiro Kaneko , Danushka Bollegala

Recommender Systems (RSs) are used to provide users with personalized item recommendations and help them overcome the problem of information overload. Currently, recommendation methods based on deep learning are gaining ground over…

Information Retrieval · Computer Science 2023-01-19 Nikzad Chizari , Niloufar Shoeibi , María N. Moreno-García

Neural ranking models are traditionally trained on a series of random batches, sampled uniformly from the entire training set. Curriculum learning has recently been shown to improve neural models' effectiveness by sampling batches…

Information Retrieval · Computer Science 2019-12-19 Gustavo Penha , Claudia Hauff

Letters of recommendation (LoRs) can carry patterns of implicitly gendered language that can inadvertently influence downstream decisions, e.g. in hiring and admissions. In this work, we investigate the extent to which Transformer-based…

Neural information retrieval (IR) systems have progressed rapidly in recent years, in large part due to the release of publicly available benchmarking tasks. Unfortunately, some dimensions of this progress are illusory: the majority of the…