English
Related papers

Related papers: Evaluation Metrics for Measuring Bias in Search En…

200 papers

In the last decade, legal case search has become an important part of a legal practitioner's work. During legal case search, search engines retrieval a number of relevant cases from huge amounts of data and serve them to users. However, it…

Information Retrieval · Computer Science 2024-03-05 Ruizhe Zhang , Qingyao Ai , Yiqun Liu , Yueyue Wu , Beining Wang

Click-through data has proven to be a valuable resource for improving search-ranking quality. Search engines can easily collect click data, but biases introduced in the data can make it difficult to use the data effectively. In order to…

Machine Learning · Computer Science 2020-02-13 Yingcheng Sun , Richard Kolacinski , Kenneth Loparo

Web search engines apply a variety of ranking signals to achieve user satisfaction, i.e., results pages that provide the best-possible results to the user. While these ranking signals implicitly consider credibility (e.g., by measuring…

Information Retrieval · Computer Science 2012-08-07 Dirk Lewandowski

Internet search affects people's cognition of the world, so mitigating biases in search results and learning fair models is imperative for social good. We study a unique gender bias in image search in this work: the search images are often…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Jialu Wang , Yang Liu , Xin Eric Wang

Search engine results depend not only on the algorithms but also on how users interact with them. However, factors affecting the selection of a search query remain understudied. Using a representative survey of Swiss citizens before a round…

Human-Computer Interaction · Computer Science 2024-10-02 Victoria Vziatysheva , Mykola Makhortykh , Maryna Sydorova , Vihang Jumle

Most research on natural language processing treats bias as an absolute concept: Based on a (probably complex) algorithmic analysis, a sentence, an article, or a text is classified as biased or not. Given the fact that for humans the…

Computation and Language · Computer Science 2022-10-14 Alonso Palomino , Martin Potthast , Khalid Al-Khatib , Benno Stein

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

Artificial Intelligence · Computer Science 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

In light of Phillips' contention regarding the impracticality of Search Neutrality, asserting that non-epistemic factors presently dictate result prioritization, our objective in this study is to confront this constraint by questioning…

Information Retrieval · Computer Science 2025-01-03 Shiran Dudy

Users rely on search engines for information in critical contexts, such as public health emergencies. Understanding how users evaluate the trustworthiness of search results is therefore essential. Research has identified rank and the…

Human-Computer Interaction · Computer Science 2023-09-21 Sterling Williams-Ceci , Michael Macy , Mor Naaman

Algorithmic bias has been the subject of much recent controversy. To clarify what is at stake and to make progress resolving the controversy, a better understanding of the concepts involved would be helpful. The discussion here focuses on…

Computers and Society · Computer Science 2025-05-21 Catherine Stinson

Web search is an integral part of our daily lives. Recently, there has been a trend of personalization in Web search, where different users receive different results for the same search query. The increasing level of personalization is…

Computers and Society · Computer Science 2017-06-19 Anikó Hannák , Piotr Sapieżyński , Arash Molavi Khaki , David Lazer , Alan Mislove , Christo Wilson

Search engines play a central role in routing political information to citizens. The algorithmic personalization of search results by large search engines like Google implies that different users may be offered systematically different…

General Economics · Economics 2022-09-29 Ulrich Matter , Roland Hodler , Johannes Ladwig

Search engines play a central role in how people gather information, but subtle cues like headline framing may influence not only what users believe but also how they search. While framing effects on judgment are well documented, their…

Computation and Language · Computer Science 2025-08-26 Amrit Poudel , Maria Milkowski , Tim Weninger

The correlation of the result lists provided by search engines is fundamental and it has deep and multidisciplinary ramifications. Here, we present automatic and unsupervised methods to assess whether or not search engines provide results…

Computation · Statistics 2011-07-15 Paolo D'Alberto , Ali Dasdan

Media coverage possesses a substantial effect on the public perception of events. The way media frames events can significantly alter the beliefs and perceptions of our society. Nevertheless, nearly all media outlets are known to report…

Computation and Language · Computer Science 2021-12-20 Timo Spinde , Christina Kreuter , Wolfgang Gaissmaier , Felix Hamborg , Bela Gipp , Helge Giese

As large language models (LLMs) become increasingly embedded in civic, educational, and political information environments, concerns about their potential political bias have grown. Prior research often evaluates such bias through simulated…

Computers and Society · Computer Science 2026-03-20 Tai-Quan Peng , Kaiqi Yang , Sanguk Lee , Hang Li , Yucheng Chu , Yuping Lin , Hui Liu

The purpose of modeling document relevance for search engines is to rank better in subsequent searches. Document-specific historical click-through rates can be important features in a dynamic ranking system which updates as we accumulate…

Information Retrieval · Computer Science 2024-02-06 Richard Demsyn-Jones

Bias in web search has been in the spotlight of bias detection research for quite a while. At the same time, little attention has been paid to query suggestions in this regard. Awareness of the problem of biased query suggestions has been…

Information Retrieval · Computer Science 2026-01-08 Fabian Haak , Philipp Schaer

The internet has been blurring the lines between local and global cultures, affecting in different ways the perception of people about themselves and others. In the global context of the internet, search engine platforms are a key mediator…

Computers and Society · Computer Science 2016-11-09 Gabriel Magno , Camila Souza Araújo , Wagner Meira , Virgilio Almeida

This study examines the influence of Google's search algorithm on news diversity by analyzing search results in Brazil, the UK, and the US. It explores how Google's system preferentially favors a limited number of news outlets. Utilizing…

Computers and Society · Computer Science 2024-11-01 Raphael Hernandes , Giulio Corsi