English
Related papers

Related papers: Medical Imaging AI Competitions Lack Fairness

200 papers

The recruitment process significantly impacts an organization's performance, productivity, and culture. Traditionally, human resource experts and industrial-organizational psychologists have developed systematic hiring methods, including…

Computers and Society · Computer Science 2025-05-20 Dena F. Mujtaba , Nihar R. Mahapatra

Fairness in medical AI is increasingly recognized as a crucial aspect of healthcare delivery. While most of the prior work done on fairness emphasizes the importance of equal performance, we argue that decreases in fairness can be either…

Machine Learning · Computer Science 2024-10-01 Samia Belhadj , Sanguk Park , Ambika Seth , Hesham Dar , Thijs Kooi

The development of Artificial Intelligence (AI), including AI in Science (AIS), should be done following the principles of responsible AI. Progress in responsible AI is often quantified through evaluation metrics, yet there has been less…

Computers and Society · Computer Science 2025-10-31 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

Recent technological advances in healthcare have led to unprecedented growth in patient data quantity and diversity. While artificial intelligence (AI) models have shown promising results in analyzing individual data modalities, there is…

Artificial Intelligence · Computer Science 2024-11-07 Daan Schouten , Giulia Nicoletti , Bas Dille , Catherine Chia , Pierpaolo Vendittelli , Megan Schuurmans , Geert Litjens , Nadieh Khalili

Recent Artificial Intelligence (AI) models have matched or exceeded human experts in several benchmarks of biomedical task performance, but surgical benchmarks in particular are often missing from prominent medical benchmark suites. Since…

Differences in data distributions between demographic groups, known as the problem of infra-marginality, complicate how people evaluate fairness in machine learning models. We present a user study with 85 participants in a hypothetical…

Human-Computer Interaction · Computer Science 2026-03-09 Schrasing Tong , Minseok Jung , Ilaria Liccardi , Lalana Kagal

Introduction: Artificial intelligence (AI) is exhibiting tremendous potential to reduce the massive costs and long timescales of drug discovery. There are however important challenges currently limiting the impact and scope of AI models.…

Other Quantitative Biology · Quantitative Biology 2024-09-25 Ghita Ghislat , Saiveth Hernandez-Hernandez , Chayanit Piyawajanusorn , Pedro J. Ballester

Fairness is a growing concern for high-risk decision-making using Artificial Intelligence (AI) but ensuring it through purely technical means is challenging: there is no universally accepted fairness measure, fairness is context-dependent,…

Artificial Intelligence · Computer Science 2024-10-07 Evdoxia Taka , Yuri Nakao , Ryosuke Sonoda , Takuya Yokota , Lin Luo , Simone Stumpf

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Matthias Eisenmann , Annika Reinke , Vivienn Weru , Minu Dietlinde Tizabi , Fabian Isensee , Tim J. Adler , Patrick Godau , Veronika Cheplygina , Michal Kozubek , Sharib Ali , Anubha Gupta , Jan Kybic , Alison Noble , Carlos Ortiz de Solórzano , Samiksha Pachade , Caroline Petitjean , Daniel Sage , Donglai Wei , Elizabeth Wilden , Deepak Alapatt , Vincent Andrearczyk , Ujjwal Baid , Spyridon Bakas , Niranjan Balu , Sophia Bano , Vivek Singh Bawa , Jorge Bernal , Sebastian Bodenstedt , Alessandro Casella , Jinwook Choi , Olivier Commowick , Marie Daum , Adrien Depeursinge , Reuben Dorent , Jan Egger , Hannah Eichhorn , Sandy Engelhardt , Melanie Ganz , Gabriel Girard , Lasse Hansen , Mattias Heinrich , Nicholas Heller , Alessa Hering , Arnaud Huaulmé , Hyunjeong Kim , Bennett Landman , Hongwei Bran Li , Jianning Li , Jun Ma , Anne Martel , Carlos Martín-Isla , Bjoern Menze , Chinedu Innocent Nwoye , Valentin Oreiller , Nicolas Padoy , Sarthak Pati , Kelly Payette , Carole Sudre , Kimberlin van Wijnen , Armine Vardazaryan , Tom Vercauteren , Martin Wagner , Chuanbo Wang , Moi Hoon Yap , Zeyun Yu , Chun Yuan , Maximilian Zenk , Aneeq Zia , David Zimmerer , Rina Bao , Chanyeol Choi , Andrew Cohen , Oleh Dzyubachyk , Adrian Galdran , Tianyuan Gan , Tianqi Guo , Pradyumna Gupta , Mahmood Haithami , Edward Ho , Ikbeom Jang , Zhili Li , Zhengbo Luo , Filip Lux , Sokratis Makrogiannis , Dominik Müller , Young-tack Oh , Subeen Pang , Constantin Pape , Gorkem Polat , Charlotte Rosalie Reed , Kanghyun Ryu , Tim Scherr , Vajira Thambawita , Haoyu Wang , Xinliang Wang , Kele Xu , Hung Yeh , Doyeob Yeo , Yixuan Yuan , Yan Zeng , Xin Zhao , Julian Abbing , Jannes Adam , Nagesh Adluru , Niklas Agethen , Salman Ahmed , Yasmina Al Khalil , Mireia Alenyà , Esa Alhoniemi , Chengyang An , Talha Anwar , Tewodros Weldebirhan Arega , Netanell Avisdris , Dogu Baran Aydogan , Yingbin Bai , Maria Baldeon Calisto , Berke Doga Basaran , Marcel Beetz , Cheng Bian , Hao Bian , Kevin Blansit , Louise Bloch , Robert Bohnsack , Sara Bosticardo , Jack Breen , Mikael Brudfors , Raphael Brüngel , Mariano Cabezas , Alberto Cacciola , Zhiwei Chen , Yucong Chen , Daniel Tianming Chen , Minjeong Cho , Min-Kook Choi , Chuantao Xie Chuantao Xie , Dana Cobzas , Julien Cohen-Adad , Jorge Corral Acero , Sujit Kumar Das , Marcela de Oliveira , Hanqiu Deng , Guiming Dong , Lars Doorenbos , Cory Efird , Sergio Escalera , Di Fan , Mehdi Fatan Serj , Alexandre Fenneteau , Lucas Fidon , Patryk Filipiak , René Finzel , Nuno R. Freitas , Christoph M. Friedrich , Mitchell Fulton , Finn Gaida , Francesco Galati , Christoforos Galazis , Chang Hee Gan , Zheyao Gao , Shengbo Gao , Matej Gazda , Beerend Gerats , Neil Getty , Adam Gibicar , Ryan Gifford , Sajan Gohil , Maria Grammatikopoulou , Daniel Grzech , Orhun Güley , Timo Günnemann , Chunxu Guo , Sylvain Guy , Heonjin Ha , Luyi Han , Il Song Han , Ali Hatamizadeh , Tian He , Jimin Heo , Sebastian Hitziger , SeulGi Hong , SeungBum Hong , Rian Huang , Ziyan Huang , Markus Huellebrand , Stephan Huschauer , Mustaffa Hussain , Tomoo Inubushi , Ece Isik Polat , Mojtaba Jafaritadi , SeongHun Jeong , Bailiang Jian , Yuanhong Jiang , Zhifan Jiang , Yueming Jin , Smriti Joshi , Abdolrahim Kadkhodamohammadi , Reda Abdellah Kamraoui , Inha Kang , Junghwa Kang , Davood Karimi , April Khademi , Muhammad Irfan Khan , Suleiman A. Khan , Rishab Khantwal , Kwang-Ju Kim , Timothy Kline , Satoshi Kondo , Elina Kontio , Adrian Krenzer , Artem Kroviakov , Hugo Kuijf , Satyadwyoom Kumar , Francesco La Rosa , Abhi Lad , Doohee Lee , Minho Lee , Chiara Lena , Hao Li , Ling Li , Xingyu Li , Fuyuan Liao , KuanLun Liao , Arlindo Limede Oliveira , Chaonan Lin , Shan Lin , Akis Linardos , Marius George Linguraru , Han Liu , Tao Liu , Di Liu , Yanling Liu , João Lourenço-Silva , Jingpei Lu , Jiangshan Lu , Imanol Luengo , Christina B. Lund , Huan Minh Luu , Yi Lv , Yi Lv , Uzay Macar , Leon Maechler , Sina Mansour L. , Kenji Marshall , Moona Mazher , Richard McKinley , Alfonso Medela , Felix Meissen , Mingyuan Meng , Dylan Miller , Seyed Hossein Mirjahanmardi , Arnab Mishra , Samir Mitha , Hassan Mohy-ud-Din , Tony Chi Wing Mok , Gowtham Krishnan Murugesan , Enamundram Naga Karthik , Sahil Nalawade , Jakub Nalepa , Mohamed Naser , Ramin Nateghi , Hammad Naveed , Quang-Minh Nguyen , Cuong Nguyen Quoc , Brennan Nichyporuk , Bruno Oliveira , David Owen , Jimut Bahan Pal , Junwen Pan , Wentao Pan , Winnie Pang , Bogyu Park , Vivek Pawar , Kamlesh Pawar , Michael Peven , Lena Philipp , Tomasz Pieciak , Szymon Plotka , Marcel Plutat , Fattaneh Pourakpour , Domen Preložnik , Kumaradevan Punithakumar , Abdul Qayyum , Sandro Queirós , Arman Rahmim , Salar Razavi , Jintao Ren , Mina Rezaei , Jonathan Adam Rico , ZunHyan Rieu , Markus Rink , Johannes Roth , Yusely Ruiz-Gonzalez , Numan Saeed , Anindo Saha , Mostafa Salem , Ricardo Sanchez-Matilla , Kurt Schilling , Wei Shao , Zhiqiang Shen , Ruize Shi , Pengcheng Shi , Daniel Sobotka , Théodore Soulier , Bella Specktor Fadida , Danail Stoyanov , Timothy Sum Hon Mun , Xiaowu Sun , Rong Tao , Franz Thaler , Antoine Théberge , Felix Thielke , Helena Torres , Kareem A. Wahid , Jiacheng Wang , YiFei Wang , Wei Wang , Xiong Wang , Jianhui Wen , Ning Wen , Marek Wodzinski , Ye Wu , Fangfang Xia , Tianqi Xiang , Chen Xiaofei , Lizhan Xu , Tingting Xue , Yuxuan Yang , Lin Yang , Kai Yao , Huifeng Yao , Amirsaeed Yazdani , Michael Yip , Hwanseung Yoo , Fereshteh Yousefirizi , Shunkai Yu , Lei Yu , Jonathan Zamora , Ramy Ashraf Zeineldin , Dewen Zeng , Jianpeng Zhang , Bokai Zhang , Jiapeng Zhang , Fan Zhang , Huahong Zhang , Zhongchen Zhao , Zixuan Zhao , Jiachen Zhao , Can Zhao , Qingshuo Zheng , Yuheng Zhi , Ziqi Zhou , Baosheng Zou , Klaus Maier-Hein , Paul F. Jäger , Annette Kopp-Schneider , Lena Maier-Hein

Recent failures such as Google Gemini generating people of color in Nazi-era uniforms illustrate how AI outputs can be factually plausible yet socially harmful. AI models are increasingly evaluated for "fairness," yet existing benchmarks…

Computation and Language · Computer Science 2025-10-01 Jen-tse Huang , Yuhang Yan , Linqi Liu , Yixin Wan , Wenxuan Wang , Kai-Wei Chang , Michael R. Lyu

Ensuring fairness and robustness in machine learning models remains a challenge, particularly under domain shifts. We present Face4FairShifts, a large-scale facial image benchmark designed to systematically evaluate fairness-aware learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yumeng Lin , Dong Li , Xintao Wu , Minglai Shao , Xujiang Zhao , Zhong Chen , Chen Zhao

Decision-making systems based on AI and machine learning have been used throughout a wide range of real-world scenarios, including healthcare, law enforcement, education, and finance. It is no longer far-fetched to envision a future where…

Artificial Intelligence · Computer Science 2022-07-26 Drago Plecko , Elias Bareinboim

Recent regulatory proposals for artificial intelligence emphasize fairness requirements for machine learning models. However, precisely defining the appropriate measure of fairness is challenging due to philosophical, cultural and political…

Artificial Intelligence · Computer Science 2026-02-19 Caleb J. S. Barr , Olivia Erdelyi , Paul D. Docherty , Randolph C. Grace

As decision-making increasingly relies on Machine Learning (ML) and (big) data, the issue of fairness in data-driven Artificial Intelligence (AI) systems is receiving increasing attention from both research and industry. A large variety of…

Machine Learning · Computer Science 2022-03-08 Tai Le Quy , Arjun Roy , Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

Recent advances in deep learning and on-device inference could transform routine screening for skin cancers. Along with the anticipated benefits of this technology, potential dangers arise from unforeseen and inherent biases. A significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ko Watanabe , Stanislav Frolov , Aya Hassan , David Dembinsky , Adriano Lucieri , Andreas Dengel

The importance of addressing fairness and bias in artificial intelligence (AI) systems cannot be over-emphasized. Mainstream media has been awashed with news of incidents around stereotypes and other types of bias in many of these systems…

Computation and Language · Computer Science 2024-09-10 Tosin Adewumi , Lama Alkhaled , Namrata Gurung , Goya van Boven , Irene Pagliai

In an era where AI-driven hiring is transforming recruitment practices, concerns about fairness and bias have become increasingly important. To explore these issues, we introduce a benchmark, FAIRE (Fairness Assessment In Resume…

Computation and Language · Computer Science 2025-04-03 Athena Wen , Tanush Patil , Ansh Saxena , Yicheng Fu , Sean O'Brien , Kevin Zhu

Image matching approaches have been widely used in computer vision applications in which the image-level matching performance of matchers is critical. However, it has not been well investigated by previous works which place more emphases on…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 JiaWang Bian , Le Zhang , Yun Liu , Wen-Yan Lin , Ming-Ming Cheng , Ian D. Reid

The past decade has witnessed a substantial increase in the number of startups and companies offering AI-based solutions for clinical decision support in medical institutions. However, the critical nature of medical decision-making raises…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Solha Kang , Wesley De Neve , Francois Rameau , Utku Ozbulak

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero