English
Related papers

Related papers: Visual Identification of Problematic Bias in Large…

200 papers

One of the primary challenges faced by deep learning is the degree to which current methods exploit superficial statistics and dataset bias, rather than learning to generalise over the specific representations they have experienced. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Damien Teney , Peng Wang , Jiewei Cao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel

This paper investigates the parameter space of machine learning (ML) algorithms in aggravating or mitigating fairness bugs. Data-driven software is increasingly applied in social-critical applications where ensuring fairness is of paramount…

Software Engineering · Computer Science 2022-02-15 Saeid Tizpaz-Niari , Ashish Kumar , Gang Tan , Ashutosh Trivedi

Fine-tuning modern computer vision models requires accurately labeled data for which the ground truth may not exist, but a set of multiple labels can be obtained from labelers of variable accuracy. We tie the notion of label quality to…

Machine Learning · Computer Science 2024-10-02 Sunil Kumar , Ted Sandler , Paulina Varshavskaya

Fairness constitutes a concern within machine learning (ML) applications. Currently, there is no study on how disparities in classification complexity between privileged and unprivileged groups could influence the fairness of solutions,…

Machine Learning · Computer Science 2025-04-09 Juliett Suárez Ferreira , Marija Slavkovik , Jorge Casillas

There is a growing trend of applying machine learning methods to medical datasets in order to predict patients' future status. Although some of these methods achieve high performance, challenges still exist in comparing and evaluating…

Medical Physics · Physics 2020-03-25 Yiran Li , Takanori Fujiwara , Yong K. Choi , Katherine K. Kim , Kwan-Liu Ma

Fairness in machine learning (ML) has a critical importance for building trustworthy machine learning system as artificial intelligence (AI) systems increasingly impact various aspects of society, including healthcare decisions and legal…

Machine Learning · Computer Science 2025-06-19 Modar Sulaiman , Kallol Roy

Many technical approaches have been proposed for ensuring that decisions made by machine learning systems are fair, but few of these proposals have been stress-tested in real-world systems. This paper presents an example of one team's…

Performance disparities of image recognition across demographic groups are known to exist in deep learning-based models, due to imbalanced group representations or spurious correlation between group and target labels. Previous work has…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Miao Zhang , Rumi Chunara

Machine Learning has been applied to pathology images in research and clinical practice with promising outcomes. However, standard ML models often lack the rigorous evaluation required for clinical decisions. Machine learning techniques for…

Image and Video Processing · Electrical Eng. & Systems 2022-04-19 Syed Ashar Javed , Dinkar Juyal , Zahil Shanis , Shreya Chakraborty , Harsha Pokkalla , Aaditya Prakash

With the growth of data sizes, visualizing them becomes more complex. Desktop displays are insufficient for presenting and collaborating on complex data visualizations. Large displays could provide the necessary space to demo or present…

Human-Computer Interaction · Computer Science 2024-09-17 Mahsa Sinaei Hamed , Pak Kwan , Matthew Klich , Jillian Aurisano , Fateme Rajabiyazdi

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. However current progress is hampered by a plurality of definitions of bias, means of quantification, and oftentimes vague…

Computation and Language · Computer Science 2023-02-14 Xudong Han , Timothy Baldwin , Trevor Cohn

Visual similarities discovery (VSD) is an important task with broad e-commerce applications. Given an image of a certain object, the goal of VSD is to retrieve images of different objects with high perceptual visual similarity. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Oren Barkan , Tal Reiss , Jonathan Weill , Ori Katz , Roy Hirsch , Itzik Malkiel , Noam Koenigstein

There has been increasing awareness of ethical issues in machine learning, and fairness has become an important research topic. Most fairness efforts in computer vision have been focused on human sensing applications and preventing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Zu Kim , André Araujo , Bingyi Cao , Cam Askew , Jack Sim , Mike Green , N'Mah Fodiatu Yilla , Tobias Weyand

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Decision making algorithms, in practice, are often trained on data that exhibits a variety of biases. Decision-makers often aim to take decisions based on some ground-truth target that is assumed or expected to be unbiased, i.e., equally…

Machine Learning · Statistics 2022-07-05 Miriam Rateike , Ayan Majumdar , Olga Mineeva , Krishna P. Gummadi , Isabel Valera

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

Machine Learning · Computer Science 2019-01-16 Heinrich Jiang , Ofir Nachum

Supervised training of deep learning models requires large labeled datasets. There is a growing interest in obtaining such datasets for medical image analysis applications. However, the impact of label noise has not received sufficient…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Davood Karimi , Haoran Dou , Simon K. Warfield , Ali Gholipour

The advances in multi-modal foundation models (FMs) (e.g., CLIP and LLaVA) have facilitated the auto-labeling of large-scale datasets, enhancing model performance in challenging downstream tasks such as open-vocabulary object detection and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xiwei Xuan , Xiaoqi Wang , Wenbin He , Jorge Piazentin Ono , Liang Gou , Kwan-Liu Ma , Liu Ren

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu