English
Related papers

Related papers: Bias-inducing geometries: an exactly solvable data…

200 papers

The idealization of a static machine-learned model, trained once and deployed forever, is not practical. As input distributions change over time, the model will not only lose accuracy, any constraints to reduce bias against a protected…

Machine Learning · Computer Science 2022-06-15 Abdulaziz A. Almuzaini , Chidansh A. Bhatt , David M. Pennock , Vivek K. Singh

Data-driven decision making is gaining prominence with the popularity of various machine learning models. Unfortunately, real-life data used in machine learning training may capture human biases, and as a result the learned models may lead…

Machine Learning · Computer Science 2020-11-24 Jiang Zhang , Ivan Beschastnikh , Sergey Mechtaev , Abhik Roychoudhury

It is widely accepted that biased data leads to biased and thus potentially unfair models. Therefore, several measures for bias in data and model predictions have been proposed, as well as bias mitigation techniques whose aim is to learn…

Machine Learning · Computer Science 2024-03-26 Marco Favier , Toon Calders , Sam Pinxteren , Jonathan Meyer

Machine learning (ML) and deep learning models are extensively used for parameter optimization and regression problems. However, not all inverse problems in ML are ``identifiable,'' indicating that model parameters may not be uniquely…

Machine Learning · Computer Science 2023-07-24 Reza Sameni

How sensitive should machine learning models be to input changes? We tackle the question of model smoothness and show that it is a useful inductive bias which aids generalization, adversarial robustness, generative modeling and…

Machine Learning · Statistics 2021-07-08 Mihaela Rosca , Theophane Weber , Arthur Gretton , Shakir Mohamed

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Machine learning (ML) is increasingly being used in high-stakes applications impacting society. Therefore, it is of critical importance that ML models do not propagate discrimination. Collecting accurate labeled data in societal…

Machine Learning · Computer Science 2020-07-03 Hadis Anahideh , Abolfazl Asudeh , Saravanan Thirumuruganathan

Supervised deep learning methods are enjoying enormous success in many practical applications of computer vision and have the potential to revolutionize robotics. However, the marked performance degradation to biases and imbalanced data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Aadarsh Sahoo , Ankit Singh , Rameswar Panda , Rogerio Feris , Abir Das

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

When machine-learning algorithms are used in high-stakes decisions, we want to ensure that their deployment leads to fair and equitable outcomes. This concern has motivated a fast-growing literature that focuses on diagnosing and addressing…

Computers and Society · Computer Science 2023-09-26 Talia Gillis , Bryce McLaughlin , Jann Spiess

This paper investigates the relationships between hyperparameters of machine learning and fairness. Data-driven solutions are increasingly used in critical socio-technical applications where ensuring fairness is important. Rather than…

Software Engineering · Computer Science 2024-07-02 Salvador Robles Herrera , Verya Monjezi , Vladik Kreinovich , Ashutosh Trivedi , Saeid Tizpaz-Niari

Recent literature has suggested the potential of using large language models (LLMs) to make classifications for tabular tasks. However, LLMs have been shown to exhibit harmful social biases that reflect the stereotypes and inequalities…

Computation and Language · Computer Science 2024-04-04 Yanchen Liu , Srishti Gautam , Jiaqi Ma , Himabindu Lakkaraju

Machine learning actively impacts our everyday life in almost all endeavors and domains such as healthcare, finance, and energy. As our dependence on the machine learning increases, it is inevitable that these algorithms will be used to…

Machine Learning · Computer Science 2021-02-23 Ankit Kulshrestha , Ilya Safro

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

As machine learning (ML) algorithms are increasingly used in high-stakes applications, concerns have arisen that they may be biased against certain social groups. Although many approaches have been proposed to make ML models fair, they…

Machine Learning · Computer Science 2023-02-01 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

Machine learning (ML) algorithms play a critical role in decision-making across various domains, such as healthcare, finance, education, and law enforcement. However, concerns about fairness and bias in these systems have raised significant…

Machine Learning · Computer Science 2025-07-25 Ahmed Rashed , Abdelkrim Kallich , Mohamed Eltayeb

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

As the decisions made or influenced by machine learning models increasingly impact our lives, it is crucial to detect, understand, and mitigate unfairness. But even simply determining what "unfairness" should mean in a given context is…

Machine Learning · Computer Science 2020-10-16 Tom Begley , Tobias Schwedes , Christopher Frye , Ilya Feige

Machine learning models can capture and amplify biases present in data, leading to disparate test performance across social groups. To better understand, evaluate, and mitigate these biases, a deeper theoretical understanding of how model…

Machine Learning · Computer Science 2025-03-19 Arjun Subramonian , Samuel J. Bell , Levent Sagun , Elvis Dohmatob

As more industries integrate machine learning into socially sensitive decision processes like hiring, loan-approval, and parole-granting, we are at risk of perpetuating historical and contemporary socioeconomic disparities. This is a…

Computers and Society · Computer Science 2017-10-20 Niels Bantilan