English
Related papers

Related papers: Are Bias Mitigation Techniques for Deep Learning E…

200 papers

Fault-tolerant deep learning accelerator is the basis for highly reliable deep learning processing and critical to deploy deep learning in safety-critical applications such as avionics and robotics. Since deep learning is known to be…

Hardware Architecture · Computer Science 2023-12-22 Qing Zhang , Cheng Liu , Bo Liu , Haitong Huang , Ying Wang , Huawei Li , Xiaowei Li

Dataset Distillation has emerged as a technique for compressing large datasets into smaller synthetic counterparts, facilitating downstream training tasks. In this paper, we study the impact of bias inside the original dataset on the…

Machine Learning · Computer Science 2024-07-11 Justin Cui , Ruochen Wang , Yuanhao Xiong , Cho-Jui Hsieh

Although deep learning models have taken on commercial and political relevance, key aspects of their training and operation remain poorly understood. This has sparked interest in science of deep learning projects, many of which require…

Machine Learning · Computer Science 2024-06-06 Sam Greydanus , Dmitry Kobak

Machine learning systems are often trained using data collected from historical decisions. If past decisions were biased, then automated systems that learn from historical data will also be biased. We propose a black-box approach to…

Machine Learning · Computer Science 2021-02-08 Sahil Verma , Michael Ernst , Rene Just

Unintended bias in Machine Learning can manifest as systemic differences in performance for different demographic groups, potentially compounding existing challenges to fairness in society at large. In this paper, we introduce a suite of…

Machine Learning · Computer Science 2019-05-09 Daniel Borkan , Lucas Dixon , Jeffrey Sorensen , Nithum Thain , Lucy Vasserman

The presence of decision-making algorithms in society is rapidly increasing nowadays, while concerns about their transparency and the possibility of these algorithms becoming new sources of discrimination are arising. In fact, many relevant…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Alejandro Peña , Ignacio Serna , Aythami Morales , Julian Fierrez

Bias in AI/ML-based systems is a ubiquitous problem and bias in AI/ML systems may negatively impact society. There are many reasons behind a system being biased. The bias can be due to the algorithm we are using for our problem or may be…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Vedant V. Kandge , Siddhant V. Kandge , Kajal Kumbharkar , Tanuja Pattanshetti

Fairness is a critical requirement for Machine Learning (ML) software, driving the development of numerous bias mitigation methods. Previous research has identified a leveling-down effect in bias mitigation for computer vision and natural…

Machine Learning · Computer Science 2025-08-06 Zhenpeng Chen , Xinyue Li , Jie M. Zhang , Weisong Sun , Ying Xiao , Tianlin Li , Yiling Lou , Yang Liu

Despite its astounding success in learning deeper multi-dimensional data, the performance of deep learning declines on new unseen tasks mainly due to its focus on same-distribution prediction. Moreover, deep learning is notorious for poor…

Machine Learning · Computer Science 2023-03-15 Hassan Gharoun , Fereshteh Momenifar , Fang Chen , Amir H. Gandomi

In spite of the high performance and reliability of deep learning algorithms in a wide range of everyday applications, many investigations tend to show that a lot of models exhibit biases, discriminating against specific subgroups of the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Jean-Rémy Conti , Nathan Noiry , Vincent Despiegel , Stéphane Gentric , Stéphan Clémençon

Deep learning models have achieved excellent recognition results on large-scale video benchmarks. However, they perform poorly when applied to videos with rare scenes or objects, primarily due to the bias of existing video datasets. We…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Haodong Duan , Yue Zhao , Kai Chen , Yuanjun Xiong , Dahua Lin

As deep learning models continue to advance and are increasingly utilized in real-world systems, the issue of robustness remains a major challenge. Existing certified training methods produce models that achieve high provable robustness…

Machine Learning · Computer Science 2023-07-26 Zhakshylyk Nurlanov , Frank R. Schmidt , Florian Bernard

The training phase is the most important stage during the machine learning process. In the case of labeled data and supervised learning, machine training consists in minimizing the loss function subject to different constraints. In an…

Machine Learning · Computer Science 2021-12-03 Davide La Torre , Danilo Liuzzi , Marco Repetto , Matteo Rocca

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

The deep neural network (DNN) has been proven effective in various domains. However, they often struggle to perform well on certain minority groups during inference, despite showing strong performance on the majority of data groups. This is…

Machine Learning · Computer Science 2023-12-11 Jiaxu Zhao , Lu Yin , Shiwei Liu , Meng Fang , Mykola Pechenizkiy

The accuracy and fairness of perception systems in autonomous driving are essential, especially for vulnerable road users such as cyclists, pedestrians, and motorcyclists who face significant risks in urban driving environments. While…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Dewant Katare , David Solans Noguero , Souneil Park , Nicolas Kourtellis , Marijn Janssen , Aaron Yi Ding

Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden…

Machine Learning · Computer Science 2023-01-31 Gianluigi Pillonetto , Aleksandr Aravkin , Daniel Gedon , Lennart Ljung , Antônio H. Ribeiro , Thomas B. Schön

This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the…

Machine Learning · Computer Science 2023-02-28 Wei Cui , Wei Yu

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and…

Machine Learning · Computer Science 2018-07-23 Pierre Stock , Moustapha Cisse

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati