English
Related papers

Related papers: Towards Accuracy-Fairness Paradox: Adversarial Exa…

200 papers

Denoising diffusion models have emerged as a dominant approach for image generation, however they still suffer from slow convergence in training and color shift issues in sampling. In this paper, we identify that these obstacles can be…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Hu Yu , Li Shen , Jie Huang , Hongsheng Li , Feng Zhao

Models trained on datasets with texture bias usually perform poorly on out-of-distribution samples since biased representations are embedded into the model. Recently, various image translation and debiasing methods have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Myeongkyun Kang , Dongkyu Won , Miguel Luna , Philip Chikontwe , Kyung Soo Hong , June Hong Ahn , Sang Hyun Park

Mitigating bias in training on biased datasets is an important open problem. Several techniques have been proposed, however the typical evaluation regime is very limited, considering very narrow data conditions. For instance, the effect of…

Machine Learning · Computer Science 2022-10-18 Xudong Han , Aili Shen , Trevor Cohn , Timothy Baldwin , Lea Frermann

Adversarial training is the industry standard for producing models that are robust to small adversarial perturbations. However, machine learning practitioners need models that are robust to other kinds of changes that occur naturally, such…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Manli Shu , Zuxuan Wu , Micah Goldblum , Tom Goldstein

Algorithmic fairness has become an important machine learning problem, especially for mission-critical Web applications. This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race…

Machine Learning · Computer Science 2023-03-16 Sungwon Han , Seungeon Lee , Fangzhao Wu , Sundong Kim , Chuhan Wu , Xiting Wang , Xing Xie , Meeyoung Cha

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Image retrieval is a crucial research topic in computer vision, with broad application prospects ranging from online product searches to security surveillance systems. In recent years, the accuracy and efficiency of image retrieval have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Kim Jinwoo

We investigate the prominent class of fair representation learning methods for bias mitigation. Using causal reasoning to define and formalise different sources of dataset bias, we reveal important implicit assumptions inherent to these…

Machine Learning · Computer Science 2025-02-11 Charles Jones , Fabio de Sousa Ribeiro , Mélanie Roschewitz , Daniel C. Castro , Ben Glocker

Computer vision algorithms, e.g. for face recognition, favour groups of individuals that are better represented in the training data. This happens because of the generalization that classifiers have to make. It is simpler to fit the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Viktoriia Sharmanska , Lisa Anne Hendricks , Trevor Darrell , Novi Quadrianto

Speaker recognition is increasingly used in several everyday applications including smart speakers, customer care centers and other speech-driven analytics. It is crucial to accurately evaluate and mitigate biases present in machine…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Raghuveer Peri , Krishna Somandepalli , Shrikanth Narayanan

Interpretability and fairness are critical in computer vision and machine learning applications, in particular when dealing with human outcomes, e.g. inviting or not inviting for a job interview based on application materials that may…

Machine Learning · Computer Science 2019-04-12 Novi Quadrianto , Viktoriia Sharmanska , Oliver Thomas

Machine learning techniques are immensely deployed in both industry and academy. Recent studies indicate that machine learning models used for classification tasks are vulnerable to adversarial examples, which limits the usage of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yutong Gao , Yi Pan

With the rise in popularity of machine and deep learning models, there is an increased focus on their vulnerability to malicious inputs. These adversarial examples drift model predictions away from the original intent of the network and are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Richard Tran , David Patrick , Michael Geyer , Amanda Fernandez

Compared with traditional machine learning models, deep neural networks perform better, especially in image classification tasks. However, they are vulnerable to adversarial examples. Adding small perturbations on examples causes a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Zifei Zhang , Kai Qiao , Lingyun Jiang , Linyuan Wang , Bin Yan

The issue of group fairness in machine learning models, where certain sub-populations or groups are favored over others, has been recognized for some time. While many mitigation strategies have been proposed in centralized learning, many of…

Machine Learning · Computer Science 2023-05-18 Ganghua Wang , Ali Payani , Myungjin Lee , Ramana Kompella

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

Neural networks are known to be vulnerable to carefully crafted adversarial examples, and these malicious samples often transfer, i.e., they maintain their effectiveness even against other models. With great efforts delved into the…

Machine Learning · Computer Science 2019-05-10 Yunhan Jia , Yantao Lu , Senem Velipasalar , Zhenyu Zhong , Tao Wei

In spite of the successful application in many fields, machine learning models today suffer from notorious problems like vulnerability to adversarial examples. Beyond falling into the cat-and-mouse game between adversarial attack and…

Artificial Intelligence · Computer Science 2022-07-06 Jitao Sang , Xian Zhao , Jiaming Zhang , Zhiyu Lin

We introduce the concept of deceptive diffusion -- training a generative AI model to produce adversarial images. Whereas a traditional adversarial attack algorithm aims to perturb an existing image to induce a misclassificaton, the…

Machine Learning · Computer Science 2024-07-01 Lucas Beerens , Catherine F. Higham , Desmond J. Higham

Large pre-trained vision-language models (VLMs) reduce the time for developing predictive models for various vision-grounded language downstream tasks by providing rich, adaptable image and text representations. However, these models suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ashish Seth , Mayur Hemani , Chirag Agarwal