English
Related papers

Related papers: Visual Data Diagnosis and Debiasing with Concept G…

200 papers

Addressing biases in computer vision models is crucial for real-world AI deployments. However, mitigating visual biases is challenging due to their unexplainable nature, often identified indirectly through visualization or sample…

Machine Learning · Computer Science 2024-03-28 Younghyun Kim , Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jaeho Lee , Jinwoo Shin

A recent study has shown that large-scale visual datasets are very biased: they can be easily classified by modern neural networks. However, the concrete forms of bias among these datasets remain unclear. In this study, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Boya Zeng , Yida Yin , Zhuang Liu

Deep neural networks trained on biased data often inadvertently learn unintended inference rules, particularly when labels are strongly correlated with biased features. Existing bias mitigation methods typically involve either a)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Rajeev Ranjan Dwivedi , Priyadarshini Kumari , Vinod K Kurmi

ConvNets and Imagenet have driven the recent success of deep learning for image classification. However, the marked slowdown in performance improvement combined with the lack of robustness of neural networks to adversarial examples and…

Machine Learning · Computer Science 2018-07-23 Pierre Stock , Moustapha Cisse

Most existing debiasing methods for multimodal models, including causal intervention and inference methods, utilize approximate heuristics to represent the biases, such as shallow features from early stages of training or unimodal features…

Machine Learning · Computer Science 2023-11-29 Vaidehi Patil , Adyasha Maharana , Mohit Bansal

Existing multi-view learning models struggle in open-set scenarios due to their implicit assumption of class completeness. Moreover, static view-induced biases, which arise from spurious view-label associations formed during training,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zihan Fang , Zhiyong Xu , Lan Du , Shide Du , Zhiling Cai , Shiping Wang

Stance detection models may tend to rely on dataset bias in the text part as a shortcut and thus fail to sufficiently learn the interaction between the targets and texts. Recent debiasing methods usually treated features learned by small…

Computation and Language · Computer Science 2022-12-21 Jianhua Yuan , Yanyan Zhao , Bing Qin

Image classifiers often rely overly on peripheral attributes that have a strong correlation with the target class (i.e., dataset bias) when making predictions. Due to the dataset bias, the model correctly classifies data samples including…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jungsoo Lee , Juyoung Lee , Sanghun Jung , Jaegul Choo

Image classification models tend to make decisions based on peripheral attributes of data items that have strong correlation with a target variable (i.e., dataset bias). These biased models suffer from the poor generalization capability…

Machine Learning · Computer Science 2021-10-26 Jungsoo Lee , Eungyeup Kim , Juyoung Lee , Jihyeon Lee , Jaegul Choo

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

Machine Learning · Computer Science 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates

With the recent growth in computer vision applications, the question of how fair and unbiased they are has yet to be explored. There is abundant evidence that the bias present in training data is reflected in the models, or even amplified.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Amirarsalan Rajabi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay , Gita Sukthankar

Recommender systems rely on user behavior data like ratings and clicks to build personalization model. However, the collected data is observational rather than experimental, causing various biases in the data which significantly affect the…

Machine Learning · Computer Science 2021-10-29 Jiawei Chen , Hande Dong , Yang Qiu , Xiangnan He , Xin Xin , Liang Chen , Guli Lin , Keping Yang

Supervised deep learning methods are enjoying enormous success in many practical applications of computer vision and have the potential to revolutionize robotics. However, the marked performance degradation to biases and imbalanced data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Aadarsh Sahoo , Ankit Singh , Rameswar Panda , Rogerio Feris , Abir Das

While deep learning models often achieve strong task performance, their successes are hampered by their inability to disentangle spurious correlations from causative factors, such as when they use protected attributes (e.g., race, gender,…

Machine Learning · Computer Science 2020-11-17 Kurtis Evan David , Qiang Liu , Ruth Fong

Deep learning model effectiveness in classification tasks is often challenged by the quality and quantity of training data whenever they are affected by strong spurious correlations between specific attributes and target labels. This…

Deep neural networks (DNNs), while increasingly deployed in many applications, struggle with robustness against anomalous and out-of-distribution (OOD) data. Current OOD benchmarks often oversimplify, focusing on single-object tasks and not…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Debargha Ganguly , Debayan Gupta , Vipin Chaudhary

Contextual information is a valuable cue for Deep Neural Networks (DNNs) to learn better representations and improve accuracy. However, co-occurrence bias in the training dataset may hamper a DNN model's generalizability to unseen scenarios…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sharat Agarwal , Sumanyu Muku , Saket Anand , Chetan Arora

Bias discovery is critical for black-box generative models, especiall text-to-image (TTI) models. Existing works predominantly focus on output-level demographic distributions, which do not necessarily guarantee concept representations to be…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Rajatsubhra Chakraborty , Xujun Che , Depeng Xu , Cori Faklaris , Xi Niu , Shuhan Yuan

Deep neural networks often struggle to learn robust representations in the presence of dataset biases, leading to suboptimal generalization on unbiased datasets. This limitation arises because the models heavily depend on peripheral and…

Machine Learning · Computer Science 2024-12-11 Carlo Alberto Barbano , Enzo Tartaglione , Marco Grangetto

Concept drift is the phenomenon in which the underlying data distributions and statistical properties of a target domain change over time, leading to a degradation in model performance. Consequently, production models require continuous…

Machine Learning · Computer Science 2025-08-07 Salvatore Greco , Bartolomeo Vacchetti , Daniele Apiletti , Tania Cerquitelli