English
Related papers

Related papers: Mitigating Bias in Visual Transformers via Targete…

200 papers

Transformers have been successfully used in various fields and are becoming the standard tools in computer vision. However, self-attention, a core component of transformers, has a quadratic complexity problem, which limits the use of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jiuk Hong , Chaehyeon Lee , Soyoun Bang , Heechul Jung

Algorithmic bias is of increasing concern, both to the research community, and society at large. Bias in AI is more abstract and unintuitive than traditional forms of discrimination and can be more difficult to detect and mitigate. A clear…

Machine Learning · Computer Science 2021-10-12 Cody Blakeney , Gentry Atkinson , Nathaniel Huish , Yan Yan , Vangelis Metris , Ziliang Zong

Training machine learning models with the only accuracy as a final goal may promote prejudices and discriminatory behaviors embedded in the data. One solution is to learn latent representations that fulfill specific fairness metrics.…

Machine Learning · Computer Science 2021-07-28 Patrik Joslin Kenfack , Adil Mehmood Khan , Rasheed Hussain , S. M. Ahsan Kazmi

Machine learning and data mining algorithms have been increasingly used recently to support decision-making systems in many areas of high societal importance such as healthcare, education, or security. While being very efficient in their…

Machine Learning · Computer Science 2020-11-02 Charlotte Laclau , Ievgen Redko , Manvi Choudhary , Christine Largeron

The task of Stance Detection involves discerning the stance expressed in a text towards a specific subject or target. Prior works have relied on existing transformer models that lack the capability to prioritize targets effectively.…

Computation and Language · Computer Science 2024-10-10 Krishna Garg , Cornelia Caragea

Fine-tuning pre-trained models is a widely employed technique in numerous real-world applications. However, fine-tuning these models on new tasks can lead to unfair outcomes. This is due to the absence of generalization guarantees for…

Machine Learning · Computer Science 2024-03-04 Yixuan Zhang , Feng Zhou

Most calibration methods operate at the logit level, implicitly assuming that miscalibration can be corrected without changing the underlying representation. We challenge this assumption and propose \textbf{Calibration Attention (CalAttn)},…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Wenhao Liang , Wei Emma Zhang , Lin Yue , Miao Xu , Mingyu Guo , Olaf Maennel , Weitong Chen

Transformers have transformed modern machine learning, driving breakthroughs in computer vision, natural language processing, and robotics. At the core of their success lies the attention mechanism, which enables the modeling of global…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Hemanth Saratchandran , Simon Lucey

Labeled datasets reflect the biases of their annotation pipelines, which sometimes introduce label bias: group-conditional label errors that cause systematic performance disparities across demographic subgroups. Label bias in image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Aditya Parikh , Stella Frank , Sneha Das , Aasa Feragen

Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairness (i.e.,…

Machine Learning · Computer Science 2021-07-30 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang , Guoliang Dong , Xingen Wang , Ting Dai , Jin Song Dong

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

With the growing adoption of Text-to-Image (TTI) systems, the social biases of these models have come under increased scrutiny. Herein we conduct a systematic investigation of one such source of bias for diffusion models: embedding spaces.…

Machine Learning · Computer Science 2024-09-17 Sahil Kuchlous , Marvin Li , Jeffrey G. Wang

Vision transformers (ViTs) are emerging with significantly improved accuracy in computer vision tasks. However, their complex architecture and enormous computation/storage demand impose urgent needs for new hardware accelerator design…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Zhengang Li , Mengshu Sun , Alec Lu , Haoyu Ma , Geng Yuan , Yanyue Xie , Hao Tang , Yanyu Li , Miriam Leeser , Zhangyang Wang , Xue Lin , Zhenman Fang

Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Zeyu Wang , Klint Qinami , Ioannis Christos Karakozis , Kyle Genova , Prem Nair , Kenji Hata , Olga Russakovsky

Fairness,the impartial treatment towards individuals or groups regardless of their inherent or acquired characteristics [20], is a critical challenge for the successful implementation of Artificial Intelligence (AI) in multiple fields like…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Catalina M Jaramillo , Paul Squires , Julian Togelius

Virtual facial avatars will play an increasingly important role in immersive communication, games and the metaverse, and it is therefore critical that they be inclusive. This requires accurate recovery of the appearance, represented by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Haiwen Feng , Timo Bolkart , Joachim Tesch , Michael J. Black , Victoria Abrevaya

As Vision Transformers (ViTs) increasingly set new benchmarks in computer vision, their practical deployment on inference engines is often hindered by their significant memory bandwidth and (on-chip) memory footprint requirements. This…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Seyedarmin Azizi , Mahdi Nazemi , Massoud Pedram

Model editing techniques, particularly task arithmetic with task vectors, offer an efficient alternative to full fine-tuning by enabling direct parameter updates through simple arithmetic operations. While this approach promises substantial…

Machine Learning · Computer Science 2026-02-13 Hiroki Naganuma , Kotaro Yoshida , Laura Gomezjurado Gonzalez , Takafumi Horie , Yuji Naraki , Ryotaro Shimizu