English
Related papers

Related papers: FairTune: Optimizing Parameter Efficient Fine Tuni…

200 papers

Adapting pre-trained foundation models for diverse downstream tasks is a core practice in artificial intelligence. However, the wide range of tasks and high computational costs make full fine-tuning impractical. To overcome this,…

Machine Learning · Computer Science 2025-06-27 Chongjie Si , Zhiyi Shi , Xuehui Wang , Yichen Xiao , Xiaokang Yang , Wei Shen

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

In the realm of Medical Visual Language Models (Med-VLMs), the quest for universal efficient fine-tuning mechanisms remains paramount, especially given researchers in interdisciplinary fields are often extremely short of training resources,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Jiawei Chen , Dingkang Yang , Yue Jiang , Mingcheng Li , Jinjie Wei , Xiaolu Hou , Lihua Zhang

Ensuring fairness has emerged as one of the primary concerns in AI and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field…

Machine Learning · Computer Science 2024-11-15 Quan Zhou

Advancements in diffusion-based foundation models have improved text-to-image generation, yet most efforts have been limited to low-resolution settings. As high-resolution image synthesis becomes increasingly essential for various…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Zahra TehraniNasab , Amar Kumar , Tal Arbel

The increasing use of foundation models highlights the urgent need to address and eliminate implicit biases present in them that arise during pretraining. In this paper, we introduce PEFTDebias, a novel approach that employs…

Machine Learning · Computer Science 2023-12-04 Sumit Agarwal , Aditya Srikanth Veerubhotla , Srijan Bansal

Earth observation (EO) is crucial for monitoring environmental changes, responding to disasters, and managing natural resources. In this context, foundation models facilitate remote sensing image analysis to retrieve relevant geoinformation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Francesc Marti-Escofet , Benedikt Blumenstiel , Linus Scheibenreif , Paolo Fraccaro , Konrad Schindler

Reducing scan time in Positron Emission Tomography (PET) imaging while maintaining high-quality images is crucial for minimizing patient discomfort and radiation exposure. Due to the limited size of datasets and distribution discrepancy…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Yumin Kim , Gayoon Choi , Seong Jae Hwang

The emergence of large pre-trained networks has revolutionized the AI field, unlocking new possibilities and achieving unprecedented performance. However, these models inherit a fundamental limitation from traditional Machine Learning…

Fine-tuning pre-trained models has recently yielded remarkable performance gains in graph neural networks (GNNs). In addition to pre-training techniques, inspired by the latest work in the natural language fields, more recent work has…

Machine Learning · Computer Science 2023-12-12 Shengrui Li , Xueting Han , Jing Bai

Fine-tuning pre-trained models is a widely employed technique in numerous real-world applications. However, fine-tuning these models on new tasks can lead to unfair outcomes. This is due to the absence of generalization guarantees for…

Machine Learning · Computer Science 2024-03-04 Yixuan Zhang , Feng Zhou

Recent progress in generative AI, especially diffusion models, has demonstrated significant utility in text-to-image synthesis. Particularly in healthcare, these models offer immense potential in generating synthetic datasets and training…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yan Luo , Muhammad Osama Khan , Congcong Wen , Muhammad Muneeb Afzal , Titus Fidelis Wuermeling , Min Shi , Yu Tian , Yi Fang , Mengyu Wang

Fairness in machine learning is crucial when individuals are subject to automated decisions made by models in high-stake domains. Organizations that employ these models may also need to satisfy regulations that promote responsible and…

Machine Learning · Computer Science 2020-10-14 Shubham Sharma , Alan H. Gee , David Paydarfar , Joydeep Ghosh

Fairness is a crucial concern for generative models, which not only reflect but can also amplify societal and cultural biases. Existing fairness notions for generative models are largely adapted from classification and focus on balancing…

Machine Learning · Computer Science 2026-02-10 Alexandre Verine , Rafael Pinot , Florian Le Bronnec

Pre-trained models (PTMs) have achieved great success in various Software Engineering (SE) downstream tasks following the ``pre-train then fine-tune'' paradigm. As fully fine-tuning all parameters of PTMs can be computationally expensive, a…

Software Engineering · Computer Science 2023-12-27 Wentao Zou , Qi Li , Jidong Ge , Chuanyi Li , Xiaoyu Shen , Liguo Huang , Bin Luo

With the universal adoption of machine learning in healthcare, the potential for the automation of societal biases to further exacerbate health disparities poses a significant risk. We explore algorithmic fairness from the perspective of…

Machine Learning · Computer Science 2024-04-02 Md Rahat Shahriar Zawad , Peter Washington

The ethical integration of Artificial Intelligence (AI) in healthcare necessitates addressing fairness-a concept that is highly context-specific across medical fields. Extensive studies have been conducted to expand the technical components…

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAIM), to improve model…

Machine Learning · Computer Science 2024-03-11 Mingxuan Liu , Yilin Ning , Yuhe Ke , Yuqing Shang , Bibhas Chakraborty , Marcus Eng Hock Ong , Roger Vaughan , Nan Liu

The recent popularity of foundation models and the pre-train-and-adapt paradigm, where a large-scale model is transferred to downstream tasks, is gaining attention for volumetric medical image segmentation. However, current transfer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Julio Silva-Rodríguez , Jose Dolz , Ismail Ben Ayed