English
Related papers

Related papers: FairTune: Optimizing Parameter Efficient Fine Tuni…

200 papers

Equity in AI for healthcare is crucial due to its direct impact on human well-being. Despite advancements in 2D medical imaging fairness, the fairness of 3D models remains underexplored, hindered by the small sizes of 3D fairness datasets.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yan Luo , Muhammad Osama Khan , Yu Tian , Min Shi , Zehao Dou , Tobias Elze , Yi Fang , Mengyu Wang

Automated Program Repair (APR) aims to fix bugs by generating patches. And existing work has demonstrated that "pre-training and fine-tuning" paradigm enables Large Language Models (LLMs) improve fixing capabilities on APR. However,…

Software Engineering · Computer Science 2024-09-13 Guochang Li , Chen Zhi , Jialiang Chen , Junxiao Han , Shuiguang Deng

Parameter-efficient fine-tuning (PEFT) adapts large pre-trained models by updating only a small subset of parameters. Recently, Representation Fine-Tuning (ReFT) has emerged as an effective alternative. ReFT shifts the fine-tuning paradigm…

Machine Learning · Computer Science 2025-12-24 Fatema Siddika , Md Anwar Hossen , J. Pablo Muñoz , Tanya Roosta , Anuj Sharma , Ali Jannesari

Multi-modal models excel in cross-modal tasks but are computationally expensive due to their billions of parameters. Parameter-efficient fine-tuning (PEFT) offers a solution by adding small trainable components while freezing pre-trained…

Machine Learning · Computer Science 2025-03-27 Sashuai Zhou , Hai Huang , Yan Xia

AI-based image reconstruction models are increasingly deployed in clinical workflows to improve image quality from noisy data, such as low-dose X-rays or accelerated MRI scans. However, these models are typically evaluated using pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Matteo Wohlrapp , Niklas Bubeck , Daniel Rueckert , William Lotter

The pursuit of fairness in machine learning models has emerged as a critical research challenge in different applications ranging from bank loan approval to face detection. Despite the widespread adoption of artificial intelligence…

Machine Learning · Computer Science 2023-11-08 Modar Sulaiman , Kallol Roy

Parameter Efficient Fine-Tuning (PEFT) techniques have drawn significant attention due to their ability to yield competitive results while updating only a small portion of the adjustable parameters. However, existing PEFT methods pose…

Machine Learning · Computer Science 2024-06-04 Muling Wu , Wenhao Liu , Xiaohua Wang , Tianlong Li , Changze Lv , Zixuan Ling , Jianhao Zhu , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

Parameter-Efficient Fine-tuning (PEFT) facilitates the fine-tuning of Large Language Models (LLMs) under limited resources. However, the fine-tuning performance with PEFT on complex, knowledge-intensive tasks is limited due to the…

Computation and Language · Computer Science 2024-06-10 Jitai Hao , WeiWei Sun , Xin Xin , Qi Meng , Zhumin Chen , Pengjie Ren , Zhaochun Ren

The use of artificial intelligence (AI) in automated disease classification significantly reduces healthcare costs and improves the accessibility of services. However, this transformation has given rise to concerns about the fairness of AI,…

Machine Learning · Computer Science 2024-12-04 Leila Gheisi , Henry Chu , Raju Gottumukkala , Yan Luo , Xingquan Zhu , Mengyu Wang , Min Shi

Over the past decades, computer-aided diagnosis tools for breast cancer have been developed to enhance screening procedures, yet their clinical adoption remains challenged by data variability and inherent biases. Although foundation models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Elodie Germani , Ilayda Selin Türk , Fatima Zeineddine , Charbel Mourad , Shadi Albarqouni

In the past few years, Artificial Intelligence (AI) has garnered attention from various industries including financial services (FS). AI has made a positive impact in financial services by enhancing productivity and improving risk…

Achieving fairness in text-to-image generation demands mitigating social biases without compromising visual fidelity, a challenge critical to responsible AI. Current fairness evaluation procedures for text-to-image models rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marco N. Bochernitsan , Rodrigo C. Barros , Lucas S. Kupssinskü

The persistent challenge of bias in machine learning models necessitates robust solutions to ensure parity and equal treatment across diverse groups, particularly in classification tasks. Current methods for mitigating bias often result in…

While deep learning (DL) approaches are reaching human-level performance for many tasks, including for diagnostics AI, the focus is now on challenges possibly affecting DL deployment, including AI privacy, domain generalization, and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Neil Joshi , Phil Burlina

Large pretrained language models are widely used in downstream NLP tasks via task-specific fine-tuning, but such procedures can be costly. Recently, Parameter-Efficient Fine-Tuning (PEFT) methods have achieved strong task performance while…

Computation and Language · Computer Science 2024-01-30 Han Zhou , Xingchen Wan , Ivan Vulić , Anna Korhonen

Parameter-efficient fine-tuning methods (PEFTs) offer the promise of adapting large pre-trained models while only tuning a small number of parameters. They have been shown to be competitive with full model fine-tuning for many downstream…

Computation and Language · Computer Science 2022-10-25 Ahmet Üstün , Asa Cooper Stickland

Algorithmic fairness has emerged as an important consideration when using machine learning to make high-stakes societal decisions. Yet, improved fairness often comes at the expense of model accuracy. While aspects of the fairness-accuracy…

Machine Learning · Statistics 2022-06-02 Camille Olivia Little , Michael Weylandt , Genevera I Allen

Parameter Efficient Fine-Tuning (PEFT) methods have emerged as effective and promising approaches for fine-tuning pre-trained language models. Compared with Full parameter Fine-Tuning (FFT), PEFT achieved comparable task performance with a…

Machine Learning · Computer Science 2025-06-10 Tongzhou Yu , Zhuhao Zhang , Guanghui Zhu , Shen Jiang , Meikang Qiu , Yihua Huang

Recently, the research community of computerized medical imaging has started to discuss and address potential fairness issues that may emerge when developing and deploying AI systems for medical image analysis. This chapter covers some of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Enzo Ferrante , Rodrigo Echeveste

We introduce equi-tuning, a novel fine-tuning method that transforms (potentially non-equivariant) pretrained models into group equivariant models while incurring minimum $L_2$ loss between the feature representations of the pretrained and…