English
Related papers

Related papers: FairBranch: Mitigating Bias Transfer in Fair Multi…

200 papers

Machine learning models are trained to minimize the mean loss for a single metric, and thus typically do not consider fairness and robustness. Neglecting such metrics in training can make these models prone to fairness violations when…

Machine Learning · Computer Science 2022-07-21 Bobby Yan , Skyler Seto , Nicholas Apostoloff

Transfer learning eases the burden of training a well-performed model from scratch, especially when training data is scarce and computation power is limited. In deep learning, a typical strategy for transfer learning is to freeze the early…

Machine Learning · Computer Science 2021-06-15 Dian Chen , Hongxin Hu , Qian Wang , Yinli Li , Cong Wang , Chao Shen , Qi Li

Recent work has found that multi-task training with a large number of diverse tasks can uniformly improve downstream performance on unseen target tasks. In contrast, literature on task transferability has established that the choice of…

Computation and Language · Computer Science 2022-07-13 Vishakh Padmakumar , Leonard Lausen , Miguel Ballesteros , Sheng Zha , He He , George Karypis

Training models with robust group fairness properties is crucial in ethically sensitive application areas such as medical diagnosis. Despite the growing body of work aiming to minimise demographic bias in AI, this problem remains…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raman Dutt , Ondrej Bohdal , Sotirios A. Tsaftaris , Timothy Hospedales

In recent years fairness in machine learning (ML) has emerged as a highly active area of research and development. Most define fairness in simple terms, where fairness means reducing gaps in performance or outcomes between demographic…

Artificial Intelligence · Computer Science 2023-03-14 Brent Mittelstadt , Sandra Wachter , Chris Russell

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

Vision-Language Models (VLMs) perform well on multimodal benchmarks but lag behind humans and specialized models on visual perception tasks like depth estimation or object counting. Finetuning on one task can unpredictably affect…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bhuvan Sachdeva , Karan Uppal , Abhinav Java , Vineeth N. Balasubramanian

The issue of fairness in machine learning models has recently attracted a lot of attention as ensuring it will ensure continued confidence of the general public in the deployment of machine learning systems. We focus on mitigating the harm…

Machine Learning · Statistics 2021-02-24 Thomas Kehrenberg , Zexun Chen , Novi Quadrianto

Resilience to class imbalance and confounding biases, together with the assurance of fairness guarantees are highly desirable properties of autonomous decision-making systems with real-life impact. Many different targeted solutions have…

Machine Learning · Computer Science 2021-05-14 Elisa Ferrari , Davide Bacciu

Knowledge transfer in multi-task learning is typically viewed as a dichotomy; positive transfer, which improves the performance of all tasks, or negative transfer, which hinders the performance of all tasks. In this paper, we investigate…

Machine Learning · Computer Science 2024-10-22 Olivier Graffeuille , Yun Sing Koh , Joerg Wicker , Moritz Lehmann

Recent literature has suggested the potential of using large language models (LLMs) to make classifications for tabular tasks. However, LLMs have been shown to exhibit harmful social biases that reflect the stereotypes and inequalities…

Computation and Language · Computer Science 2024-04-04 Yanchen Liu , Srishti Gautam , Jiaqi Ma , Himabindu Lakkaraju

Deep learning models, particularly Convolutional Neural Networks (CNNs), have demonstrated exceptional performance in diagnosing skin diseases, often outperforming dermatologists. However, they have also unveiled biases linked to specific…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Anshul Pundhir , Balasubramanian Raman , Pravendra Singh

At the intersection of the cutting-edge technologies and privacy concerns, Federated Learning (FL) with its distributed architecture, stands at the forefront in a bid to facilitate collaborative model training across multiple clients while…

Machine Learning · Computer Science 2025-09-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Purpose: Surgery scene understanding with tool-tissue interaction recognition and automatic report generation can play an important role in intra-operative guidance, decision-making and postoperative analysis in robotic surgery. However,…

Artificial Intelligence · Computer Science 2022-11-29 Lalithkumar Seenivasan , Mobarakol Islam , Mengya Xu , Chwee Ming Lim , Hongliang Ren

Fairness-aware learning aims to mitigate discrimination against specific protected social groups (e.g., those categorized by gender, ethnicity, age) while minimizing predictive performance loss. Despite efforts to improve fairness in…

Machine Learning · Computer Science 2025-05-02 Kewen Peng , Yicheng Yang , Hao Zhuo

Class imbalance is a common challenge in many NLP tasks, and has clear connections to bias, in that bias in training data often leads to higher accuracy for majority groups at the expense of minority groups. However there has traditionally…

Computation and Language · Computer Science 2021-09-23 Shivashankar Subramanian , Afshin Rahimi , Timothy Baldwin , Trevor Cohn , Lea Frermann

While multi-task learning (MTL) has gained significant attention in recent years, its underlying mechanisms remain poorly understood. Recent methods did not yield consistent performance improvements over single task learning (STL)…

Machine Learning · Computer Science 2024-08-16 Cathrin Elich , Lukas Kirchdorfer , Jan M. Köhler , Lukas Schott

Transfer Learning (TL) aims to transfer knowledge acquired in one problem, the source problem, onto another problem, the target problem, dispensing with the bottom-up construction of the target model. Due to its relevance, TL has gained…

Machine Learning · Computer Science 2017-12-07 Ricardo Gamelas Sousa , Luís A. Alexandre , Jorge M. Santos , Luís M. Silva , Joaquim Marques de Sá

Multi-task learning (MTL) allows deep neural networks to learn from related tasks by sharing parameters with other networks. In practice, however, MTL involves searching an enormous space of possible parameter sharing architectures to find…

Machine Learning · Statistics 2018-11-20 Sebastian Ruder , Joachim Bingel , Isabelle Augenstein , Anders Søgaard