English
Related papers

Related papers: FAIRification of MLC data

200 papers

Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach…

Artificial Intelligence · Computer Science 2024-06-10 Wei Zhou , Hong Huang , Guowen Zhang , Ruize Shi , Kehan Yin , Yuanyuan Lin , Bang Liu

Multi-label classification (MLC) is a generalization of standard classification where multiple labels may be assigned to a given sample. In the real world, it is more common to deal with noisy datasets than clean datasets, given how modern…

Machine Learning · Computer Science 2021-02-18 Wenting Zhao , Carla Gomes

This paper presents fairlib, an open-source framework for assessing and improving classification fairness. It provides a systematic framework for quickly reproducing existing baseline models, developing new methods, evaluating models with…

Machine Learning · Computer Science 2022-05-05 Xudong Han , Aili Shen , Yitong Li , Lea Frermann , Timothy Baldwin , Trevor Cohn

In the era of big data, we are often facing the challenge of data heterogeneity and the lack of label information simultaneously. In the financial domain (e.g., fraud detection), the heterogeneous data may include not only numerical data…

Machine Learning · Computer Science 2023-02-14 Lecheng Zheng , Yada Zhu , Jingrui He

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

With the emerging needs of creating fairness-aware solutions for search and recommendation systems, a daunting challenge exists of evaluating such solutions. While many of the traditional information retrieval (IR) metrics can capture the…

Information Retrieval · Computer Science 2022-03-31 Ruoyuan Gao , Yingqiang Ge , Chirag Shah

Disaggregated performance metrics across demographic groups are a hallmark of fairness assessments in computer vision. These metrics successfully incentivized performance improvements on person-centric tasks such as face analysis and are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Melissa Hall , Bobbie Chern , Laura Gustafson , Denisse Ventura , Harshad Kulkarni , Candace Ross , Nicolas Usunier

Machine learning (ML) models often exhibit bias that can exacerbate inequities in biomedical applications. Fairness auditing, the process of evaluating a model's performance across subpopulations, is critical for identifying and mitigating…

Methodology · Statistics 2026-05-19 Jianhui Gao , Jessica Gronsbell

Machine learning (ML) is an increasingly important scientific tool supporting decision making and knowledge generation in numerous fields. With this, it also becomes more and more important that the results of ML experiments are…

Machine Learning · Computer Science 2020-06-23 Sheeba Samuel , Frank Löffler , Birgitta König-Ries

While the need for well-trained, fair ML systems is increasing ever more, measuring fairness for modern models and datasets is becoming increasingly difficult as they grow at an unprecedented pace. One key challenge in scaling common…

Artificial Intelligence · Computer Science 2022-01-19 Alex Bäuerle , Aybuke Gul Turker , Ken Burke , Osman Aka , Timo Ropinski , Christina Greer , Mani Varadarajan

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Multi-label learning is a rapidly growing research area that aims to predict multiple labels from a single input data point. In the era of big data, tasks involving multi-label classification (MLC) or ranking present significant and…

Machine Learning · Computer Science 2024-06-27 Adane Nega Tarekegn , Mohib Ullah , Faouzi Alaya Cheikh

Classification in the context of multi-label data streams represents a challenge that has attracted significant attention due to its high real-world applicability. However, this task faces problems inherent to dynamic environments, such as…

Machine Learning · Computer Science 2025-08-26 H. Freire-Oliveira , E. R. F. Paiva , J. Gama , L. Khan , R. Cerri

Classification is a fundamental task in machine learning. While conventional methods-such as binary, multiclass, and multi-label classification-are effective for simpler problems, they may not adequately address the complexities of some…

The explosive growth of data fuels data-driven research, facilitating progress across diverse domains. The FAIR principles emerge as a guiding standard, aiming to enhance the findability, accessibility, interoperability, and reusability of…

Computation and Language · Computer Science 2024-08-12 Tingyan Ma , Wei Liu , Bin Lu , Xiaoying Gan , Yunqiang Zhu , Luoyi Fu , Chenghu Zhou

As machine learning has become more prevalent, researchers have begun to recognize the necessity of ensuring machine learning systems are fair. Recently, there has been an interest in defining a notion of fairness that mitigates…

Data Structures and Algorithms · Computer Science 2020-06-22 Sara Ahmadian , Alessandro Epasto , Marina Knittel , Ravi Kumar , Mohammad Mahdian , Benjamin Moseley , Philip Pham , Sergei Vassilvitskii , Yuyan Wang

With the global increase in experimental data artifacts, harnessing them in a unified fashion leads to a major stumbling block - bad metadata. To bridge this gap, this work presents a Natural Language Processing (NLP) informed application,…

Computation and Language · Computer Science 2024-05-02 Sowmya S. Sundaram , Mark A. Musen

Reranking is a critical component in recommender systems, playing an essential role in refining the output of recommendation algorithms. Traditional reranking models have focused predominantly on accuracy, but modern applications demand…

Information Retrieval · Computer Science 2025-02-04 Jingtong Gao , Bo Chen , Weiwen Liu , Xiangyang Li , Yichao Wang , Wanyu Wang , Huifeng Guo , Ruiming Tang , Xiangyu Zhao

While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover…

Machine Learning · Computer Science 2024-09-26 Ahmet Kapkiç , Pratanu Mandal , Shu Wan , Paras Sheth , Abhinav Gorantla , Yoonhyuk Choi , Huan Liu , K. Selçuk Candan

As machine learning (ML) systems are increasingly adopted in high-stakes decision-making domains, ensuring fairness in their outputs has become a central challenge. At the core of fair ML research are the datasets used to investigate bias…

Machine Learning · Computer Science 2025-10-28 Jan Simson , Alessandro Fabris , Cosima Fröhner , Frauke Kreuter , Christoph Kern