English
Related papers

Related papers: The Trade-off between Performance, Efficiency, and…

200 papers

Mainstream Natural Language Processing (NLP) research has ignored the majority of the world's languages. In moving from excluding the majority of the world's languages to blindly adopting what we make for English, we first risk importing…

Computation and Language · Computer Science 2024-11-08 Hellina Hailu Nigatu , Zeerak Talat

Existing bias mitigation methods to reduce disparities in model outcomes across cohorts have focused on data augmentation, debiasing model embeddings, or adding fairness-based optimization objectives during training. Separately, certified…

Computation and Language · Computer Science 2021-06-22 Yada Pruksachatkun , Satyapriya Krishna , Jwala Dhamala , Rahul Gupta , Kai-Wei Chang

Existing works show that augmenting the training data of pre-trained language models (PLMs) for classification tasks fine-tuned via parameter-efficient fine-tuning methods (PEFT) using both clean and adversarial examples can enhance their…

Computation and Language · Computer Science 2024-06-18 Tuc Nguyen , Thai Le

Moral alignment has emerged as a widely adopted approach for regulating the behavior of pretrained language models (PLMs), typically through fine-tuning on curated datasets. Gender stereotype mitigation is a representational task within the…

Computation and Language · Computer Science 2025-11-21 Guangliang Liu , Bocheng Chen , Han Zi , Xitong Zhang , Kristen Marie Johnson

With excellent generalization ability, self-supervised speech models have shown impressive performance on various downstream speech tasks in the pre-training and fine-tuning paradigm. However, as the growing size of pre-trained models,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-04 Mufan Sang , John H. L. Hansen

The remarkable performance of deep learning models and their applications in consequential domains (e.g., facial recognition) introduces important challenges at the intersection of equity and security. Fairness and robustness are two…

Machine Learning · Computer Science 2022-11-24 Cuong Tran , Keyu Zhu , Ferdinando Fioretto , Pascal Van Hentenryck

Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairness (i.e.,…

Machine Learning · Computer Science 2021-07-30 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang , Guoliang Dong , Xingen Wang , Ting Dai , Jin Song Dong

A central goal of algorithmic fairness is to reduce bias in automated decision making. An unavoidable tension exists between accuracy gains obtained by using sensitive information (e.g., gender or ethnic group) as part of a statistical…

Machine Learning · Statistics 2020-02-03 Luca Oneto , Michele Donini , Amon Elders , Massimiliano Pontil

Despite the rapid development and great success of machine learning models, extensive studies have exposed their disadvantage of inheriting latent discrimination and societal bias from the training data. This phenomenon hinders their…

Machine Learning · Computer Science 2021-12-30 Tianxiang Zhao , Enyan Dai , Kai Shu , Suhang Wang

Existing research mostly improves the fairness of Machine Learning (ML) software regarding a single protected attribute at a time, but this is unrealistic given that many users have multiple protected attributes. This paper conducts an…

Machine Learning · Computer Science 2024-04-05 Zhenpeng Chen , Jie M. Zhang , Federica Sarro , Mark Harman

Rapid advancements of large language models (LLMs) have enabled the processing, understanding, and generation of human-like text, with increasing integration into systems that touch our social sphere. Despite this success, these models can…

Computation and Language · Computer Science 2024-07-16 Isabel O. Gallegos , Ryan A. Rossi , Joe Barrow , Md Mehrab Tanjim , Sungchul Kim , Franck Dernoncourt , Tong Yu , Ruiyi Zhang , Nesreen K. Ahmed

In dimensionality reduction problems, the adopted technique may produce disparities between the representation errors of different groups. For instance, in the projected space, a specific class can be better represented in comparison with…

Machine Learning · Computer Science 2022-10-04 Guilherme D. Pelegrina , Renan D. B. Brotto , Leonardo T. Duarte , Romis Attux , João M. T. Romano

Fairness and environmental impact are important research directions for the sustainable development of artificial intelligence. However, while each topic is an active research area in natural language processing (NLP), there is a surprising…

Computation and Language · Computer Science 2022-11-09 Marius Hessenthaler , Emma Strubell , Dirk Hovy , Anne Lauscher

Existing NLP datasets contain various biases, and models tend to quickly learn those biases, which in turn limits their robustness. Existing approaches to improve robustness against dataset biases mostly focus on changing the training…

Computation and Language · Computer Science 2020-10-26 Nafise Sadat Moosavi , Marcel de Boer , Prasetya Ajie Utama , Iryna Gurevych

Deploying natural language processing (NLP) models on mobile platforms requires models that can adapt across diverse applications while remaining efficient in memory and computation. We investigate pre-finetuning strategies to enhance the…

Computation and Language · Computer Science 2025-10-10 Junyi Zhu , Savas Ozkan , Andrea Maracani , Sinan Mutlu , Cho Jung Min , Mete Ozay

The rise of generative artificial intelligence, particularly Large Language Models (LLMs), has intensified the imperative to scrutinize fairness alongside accuracy. Recent studies have begun to investigate fairness evaluations for LLMs…

Information Retrieval · Computer Science 2024-08-31 Chandan Kumar Sah , Lian Xiaoli , Muhammad Mirajul Islam

Whereas previous post-processing approaches for increasing the fairness of predictions of biased classifiers address only group fairness, we propose a method for increasing both individual and group fairness. Our novel framework includes an…

Models for natural language understanding (NLU) tasks often rely on the idiosyncratic biases of the dataset, which make them brittle against test cases outside the training distribution. Recently, several proposed debiasing methods are…

Computation and Language · Computer Science 2020-05-04 Prasetya Ajie Utama , Nafise Sadat Moosavi , Iryna Gurevych

We investigate the tradeoff between adequacy and fluency in machine translation. We show the severity of this tradeoff at the evaluation level and analyze where popular metrics fall within it. Essentially, current metrics generally lean…

Computation and Language · Computer Science 2025-09-25 Behzad Shayegh , Jan-Thorsten Peter , David Vilar , Tobias Domhan , Juraj Juraska , Markus Freitag , Lili Mou

As machine learning (ML) systems increasingly shape access to credit, jobs, and other opportunities, the fairness of algorithmic decisions has become a central concern. Yet it remains unclear when enforcing fairness constraints in these…

Machine Learning · Statistics 2026-03-10 Yi Yang , Xiangyu Chang , Pei-yu Chen