English
Related papers

Related papers: Finspector: A Human-Centered Visual Inspection Too…

200 papers

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor

Sensitive attributes like gender or age can lead to unfair predictions in machine learning tasks such as predictive business process monitoring, particularly when used without considering context. We present FairLoop1, a tool for…

Recent breakthroughs in self supervised training have led to a new class of pretrained vision language models. While there have been investigations of bias in multimodal models, they have mostly focused on gender and racial bias, giving…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Sepehr Janghorbani , Gerard de Melo

Many recent neural models have shown remarkable empirical results in Machine Reading Comprehension, but evidence suggests sometimes the models take advantage of dataset biases to predict and fail to generalize on out-of-sample data. While…

Computation and Language · Computer Science 2022-07-20 Yifan Zhong , Haohan Wang , Eric P. Xing

Large Language Models (LLMs) are increasingly deployed in high-stakes contexts where their outputs influence real-world decisions. However, evaluating bias in LLM outputs remains methodologically challenging due to sensitivity to prompt…

Computation and Language · Computer Science 2026-01-13 William Guey , Wei Zhang , Pei-Luen Patrick Rau , Pierrick Bougault , Vitor D. de Moura , Bertan Ucar , Jose O. Gomes

Generating professional financial reports is a labor-intensive and intellectually demanding process that current AI systems struggle to fully automate. To address this challenge, we introduce FinSight (Financial InSight), a novel multi…

Computation and Language · Computer Science 2025-10-21 Jiajie Jin , Yuyao Zhang , Yimeng Xu , Hongjin Qian , Yutao Zhu , Zhicheng Dou

Mitigating social bias in large language models (LLMs) has become an increasingly important research objective. However, existing debiasing methods often incur high human and computational costs, exhibit limited effectiveness, and struggle…

Computation and Language · Computer Science 2025-06-02 Xiaoqing Cheng , Ruizhe Chen , Hongying Zan , Yuxiang Jia , Min Peng

Visual data from the Web power image classifiers, which often underpin many web services, such as recommendation and content moderation. However, the raw Web data often contain spurious correlations and social biases, and neural networks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jungwook Seo , Yoonsik Park , Changmin Lee , Sungyong Baik

Transformers are widely used in natural language processing, where they consistently achieve state-of-the-art performance. This is mainly due to their attention-based architecture, which allows them to model rich linguistic relations…

Computation and Language · Computer Science 2022-11-29 Nikolaos Mylonas , Ioannis Mollas , Grigorios Tsoumakas

Foundation models have received much attention due to their effectiveness across a broad range of downstream applications. Though there is a big convergence in terms of architecture, most pretrained models are typically still developed for…

Computation and Language · Computer Science 2022-06-14 Yaru Hao , Haoyu Song , Li Dong , Shaohan Huang , Zewen Chi , Wenhui Wang , Shuming Ma , Furu Wei

An important challenge in statistical analysis lies in controlling the bias of estimators due to the ever-increasing data size and model complexity. Approximate numerical methods and data features like censoring and misclassification often…

Statistics Theory · Mathematics 2020-11-17 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser , Yuming Zhang

Biases inherent in both data and algorithms make the fairness of widespread machine learning (ML)-based decision-making systems less than optimal. To improve the trustfulness of such ML decision systems, it is crucial to be aware of the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Biying Fu , Naser Damer

Detecting stereotypes and biases in Large Language Models (LLMs) is crucial for enhancing fairness and reducing adverse impacts on individuals or groups when these models are applied. Traditional methods, which rely on embedding spaces or…

Computation and Language · Computer Science 2024-05-07 Yanhong Bai , Jiabao Zhao , Jinxin Shi , Zhentao Xie , Xingjiao Wu , Liang He

AI-generated text detectors have recently gained adoption in educational and professional contexts. Prior research has uncovered isolated cases of bias, particularly against English Language Learners (ELLs) however, there is a lack of…

Artificial Intelligence · Computer Science 2025-12-15 Priyam Basu , Yunfeng Zhang , Vipul Raheja

Sparse language vectors from linguistic typology databases and learned embeddings from tasks like multilingual machine translation have been investigated in isolation, without analysing how they could benefit from each other's language…

Computation and Language · Computer Science 2020-10-27 Arturo Oncevay , Barry Haddow , Alexandra Birch

Most machine learning methods are known to capture and exploit biases of the training data. While some biases are beneficial for learning, others are harmful. Specifically, image captioning models tend to exaggerate biases present in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Kaylee Burns , Lisa Anne Hendricks , Kate Saenko , Trevor Darrell , Anna Rohrbach

Recent advances in multimodal large language models (MLLMs) have demonstrated strong capabilities in understanding general visual content. However, these general-domain MLLMs perform poorly in face perception tasks, often producing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jingzhi Li , Changjiang Luo , Ruoyu Chen , Hua Zhang , Wenqi Ren , Jianhou Gan , Xiaochun Cao

Modern software relies heavily on data and machine learning, and affects decisions that shape our world. Unfortunately, recent studies have shown that because of biases in data, software systems frequently inject bias into their decisions,…

Machine Learning · Computer Science 2020-12-21 Brittany Johnson , Jesse Bartola , Rico Angell , Katherine Keith , Sam Witty , Stephen J. Giguere , Yuriy Brun

The measurement of bias in machine learning often focuses on model performance across identity subgroups (such as man and woman) with respect to groundtruth labels. However, these methods do not directly measure the associations that a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Osman Aka , Ken Burke , Alex Bäuerle , Christina Greer , Margaret Mitchell

The increased interest in deep learning applications, and their hard-to-detect biases result in the need to validate and explain complex models. However, current explanation methods are limited as far as both the explanation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Weronika Hryniewska , Adrianna Grudzień , Przemysław Biecek