中文
相关论文

相关论文: The Authors Matter: Understanding and Mitigating I…

200 篇论文

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

计算与语言 · 计算机科学 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

As language models are increasingly included in human-facing machine learning tools, bias against demographic subgroups has gained attention. We propose FineDeb, a two-phase debiasing framework for language models that starts with…

计算与语言 · 计算机科学 2023-02-07 Akash Saravanan , Dhruv Mullick , Habibur Rahman , Nidhi Hegde

Recently, Large Language Models (LLMs) have demonstrated a superior ability to serve as ranking models. However, concerns have arisen as LLMs will exhibit discriminatory ranking behaviors based on users' sensitive attributes (\eg gender).…

信息检索 · 计算机科学 2024-09-26 Chen Xu , Wenjie Wang , Yuxin Li , Liang Pang , Jun Xu , Tat-Seng Chua

While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence.…

机器学习 · 统计学 2016-09-06 Hao Wang , Dit-Yan Yeung

Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure…

机器学习 · 计算机科学 2021-06-01 Runshan Fu , Yangfan Liang , Peter Zhang

Machine Learning seeks to identify and encode bodies of knowledge within provided datasets. However, data encodes subjective content, which determines the possible outcomes of the models trained on it. Because such subjectivity enables…

人工智能 · 计算机科学 2021-01-29 Zeerak Waseem , Smarika Lulz , Joachim Bingel , Isabelle Augenstein

Embeddings play a pivotal role in the efficacy of Large Language Models. They are the bedrock on which these models grasp contextual relationships and foster a more nuanced understanding of language and consequently perform remarkably on a…

计算与语言 · 计算机科学 2025-01-08 Aishik Rakshit , Smriti Singh , Shuvam Keshari , Arijit Ghosh Chowdhury , Vinija Jain , Aman Chadha

Machine learning models are often implemented in cohort with humans in the pipeline, with the model having an option to defer to a domain expert in cases where it has low confidence in its inference. Our goal is to design mechanisms for…

机器学习 · 计算机科学 2021-12-14 Vijay Keswani , Matthew Lease , Krishnaram Kenthapadi

Training data for text classification is often limited in practice, especially for applications with many output classes or involving many related classification problems. This means classifiers must generalize from limited evidence, but…

计算与语言 · 计算机科学 2020-05-19 Abhijit Mahabal , Jason Baldridge , Burcu Karagol Ayan , Vincent Perot , Dan Roth

In recent years, there has been an exponential growth in the number of complex documents and texts that require a deeper understanding of machine learning methods to be able to accurately classify texts in many applications. Many machine…

Vision-language models can encode societal biases and stereotypes, but there are challenges to measuring and mitigating these multimodal harms due to lacking measurement robustness and feature degradation. To address these challenges, we…

The success of deep neural nets heavily relies on their ability to encode complex relations between their input and their output. While this property serves to fit the training data well, it also obscures the mechanism that drives…

机器学习 · 计算机科学 2021-12-10 Itai Gat , Guy Lorberbom , Idan Schwartz , Tamir Hazan

Large language models have demonstrated strong capabilities to learn in-context, where exemplar input-output pairings are appended to the prompt for demonstration. However, existing work has demonstrated the ability of models to learn…

计算与语言 · 计算机科学 2025-02-11 Stephanie Schoch , Yangfeng Ji

Text-to-image diffusion models, which are theoretically equivalent to score-based generative models, generate images through a multi-step denoising process guided by text embeddings extracted from pretrained vision-language models such as…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Seung Hyuk Lee , Songkuk Kim

Recent advances in Representation Learning and Adversarial Training seem to succeed in removing unwanted features from the learned representation. We show that demographic information of authors is encoded in -- and can be recovered from --…

计算与语言 · 计算机科学 2018-09-05 Yanai Elazar , Yoav Goldberg

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

计算机视觉与模式识别 · 计算机科学 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

Group bias in natural language processing tasks manifests as disparities in system error rates across texts authorized by different demographic groups, typically disadvantaging minority groups. Dataset balancing has been shown to be…

计算与语言 · 计算机科学 2022-05-17 Xudong Han , Timothy Baldwin , Trevor Cohn

What does it mean for an algorithm to be biased? In U.S. law, unintentional bias is encoded via disparate impact, which occurs when a selection process has widely different outcomes for different groups, even as it appears to be neutral.…

My research investigates the use of cutting-edge hybrid deep learning models to accurately differentiate between AI-generated text and human writing. I applied a robust methodology, utilising a carefully selected dataset comprising AI and…

计算与语言 · 计算机科学 2024-01-17 Abiodun Finbarrs Oketunji

As algorithms increasingly inform and influence decisions made about individuals, it becomes increasingly important to address concerns that these algorithms might be discriminatory. The output of an algorithm can be discriminatory for many…

机器学习 · 计算机科学 2018-03-19 Úrsula Hébert-Johnson , Michael P. Kim , Omer Reingold , Guy N. Rothblum