English
Related papers

Related papers: Towards Controllable Biases in Language Generation

200 papers

Neural approaches to Natural Language Generation (NLG) have been promising for goal-oriented dialogue. One of the challenges of productionizing these approaches, however, is the ability to control response quality, and ensure that generated…

Computation and Language · Computer Science 2022-08-24 Ashwini Challa , Kartikeya Upasani , Anusha Balakrishnan , Rajen Subba

Controllable text generation systems often leverage control codes to direct various properties of the output like style and length. Inspired by recent work on causal inference for NLP, this paper reveals a previously overlooked flaw in…

Computation and Language · Computer Science 2022-10-10 Junyi Chai , Reid Pryzant , Victor Ye Dong , Konstantin Golobokov , Chenguang Zhu , Yi Liu

In this project, we want to explore the newly emerging field of prompt engineering and apply it to the downstream task of detecting LM biases. More concretely, we explore how to design prompts that can indicate 4 different types of biases:…

Computation and Language · Computer Science 2023-09-12 Md Abdul Aowal , Maliha T Islam , Priyanka Mary Mammen , Sandesh Shetty

Natural language generation models reproduce and often amplify the biases present in their training data. Previous research explored using sequence-to-sequence rewriting models to transform biased model outputs (or original texts) into more…

Computation and Language · Computer Science 2023-05-19 Chantal Amrhein , Florian Schottmann , Rico Sennrich , Samuel Läubli

Detecting and mitigating harmful biases in modern language models are widely recognized as crucial, open problems. In this paper, we take a step back and investigate how language models come to be biased in the first place. We use a…

Computation and Language · Computer Science 2022-07-22 Oskar van der Wal , Jaap Jumelet , Katrin Schulz , Willem Zuidema

Current approaches for controlling dialogue response generation are primarily focused on high-level attributes like style, sentiment, or topic. In this work, we focus on constrained long-term dialogue generation, which involves more…

Computation and Language · Computer Science 2022-05-17 Ramya Ramakrishnan , Hashan Buddhika Narangodage , Mauro Schilman , Kilian Q. Weinberger , Ryan McDonald

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

Slang is a common type of informal language, but its flexible nature and paucity of data resources present challenges for existing natural language systems. We take an initial step toward machine generation of slang by developing a…

Computation and Language · Computer Science 2021-05-25 Zhewei Sun , Richard Zemel , Yang Xu

While Large Language Models (LLMs) have become ubiquitous in many fields, understanding and mitigating LLM biases is an ongoing issue. This paper provides a novel method for evaluating the demographic biases of various generative AI models.…

Computation and Language · Computer Science 2025-06-16 Jack H Fagan , Ruhaan Juyaal , Amy Yue-Ming Yu , Siya Pun

In this work, we propose a method for neural dialogue response generation that allows not only generating semantically reasonable responses according to the dialogue history, but also explicitly controlling the sentiment of the response via…

Computation and Language · Computer Science 2019-01-23 Xiang Kong , Bohan Li , Graham Neubig , Eduard Hovy , Yiming Yang

The widespread adoption of large language models (LLMs) and generative AI (GenAI) tools across diverse applications has amplified the importance of addressing societal biases inherent within these technologies. While the NLP community has…

Large language models (LLMs) are increasingly capable of generating personalized, persuasive text at scale, raising new questions about bias and fairness in automated communication. This paper presents the first systematic analysis of how…

Computation and Language · Computer Science 2026-04-21 Tunazzina Islam

While recent advances in language modeling have resulted in powerful generation models, their generation style remains implicitly dependent on the training data and can not emulate a specific target style. Leveraging the generative…

Computation and Language · Computer Science 2020-10-23 Hrituraj Singh , Gaurav Verma , Balaji Vasan Srinivasan

Language models have been shown to propagate social bias through their output, particularly in the representation of gender and ethnicity. This paper investigates gender and ethnicity biases in AI-generated occupational stories.…

Computation and Language · Computer Science 2025-09-08 Martha O. Dimgba , Sharon Oba , Ameeta Agrawal , Philippe J. Giabbanelli

Language generation models' democratization benefits many domains, from answering health-related questions to enhancing education by providing AI-driven tutoring services. However, language generation models' democratization also makes it…

Computation and Language · Computer Science 2021-06-03 Paras Bhatt , Anthony Rios

Machine Learning has seen tremendous growth recently, which has led to larger adoption of ML systems for educational assessments, credit risk, healthcare, employment, criminal justice, to name a few. The trustworthiness of ML and NLP…

Computation and Language · Computer Science 2021-03-19 Nishtha Madaan , Inkit Padhi , Naveen Panwar , Diptikalyan Saha

Generative AI, such as large language models, has undergone rapid development within recent years. As these models become increasingly available to the public, concerns arise about perpetuating and amplifying harmful biases in applications.…

Computation and Language · Computer Science 2024-09-04 Sara Sterlie , Nina Weng , Aasa Feragen

The adoption of natural language generation (NLG) models can leave individuals vulnerable to the generation of harmful information memorized by the models, such as conspiracy theories. While previous studies examine conspiracy theories in…

Computation and Language · Computer Science 2021-06-10 Sharon Levy , Michael Saxon , William Yang Wang

Current large-scale language models can be politically biased as a result of the data they are trained on, potentially causing serious problems when they are deployed in real-world settings. In this paper, we describe metrics for measuring…

Computation and Language · Computer Science 2021-05-03 Ruibo Liu , Chenyan Jia , Jason Wei , Guangxuan Xu , Lili Wang , Soroush Vosoughi

Although large language models (LLMs) have demonstrated their effectiveness in a wide range of applications, they have also been observed to perpetuate unwanted biases present in the training data, potentially leading to harm for…

Computation and Language · Computer Science 2026-03-09 Schrasing Tong , Eliott Zemour , Jessica Lu , Rawisara Lohanimit , Lalana Kagal