English
Related papers

Related papers: Uncovering and Categorizing Social Biases in Text-…

200 papers

Transformer language models have achieved state-of-the-art performance for a variety of natural language tasks but have been shown to encode unwanted biases. We evaluate the social biases encoded by transformers trained with the masked…

Computation and Language · Computer Science 2025-08-19 Rahul Zalkikar , Kanchan Chandra

Large Language Models (LLMs) often struggle with the precise logic and schema alignment required for complex Text-to-SQL tasks. While current methods rely heavily on static prompting, they lack the ability to dynamically adapt and…

Computation and Language · Computer Science 2026-05-12 Haolin Yang , Jipeng Zhang , Zhitao He , Alexander Zhou , Yi R. Fung

Text-to-SQL bridges the gap between natural language and structured database language, thus allowing non-technical users to easily query databases. Traditional approaches model text-to-SQL as a direct translation task, where a given Natural…

Machine Learning · Computer Science 2025-08-12 Anurag Tripathi , Vaibhav Patle , Abhinav Jain , Ayush Pundir , Sairam Menon , Ajeet Kumar Singh , Dorien Herremans

Since we can leverage a large amount of unlabeled data without any human supervision to train a model and transfer the knowledge to target tasks, self-supervised learning is a de-facto component for the recent success of deep learning in…

Computation and Language · Computer Science 2021-03-12 Donggyu Kim , Seanie Lee

Existing text-to-SQL research only considers complete questions as the input, but lay-users might strive to formulate a complete question. To build a smarter natural language interface to database systems (NLIDB) that also processes…

Computation and Language · Computer Science 2021-10-01 Naihao Deng , Shuaichen Chang , Peng Shi , Tao Yu , Rui Zhang

Research at the intersection of machine learning and the social sciences has provided critical new insights into social behavior. At the same time, a variety of critiques have been raised ranging from technical issues with the data used and…

Computers and Society · Computer Science 2020-01-16 Jason Radford , Kenneth Joseph

A stereotype is a generalized perception of a specific group of humans. It is often potentially encoded in human language, which is more common in texts on social issues. Previous works simply define a sentence as stereotypical and…

Computation and Language · Computer Science 2024-01-30 Yang Liu

Sensitive attributes are legally protected characteristics that should not be used to discriminate. Careful steps have been taken to minimize the risk of human bias regarding these fields, such as race and age. Large language models (LLMs)…

Computers and Society · Computer Science 2026-04-14 Anay Agarwalla , Simeon Sayer

The recent advances in large language models (LLMs) have revolutionized industries such as finance, marketing, and customer service by enabling sophisticated natural language processing tasks. However, the broad adoption of LLMs brings…

Computers and Society · Computer Science 2025-02-19 Berk Yilmaz , Huthaifa I. Ashqar

Large language models (LLMs) have been shown to exhibit biases against LGBTQ+ populations. While safety training may lessen explicit expressions of bias, previous work has shown that implicit stereotype-driven associations often persist. In…

Additive two-tower models are popular learning-to-rank methods for handling biased user feedback in industry settings. Recent studies, however, report a concerning phenomenon: training two-tower models on clicks collected by well-performing…

Information Retrieval · Computer Science 2025-06-26 Philipp Hager , Onno Zoeter , Maarten de Rijke

As Large Language Models (LLMs) increasingly power decision-making systems across critical domains, understanding and mitigating their biases becomes essential for responsible AI deployment. Although bias assessment frameworks have…

Computation and Language · Computer Science 2026-04-06 Divyanshu Kumar , Ishita Gupta , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Ensuring that the benefits of sign language technologies are distributed equitably among all community members is crucial. Thus, it is important to address potential biases and inequities that may arise from the design or use of these…

Computation and Language · Computer Science 2024-10-08 Katherine Atwell , Danielle Bragg , Malihe Alikhani

Machine learning models that convert user-written text descriptions into images are now widely available online and used by millions of users to generate millions of images a day. We investigate the potential for these models to amplify…

The capabilities of natural language models trained on large-scale data have increased immensely over the past few years. Open source libraries such as HuggingFace have made these models easily available and accessible. While prior research…

Computation and Language · Computer Science 2021-10-29 Hannah Kirk , Yennie Jun , Haider Iqbal , Elias Benussi , Filippo Volpin , Frederic A. Dreyer , Aleksandar Shtedritski , Yuki M. Asano

We present a data-driven approach using word embeddings to discover and categorise language biases on the discussion platform Reddit. As spaces for isolated user communities, platforms such as Reddit are increasingly connected to issues of…

Computation and Language · Computer Science 2020-08-17 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Natalia Criado

Text-to-SQL parsing tackles the problem of mapping natural language questions to executable SQL queries. In practice, text-to-SQL parsers often encounter various challenging scenarios, requiring them to be generalizable and robust. While…

Computation and Language · Computer Science 2022-10-25 Chang Gao , Bowen Li , Wenxuan Zhang , Wai Lam , Binhua Li , Fei Huang , Luo Si , Yongbin Li

Large language models (LLMs) have demonstrated strong performance in translating natural language questions into SQL queries (Text-to-SQL). In contrast, small language models (SLMs) ranging from 0.5B to 1.5B parameters currently…

Computation and Language · Computer Science 2025-07-31 Lei Sheng , Shuai-Shuai Xu

Large language models (LLMs) are widely applied across diverse domains, raising concerns about their limitations and potential risks. In this study, we investigate two types of bias that LLMs may display: stereotype bias and deviation bias.…

Computation and Language · Computer Science 2026-05-20 Daniel Wang , Eli Brignac , Minjia Mao , Xiao Fang

Previous text-to-SQL datasets and systems have primarily focused on user questions with clear intentions that can be answered. However, real user questions can often be ambiguous with multiple interpretations or unanswerable due to a lack…