English
Related papers

Related papers: Are Stereotypes Leading LLMs' Zero-Shot Stance Det…

200 papers

Stance detection is a challenging task that aims to identify public opinion from social media platforms with respect to specific targets. Previous work on stance detection largely focused on pure texts. In this paper, we study multi-modal…

Computation and Language · Computer Science 2024-06-07 Bin Liang , Ang Li , Jingqian Zhao , Lin Gui , Min Yang , Yue Yu , Kam-Fai Wong , Ruifeng Xu

Large Language Models (LLMs) have demonstrated exceptional capabilities in generalizing to new tasks in a zero-shot or few-shot manner. However, the extent to which LLMs can comprehend user preferences based on their previous behavior…

Information Retrieval · Computer Science 2023-05-12 Wang-Cheng Kang , Jianmo Ni , Nikhil Mehta , Maheswaran Sathiamoorthy , Lichan Hong , Ed Chi , Derek Zhiyuan Cheng

Language models (LMs) can exhibit systematic biases against speakers based on variations in their dialects, even in the absence of a dialect label, a behavior known as covert dialect bias. In this work, we quantify covert dialect bias in…

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

Computation and Language · Computer Science 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Stance detection on social media is an emerging opinion mining paradigm for various social and political applications in which sentiment analysis may be sub-optimal. There has been a growing research interest for developing effective…

Social and Information Networks · Computer Science 2021-04-16 Abeer AlDayel , Walid Magdy

Performance of Large Language Models (LLMs) on multiple-choice tasks differs markedly between symbol-based and cloze-style evaluation formats. The observed discrepancies are systematically attributable to task characteristics: natural…

Computation and Language · Computer Science 2026-02-02 Joonhak Lee , Sungmok Jung , Jongyeon Park , Jaejin Lee

Beliefs shape how people reason, communicate, and behave. Rather than existing in isolation, they exhibit a rich correlational structure--some connected through logical dependencies, others through indirect associations or social processes.…

Computation and Language · Computer Science 2026-02-02 Joseph Malone , Rachith Aiyappa , Byunghwee Lee , Haewoon Kwak , Jisun An , Yong-Yeol Ahn

Sensitive attributes are legally protected characteristics that should not be used to discriminate. Careful steps have been taken to minimize the risk of human bias regarding these fields, such as race and age. Large language models (LLMs)…

Computers and Society · Computer Science 2026-04-14 Anay Agarwalla , Simeon Sayer

Large Language Models (LLMs) have become essential for offensive language detection, yet their ability to handle annotation disagreement remains underexplored. Disagreement samples, which arise from subjective interpretations, pose a unique…

Computation and Language · Computer Science 2025-05-20 Junyu Lu , Kai Ma , Kaichun Wang , Kelaiti Xiao , Roy Ka-Wei Lee , Bo Xu , Liang Yang , Hongfei Lin

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Computation and Language · Computer Science 2024-08-08 Shachi H Kumar , Saurav Sahay , Sahisnu Mazumder , Eda Okur , Ramesh Manuvinakurike , Nicole Beckage , Hsuan Su , Hung-yi Lee , Lama Nachman

Most research on natural language processing treats bias as an absolute concept: Based on a (probably complex) algorithmic analysis, a sentence, an article, or a text is classified as biased or not. Given the fact that for humans the…

Computation and Language · Computer Science 2022-10-14 Alonso Palomino , Martin Potthast , Khalid Al-Khatib , Benno Stein

Linear Attention Large Language Models (LLMs) offer a compelling recurrent formulation that compresses context into a fixed-size state matrix, enabling constant-time inference. However, the internal dynamics of this compressed state remain…

Machine Learning · Computer Science 2026-02-03 Ao Sun , Hongtao Zhang , Heng Zhou , Yixuan Ma , Yiran Qin , Tongrui Su , Yan Liu , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He

Large-scale web-scraped text corpora used to train general-purpose AI models often contain harmful demographic-targeted social biases, creating a regulatory need for data auditing and developing scalable bias-detection methods. Although…

Computation and Language · Computer Science 2026-04-10 Ayan Majumdar , Feihao Chen , Jinghui Li , Xiaozhen Wang

Large language models (LLMs) inherit biases from their training data and alignment processes, influencing their responses in subtle ways. While many studies have examined these biases, little work has explored their robustness during…

Computation and Language · Computer Science 2024-11-06 Virgile Rennard , Christos Xypolopoulos , Michalis Vazirgiannis

A stereotype is an over-generalized belief about a particular group of people, e.g., Asians are good at math or Asians are bad drivers. Such beliefs (biases) are known to hurt target groups. Since pretrained language models are trained on…

Computation and Language · Computer Science 2020-04-21 Moin Nadeem , Anna Bethke , Siva Reddy

The spread of fake news, polarizing, politically biased, and harmful content on online platforms has been a serious concern. With large language models becoming a promising approach, however, no study has properly benchmarked their…

Computation and Language · Computer Science 2025-09-10 Michele Joshua Maggini , Dhia Merzougui , Rabiraj Bandyopadhyay , Gaël Dias , Fabrice Maurel , Pablo Gamallo

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

Large Language Models (LLMs) have shown significant promise in various applications, including zero-shot and few-shot learning. However, their performance can be hampered by inherent biases. Instead of traditionally sought methods that aim…

Computation and Language · Computer Science 2024-01-19 Yong Zhang , Hanzhang Li , Zhitao Li , Ning Cheng , Ming Li , Jing Xiao , Jianzong Wang

Large Language Models (LLMs) are increasingly deployed in high-stakes domains such as clinical decision support and medical documentation. However, the robustness of these models against subtle linguistic variations, specifically…

Computation and Language · Computer Science 2026-05-19 Jen-tse Huang , Didi Zhou , Faith Kamau , Amy Oh , Anne R. Links , Mark Dredze , Mary Catherine Beach , Somnath Saha

Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express…

Computation and Language · Computer Science 2025-09-03 Aleksandra Sorokovikova , Pavel Chizhov , Iuliia Eremenko , Ivan P. Yamshchikov