English
Related papers

Related papers: Robust Persona-Aware Toxicity Detection with Promp…

200 papers

Large Language Models (LLMs) can infer sensitive attributes such as gender or age from indirect cues like names and pronouns, potentially biasing recommendations. While several debiasing methods exist, they require access to the LLMs'…

Information Retrieval · Computer Science 2026-03-16 Mihaela Rotar , Theresia Veronika Rampisela , Maria Maistro

Despite rapid advances in large language models (LLMs), their integration with traditional supervised machine learning (ML) techniques that have proven applicability to medical data remains underexplored. This is particularly true for…

Computation and Language · Computer Science 2025-05-28 Yuxin Zhu , Yuting Guo , Noah Marchuck , Abeed Sarker , Yun Wang

Lexical Simplification (LS) methods use a three-step pipeline: complex word identification, substitute generation, and substitute ranking, each with separate evaluation datasets. We found large language models (LLMs) can simplify sentences…

Computation and Language · Computer Science 2025-01-28 Jipeng Qiang , Minjiang Huang , Yi Zhu , Yunhao Yuan , Chaowei Zhang , Xiaoye Ouyang

Early identification of suicide risk is crucial for preventing suicidal behaviors. As a result, the identification and study of patterns and markers related to suicide risk have become a key focus of current research. In this paper, we…

Sound · Computer Science 2025-07-02 Yifan Gao , Jiao Fu , Long Guo , Hong Liu

Prompting is now a dominant method for evaluating the linguistic knowledge of large language models (LLMs). While other methods directly read out models' probability distributions over strings, prompting requires models to access this…

Computation and Language · Computer Science 2023-10-24 Jennifer Hu , Roger Levy

Personality traits have long been studied as predictors of human behavior. Recent advances in Large Language Models (LLMs) suggest similar patterns may emerge in artificial systems, with advanced LLMs displaying consistent behavioral…

Artificial Intelligence · Computer Science 2025-09-08 Pengrui Han , Rafal Kocielnik , Peiyang Song , Ramit Debnath , Dean Mobbs , Anima Anandkumar , R. Michael Alvarez

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

Artificial Intelligence · Computer Science 2026-04-21 Yingtao Tian

Controlling emergent behavioral personas (e.g., sycophancy, hallucination) in Large Language Models (LLMs) is critical for AI safety, yet remains a persistent challenge. Existing solutions face a dilemma: manual prompt engineering is…

Machine Learning · Computer Science 2026-04-23 Harshvardhan Saini , Yiming Tang , Dianbo Liu

This paper presents a competitive approach to multilingual subjectivity detection using large language models (LLMs) with few-shot prompting. We participated in Task 1: Subjectivity of the CheckThat! 2025 evaluation campaign. We show that…

Computation and Language · Computer Science 2025-07-11 Akram Elbouanani , Evan Dufraisse , Aboubacar Tuo , Adrian Popescu

We discover a previously overlooked challenge in personalized text generation: personalization methods are increasingly applied under explicit style instructions, yet their behavior under such constraints remains poorly understood. To…

Artificial Intelligence · Computer Science 2026-01-13 Yutong Song , Jiang Wu , Shaofan Yuan , Chengze Shen , Jian Wang , Amir Rahmani , Nikil Dutt , Yu Wang

Workplace toxicity is widely recognized as detrimental to organizational culture, yet quantifying its direct impact on operational efficiency remains methodologically challenging due to the ethical and practical difficulties of reproducing…

Artificial Intelligence · Computer Science 2026-04-28 Benedikt Mangold

Large language models (LLMs) have revolutionized NLP research. Notably, in-context learning enables their use as evaluation metrics for natural language generation, making them particularly advantageous in low-resource scenarios and…

Computation and Language · Computer Science 2024-11-19 Christoph Leiter , Steffen Eger

The use of LLMs in natural language reasoning has shown mixed results, sometimes rivaling or even surpassing human performance in simpler classification tasks while struggling with social-cognitive reasoning, a domain where humans naturally…

Computation and Language · Computer Science 2024-10-23 Fiona Anting Tan , Gerard Christopher Yeo , Kokil Jaidka , Fanyou Wu , Weijie Xu , Vinija Jain , Aman Chadha , Yang Liu , See-Kiong Ng

Word-level psycholinguistic norms lend empirical support to theories of language processing. However, obtaining such human-based measures is not always feasible or straightforward. One promising approach is to augment human norming datasets…

Ensuring the safety of large language model (LLM) applications is essential for developing trustworthy artificial intelligence. Current LLM safety benchmarks have two limitations. First, they focus solely on either discriminative or…

Computation and Language · Computer Science 2024-10-30 Yutao Mou , Shikun Zhang , Wei Ye

Red-teaming, or identifying prompts that elicit harmful responses, is a critical step in ensuring the safe and responsible deployment of large language models (LLMs). Developing effective protection against many modes of attack prompts…

Computation and Language · Computer Science 2025-03-03 Seanie Lee , Minsu Kim , Lynn Cherif , David Dobre , Juho Lee , Sung Ju Hwang , Kenji Kawaguchi , Gauthier Gidel , Yoshua Bengio , Nikolay Malkin , Moksh Jain

Emotional prompting - the use of specific emotional diction in prompt engineering - has shown increasing promise in improving large language model (LLM) performance, truthfulness, and responsibility. However these studies have been limited…

Machine Learning · Computer Science 2026-04-10 Ameen Patel , Felix Lee , Kyle Liang , Joseph Thomas

Synthetic personae experiments have become a prominent method in Large Language Model alignment research, yet the representativeness and ecological validity of these personae vary considerably between studies. Through a review of 63…

Computers and Society · Computer Science 2025-12-02 Jan Batzner , Volker Stocker , Bingjun Tang , Anusha Natarajan , Qinhao Chen , Stefan Schmid , Gjergji Kasneci

Recent advances in large language models (LLMs) demonstrate their potential as educational tutors. However, different tutoring strategies benefit different student personalities, and mismatches can be counterproductive to student outcomes.…

Computation and Language · Computer Science 2026-01-14 Donya Rooein , Sankalan Pal Chowdhury , Mariia Eremeeva , Yuan Qin , Debora Nozza , Mrinmaya Sachan , Dirk Hovy

Algorithmic bias often arises as a result of differential subgroup validity, in which predictive relationships vary across groups. For example, in toxic language detection, comments targeting different demographic groups can vary markedly…

Machine Learning · Computer Science 2023-03-08 Soumyajit Gupta , Sooyong Lee , Maria De-Arteaga , Matthew Lease