English
Related papers

Related papers: Aligned Probing: Relating Toxic Behavior and Model…

200 papers

This work presents a novel systematic methodology to analyse the capabilities and limitations of Large Language Models (LLMs) with feedback from a formal inference engine, on logic theory induction. The analysis is complexity-graded w.r.t.…

Computation and Language · Computer Science 2025-01-15 João Pedro Gandarela , Danilo S. Carvalho , André Freitas

Large language models (LLMs) have become increasingly integrated with various applications. To ensure that LLMs do not generate unsafe responses, they are aligned with safeguards that specify what content is restricted. However, such…

Computation and Language · Computer Science 2024-05-08 Hongyu Cai , Arjun Arunasalam , Leo Y. Lin , Antonio Bianchi , Z. Berkay Celik

Language models often misinterpret human intentions due to their handling of ambiguity, a limitation well-recognized in NLP research. While morally clear scenarios are more discernible to LLMs, greater difficulty is encountered in morally…

Computation and Language · Computer Science 2024-10-11 Pranav Senthilkumar , Visshwa Balasubramanian , Prisha Jain , Aneesa Maity , Jonathan Lu , Kevin Zhu

While explicit Chain-of-Thought (CoT) empowers large reasoning models (LRMs), it enables the generation of riskier final answers. Current alignment paradigms primarily rely on externally enforced compliance, optimizing models to detect…

Artificial Intelligence · Computer Science 2026-05-12 Yi Zhang , Yuxin Chen , Leheng Sheng , Dongcheng Zhang , Chaochao Lu , Xiang Wang , An Zhang

Content moderation typically combines the efforts of human moderators and machine learning models. However, these systems often rely on data where significant disagreement occurs during moderation, reflecting the subjective nature of…

Computation and Language · Computer Science 2025-09-01 Guillermo Villate-Castillo , Javier Del Ser , Borja Sanz

Despite their strong performance, large language models (LLMs) face challenges in real-world application of lexical simplification (LS), particularly in privacy-sensitive and resource-constrained environments. Moreover, since vulnerable…

Computation and Language · Computer Science 2025-09-30 Akio Hayakawa , Stefan Bott , Horacio Saggion

Recent research on large language models (LLMs) has demonstrated their ability to understand and employ deceptive behavior, even without explicit prompting. However, such behavior has only been observed in rare, specialized cases and has…

Computation and Language · Computer Science 2025-06-24 Laurène Vaugrante , Francesca Carlon , Maluna Menke , Thilo Hagendorff

Large language models (LLMs) have demonstrated revolutionary capabilities in understanding complex contexts and performing a wide range of tasks. However, LLMs can also answer questions that are unethical or harmful, raising concerns about…

Cryptography and Security · Computer Science 2025-04-15 Kang Yang , Guanhong Tao , Xun Chen , Jun Xu

Theory of Mind (ToM), the ability to attribute mental states to others, is a hallmark of social intelligence. While large language models (LLMs) demonstrate promising performance on standard ToM benchmarks, we observe that they often fail…

Computation and Language · Computer Science 2026-04-14 Mengfan Li , Xuanhua Shi , Yang Deng

While Large Language Models (LLMs) have achieved strong performance across many NLP tasks, their opaque internal mechanisms hinder trustworthiness and safe deployment. Existing surveys in explainable AI largely focus on post-hoc explanation…

Computation and Language · Computer Science 2026-04-21 Yutong Gao , Qinglin Meng , Yuan Zhou , Liangming Pan

Large language models are increasingly used for creative writing and engagement content, raising safety concerns about the outputs. Therefore, casting humor generation as a testbed, this work evaluates how funniness optimization in modern…

Computation and Language · Computer Science 2025-10-22 Atharvan Dogra , Soumya Suvra Ghosal , Ameet Deshpande , Ashwin Kalyan , Dinesh Manocha

Large language models (LLMs) learn undesirable properties during pretraining, including dangerous knowledge and toxic text generation. Just as post-training uses different objectives to shape different behaviors, we argue that unlearning…

Computation and Language · Computer Science 2026-05-27 Berk Atil , Vipul Gupta , Rebecca J. Passonneau

Most commonly used language models (LMs) are instruction-tuned and aligned using a combination of fine-tuning and reinforcement learning, causing them to refuse users requests deemed harmful by the model. However, jailbreak prompts can…

Computation and Language · Computer Science 2025-07-02 Aryan Shrivastava , Ari Holtzman

Knowledge probing quantifies how much relational knowledge a language model (LM) has acquired during pre-training. Existing knowledge probes evaluate model capabilities through metrics like prediction accuracy and precision. Such…

Computation and Language · Computer Science 2026-01-28 Christopher Kissling , Elena Merdjanovska , Alan Akbik

Large language models (LLMs) have led to breakthroughs in language tasks, yet the internal mechanisms that enable their remarkable generalization and reasoning abilities remain opaque. This lack of transparency presents challenges such as…

Computation and Language · Computer Science 2024-04-17 Haiyan Zhao , Fan Yang , Bo Shen , Himabindu Lakkaraju , Mengnan Du

Large Language Models (LLMs) have become essential for offensive language detection, yet their ability to handle annotation disagreement remains underexplored. Disagreement samples, which arise from subjective interpretations, pose a unique…

Computation and Language · Computer Science 2025-05-20 Junyu Lu , Kai Ma , Kaichun Wang , Kelaiti Xiao , Roy Ka-Wei Lee , Bo Xu , Liang Yang , Hongfei Lin

Alignment safety research assumes that ethical instructions improve model behavior, but how language models internally process such instructions remains unknown. We conducted over 600 multi-agent simulations across four models (Llama 3.3…

Computation and Language · Computer Science 2026-04-02 Hiroki Fukui

Diffusion language models (DLMs) generate tokens in parallel through iterative denoising, which can reduce latency and enable bidirectional conditioning. However, the safety risks posed by jailbreak attacks that exploit this inference…

Artificial Intelligence · Computer Science 2026-02-18 Shojiro Yamabe , Jun Sakuma

Despite rapid advances in large language models (LLMs), their linguistic abilities in low-resource and morphologically rich languages are still not well understood due to limited annotated resources and the absence of standardized…

Computation and Language · Computer Science 2026-04-01 Hailay Kidu Teklehaymanot , Gebrearegawi Gebremariam , Wolfgang Nejdl

The growing deployment of large language models (LLMs) has amplified concerns regarding their inherent biases, raising critical questions about their fairness, safety, and societal impact. However, quantifying LLM bias remains a fundamental…

Computation and Language · Computer Science 2025-05-26 Alireza Arbabi , Florian Kerschbaum