English
Related papers

Related papers: Normative Conflicts and Shallow AI Alignment

200 papers

As artificial intelligence (AI) becomes deeply integrated into critical infrastructures and everyday life, ensuring its safe deployment is one of humanity's most urgent challenges. Current AI models prioritize task optimization over safety,…

Artificial Intelligence · Computer Science 2024-11-08 Joshua T. S. Hewson

This work introduces a novel framework for evaluating LLMs' capacity to balance instruction-following with critical reasoning when presented with multiple-choice questions containing no valid answers. Through systematic evaluation across…

Computation and Language · Computer Science 2025-06-03 Gracjan Góral , Emilia Wiśnios , Piotr Sankowski , Paweł Budzianowski

Are AI systems truly representing human values, or merely averaging across them? Our study suggests a concerning reality: Large Language Models (LLMs) fail to represent diverse cultural moral frameworks despite their linguistic…

Computation and Language · Computer Science 2025-08-01 Simon Münker

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

Computation and Language · Computer Science 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

Large Language Model (LLMs) such as ChatGPT that exhibit generative AI capabilities are facing accelerated adoption and innovation. The increased presence of Generative AI (GAI) inevitably raises concerns about the risks and safety…

Computers and Society · Computer Science 2024-07-29 Jaymari Chua , Yun Li , Shiyi Yang , Chen Wang , Lina Yao

The critical inquiry pervading the realm of Philosophy, and perhaps extending its influence across all Humanities disciplines, revolves around the intricacies of morality and normativity. Surprisingly, in recent years, this thematic thread…

Artificial Intelligence · Computer Science 2024-06-19 Nicholas Kluge Corrêa

Instruction-tuned Large Language Models (LLMs) are increasingly deployed as AI Assistants in firms for support in cognitive tasks. These AI assistants carry embedded perspectives which influence factors across the firm including…

Computers and Society · Computer Science 2025-05-27 Noah Broestl , Benjamin Lange , Cristina Voinea , Geoff Keeling , Rachael Lam

Large Language Models (LLMs) have become a cornerstone in the field of Natural Language Processing (NLP), offering transformative capabilities in understanding and generating human-like text. However, with their rising prominence, the…

Cryptography and Security · Computer Science 2024-03-26 Arijit Ghosh Chowdhury , Md Mofijul Islam , Vaibhav Kumar , Faysal Hossain Shezan , Vaibhav Kumar , Vinija Jain , Aman Chadha

Alignment of artificial intelligence (AI) encompasses the normative problem of specifying how AI systems should act and the technical problem of ensuring AI systems comply with those specifications. To date, AI alignment has generally…

Spurred by the recent rapid increase in the development and distribution of large language models (LLMs) across industry and academia, much recent work has drawn attention to safety- and security-related threats and vulnerabilities of LLMs,…

Computation and Language · Computer Science 2023-08-25 Maximilian Mozes , Xuanli He , Bennett Kleinberg , Lewis D. Griffin

Hallucination in large language models (LLMs) has been widely studied in recent years, with progress in both detection and mitigation aimed at improving truthfulness. Yet, a critical side effect remains largely overlooked: enhancing…

Computation and Language · Computer Science 2026-02-02 Omar Mahmoud , Ali Khalil , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana

Large Language Models (LLMs) are being integrated into professional domains, yet their limitations in such high-stakes fields as law remain poorly understood. In response, this paper introduces examples of critical challenges to the…

Artificial Intelligence · Computer Science 2026-01-27 Eljas Linna , Tuula Linna

This paper presents an approach to developing assurance cases for adversarial robustness and regulatory compliance in large language models (LLMs). Focusing on both natural and code language tasks, we explore the vulnerabilities these…

Cryptography and Security · Computer Science 2024-10-10 Tomas Bueno Momcilovic , Dian Balta , Beat Buesser , Giulio Zizzo , Mark Purcell

Large language models are now tuned to align with the goals of their creators, namely to be "helpful and harmless." These models should respond helpfully to user questions, but refuse to answer requests that could cause harm. However,…

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

The recent rise in popularity of large language models (LLMs) has prompted considerable concerns about their moral capabilities. Although considerable effort has been dedicated to aligning LLMs with human moral values, existing benchmarks…

Artificial Intelligence · Computer Science 2025-08-19 Alessio Galatolo , Luca Alberto Rappuoli , Katie Winkle , Meriem Beloucif

Large Language Models are fundamental actors in the modern IT landscape dominated by AI solutions. However, security threats associated with them might prevent their reliable adoption in critical application scenarios such as government…

Cryptography and Security · Computer Science 2025-11-10 Marco Arazzi , Vignesh Kumar Kembu , Antonino Nocera , Vinod P

Ensuring that Large Language Models (LLMs) align with the diverse and evolving human values across different regions and cultures remains a critical challenge in AI ethics. Current alignment approaches often yield superficial conformity…

Artificial Intelligence · Computer Science 2025-11-04 Jiahao Wang , Songkai Xue , Jinghui Li , Xiaozhen Wang

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

Despite the transformative impact of Artificial Intelligence (AI) across various sectors, cyber security continues to rely on traditional static and dynamic analysis tools, hampered by high false positive rates and superficial code…

Cryptography and Security · Computer Science 2025-04-28 Rajesh Yarra