English
Related papers

Related papers: Dropouts in Confidence: Moral Uncertainty in Human…

200 papers

We explore how large language models (LLMs) can be influenced by prompting them to alter their initial decisions and align them with established ethical frameworks. Our study is based on two experiments designed to assess the susceptibility…

Computation and Language · Computer Science 2024-11-19 Allison Huang , Yulu Niki Pi , Carlos Mougan

With the rapid development and uptake of large language models (LLMs) across high-stakes settings, it is increasingly important to ensure that LLMs behave in ways that align with human values. Existing moral benchmarks prompt LLMs with…

Computation and Language · Computer Science 2026-02-11 Andrew Shaw , Christina Hahn , Catherine Rasgaitis , Yash Mishra , Alisa Liu , Natasha Jaques , Yulia Tsvetkov , Amy X. Zhang

This study establishes a novel framework for systematically evaluating the moral reasoning capabilities of large language models (LLMs) as they increasingly integrate into critical societal domains. Current assessment methodologies lack the…

Computers and Society · Computer Science 2025-05-05 Junfeng Jiao , Saleh Afroogh , Abhejay Murali , Kevin Chen , David Atkinson , Amit Dhurandhar

This study examines the ethical reasoning of six prominent generative large language models: OpenAI GPT-4o, Meta LLaMA 3.1, Perplexity, Anthropic Claude 3.5 Sonnet, Google Gemini, and Mistral 7B. The research explores how these models…

Artificial Intelligence · Computer Science 2025-01-16 W. Russell Neuman , Chad Coleman , Manan Shah

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

Artificial Intelligence · Computer Science 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Evaluating moral alignment in agents navigating conflicting, hierarchically structured human norms is a critical challenge at the intersection of AI safety, moral philosophy, and cognitive science. We introduce Morality Chains, a novel…

As large language models (LLMs) become more deeply integrated into various sectors, understanding how they make moral judgments has become crucial, particularly in the realm of autonomous driving. This study utilized the Moral Machine…

Computation and Language · Computer Science 2024-02-08 Kazuhiro Takemoto

The recent rise in popularity of large language models (LLMs) has prompted considerable concerns about their moral capabilities. Although considerable effort has been dedicated to aligning LLMs with human moral values, existing benchmarks…

Artificial Intelligence · Computer Science 2025-08-19 Alessio Galatolo , Luca Alberto Rappuoli , Katie Winkle , Meriem Beloucif

As large language models (LLMs) increasingly integrate into our daily lives, it becomes crucial to understand their implicit biases and moral tendencies. To address this, we introduce a Moral Foundations LLM dataset (MFD-LLM) grounded in…

Computers and Society · Computer Science 2025-04-10 Monika Jotautaite , Mary Phuong , Chatrik Singh Mangat , Maria Angelica Martinez

The emergence of Large Language Models (LLMs) has revealed a growing need for human-AI collaboration, especially in creative decision-making scenarios where trust and reliance are paramount. Through human studies and model evaluations on…

Computation and Language · Computer Science 2024-10-07 Manasi Sharma , Ho Chit Siu , Rohan Paleja , Jaime D. Peña

Moral judgment is integral to large language models' (LLMs) social reasoning. As multi-agent systems gain prominence, it becomes crucial to understand how LLMs function when collaborating compared to operating as individual agents. In human…

Computation and Language · Computer Science 2025-10-30 Anita Keshmirian , Razan Baltaji , Babak Hemmatian , Hadi Asghari , Lav R. Varshney

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

Artificial Intelligence · Computer Science 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely…

Computation and Language · Computer Science 2025-05-26 Ya Wu , Qiang Sheng , Danding Wang , Guang Yang , Yifan Sun , Zhengjia Wang , Yuyan Bu , Juan Cao

As artificial intelligence (AI), including machine learning (ML) models and foundation models (FMs), is increasingly deployed in high-stakes domains, ensuring their trustworthiness has become a central challenge. However, the core…

Artificial Intelligence · Computer Science 2026-05-05 Ruta Binkyte , Ivaxi Sheth , Zhijing Jin , Mohammad Havaei , Bernhard Schölkopf , Mario Fritz

As users increasingly seek guidance from LLMs for decision-making in daily life, many of these decisions are not clear-cut and depend significantly on the personal values and ethical standards of people. We present DailyDilemmas, a dataset…

Computation and Language · Computer Science 2025-03-18 Yu Ying Chiu , Liwei Jiang , Yejin Choi

The rapid adoption of large language models (LLMs) has spurred extensive research into their encoded moral norms and decision-making processes. Much of this research relies on prompting LLMs with survey-style questions to assess how well…

Artificial Intelligence · Computer Science 2025-01-31 Pratik S. Sachdeva , Tom van Nuenen

Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied to the reasoning, knowledge, or decision making of the…

Machine Learning · Computer Science 2026-01-13 Jiawei Wang , Yanfei Zhou , Siddartha Devic , Deqing Fu

As large language models (LLMs) become increasingly capable of autonomous decision-making, they introduce new challenges and opportunities for human-AI cooperation in mixed-motive contexts. While prior research has primarily examined AI in…

Human-Computer Interaction · Computer Science 2025-05-29 Guanxuan Jiang , Shirao Yang , Yuyang Wang , Pan Hui

Large language models (LLMs) increasingly find their way into the most diverse areas of our everyday lives. They indirectly influence people's decisions or opinions through their daily use. Therefore, understanding how and which moral…

Computers and Society · Computer Science 2024-07-23 Karina Vida , Fabian Damken , Anne Lauscher