中文
相关论文

相关论文: Dropouts in Confidence: Moral Uncertainty in Human…

200 篇论文

We explore how large language models (LLMs) can be influenced by prompting them to alter their initial decisions and align them with established ethical frameworks. Our study is based on two experiments designed to assess the susceptibility…

计算与语言 · 计算机科学 2024-11-19 Allison Huang , Yulu Niki Pi , Carlos Mougan

With the rapid development and uptake of large language models (LLMs) across high-stakes settings, it is increasingly important to ensure that LLMs behave in ways that align with human values. Existing moral benchmarks prompt LLMs with…

This study establishes a novel framework for systematically evaluating the moral reasoning capabilities of large language models (LLMs) as they increasingly integrate into critical societal domains. Current assessment methodologies lack the…

计算机与社会 · 计算机科学 2025-05-05 Junfeng Jiao , Saleh Afroogh , Abhejay Murali , Kevin Chen , David Atkinson , Amit Dhurandhar

This study examines the ethical reasoning of six prominent generative large language models: OpenAI GPT-4o, Meta LLaMA 3.1, Perplexity, Anthropic Claude 3.5 Sonnet, Google Gemini, and Mistral 7B. The research explores how these models…

人工智能 · 计算机科学 2025-01-16 W. Russell Neuman , Chad Coleman , Manan Shah

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

人工智能 · 计算机科学 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

软件工程 · 计算机科学 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Evaluating moral alignment in agents navigating conflicting, hierarchically structured human norms is a critical challenge at the intersection of AI safety, moral philosophy, and cognitive science. We introduce Morality Chains, a novel…

As large language models (LLMs) become more deeply integrated into various sectors, understanding how they make moral judgments has become crucial, particularly in the realm of autonomous driving. This study utilized the Moral Machine…

计算与语言 · 计算机科学 2024-02-08 Kazuhiro Takemoto

The recent rise in popularity of large language models (LLMs) has prompted considerable concerns about their moral capabilities. Although considerable effort has been dedicated to aligning LLMs with human moral values, existing benchmarks…

人工智能 · 计算机科学 2025-08-19 Alessio Galatolo , Luca Alberto Rappuoli , Katie Winkle , Meriem Beloucif

As large language models (LLMs) increasingly integrate into our daily lives, it becomes crucial to understand their implicit biases and moral tendencies. To address this, we introduce a Moral Foundations LLM dataset (MFD-LLM) grounded in…

计算机与社会 · 计算机科学 2025-04-10 Monika Jotautaite , Mary Phuong , Chatrik Singh Mangat , Maria Angelica Martinez

The emergence of Large Language Models (LLMs) has revealed a growing need for human-AI collaboration, especially in creative decision-making scenarios where trust and reliance are paramount. Through human studies and model evaluations on…

计算与语言 · 计算机科学 2024-10-07 Manasi Sharma , Ho Chit Siu , Rohan Paleja , Jaime D. Peña

Moral judgment is integral to large language models' (LLMs) social reasoning. As multi-agent systems gain prominence, it becomes crucial to understand how LLMs function when collaborating compared to operating as individual agents. In human…

计算与语言 · 计算机科学 2025-10-30 Anita Keshmirian , Razan Baltaji , Babak Hemmatian , Hadi Asghari , Lav R. Varshney

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

人工智能 · 计算机科学 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

Ethical decision-making is a critical aspect of human judgment, and the growing use of LLMs in decision-support systems necessitates a rigorous evaluation of their moral reasoning capabilities. However, existing assessments primarily rely…

计算与语言 · 计算机科学 2025-05-26 Ya Wu , Qiang Sheng , Danding Wang , Guang Yang , Yifan Sun , Zhengjia Wang , Yuyan Bu , Juan Cao

As artificial intelligence (AI), including machine learning (ML) models and foundation models (FMs), is increasingly deployed in high-stakes domains, ensuring their trustworthiness has become a central challenge. However, the core…

人工智能 · 计算机科学 2026-05-05 Ruta Binkyte , Ivaxi Sheth , Zhijing Jin , Mohammad Havaei , Bernhard Schölkopf , Mario Fritz

As users increasingly seek guidance from LLMs for decision-making in daily life, many of these decisions are not clear-cut and depend significantly on the personal values and ethical standards of people. We present DailyDilemmas, a dataset…

计算与语言 · 计算机科学 2025-03-18 Yu Ying Chiu , Liwei Jiang , Yejin Choi

The rapid adoption of large language models (LLMs) has spurred extensive research into their encoded moral norms and decision-making processes. Much of this research relies on prompting LLMs with survey-style questions to assess how well…

人工智能 · 计算机科学 2025-01-31 Pratik S. Sachdeva , Tom van Nuenen

Large Language Models (LLMs) can produce surprisingly sophisticated estimates of their own uncertainty. However, it remains unclear to what extent this expressed confidence is tied to the reasoning, knowledge, or decision making of the…

机器学习 · 计算机科学 2026-01-13 Jiawei Wang , Yanfei Zhou , Siddartha Devic , Deqing Fu

As large language models (LLMs) become increasingly capable of autonomous decision-making, they introduce new challenges and opportunities for human-AI cooperation in mixed-motive contexts. While prior research has primarily examined AI in…

人机交互 · 计算机科学 2025-05-29 Guanxuan Jiang , Shirao Yang , Yuyang Wang , Pan Hui

Large language models (LLMs) increasingly find their way into the most diverse areas of our everyday lives. They indirectly influence people's decisions or opinions through their daily use. Therefore, understanding how and which moral…

计算机与社会 · 计算机科学 2024-07-23 Karina Vida , Fabian Damken , Anne Lauscher