中文
相关论文

相关论文: A Comparative Analysis on Ethical Benchmarking in …

200 篇论文

This paper investigates the ethical implications of aligning Large Language Models (LLMs) with financial optimization, through the case study of GreedLlama, a model fine-tuned to prioritize economically beneficial outcomes. By comparing…

计算与语言 · 计算机科学 2024-04-05 Jeffy Yu , Maximilian Huber , Kevin Tang

This study addresses ethical issues surrounding Large Language Models (LLMs) within the field of artificial intelligence. It explores the common ethical challenges posed by both LLMs and other AI systems, such as privacy and fairness, as…

计算机与社会 · 计算机科学 2025-06-17 Junfeng Jiao , Saleh Afroogh , Yiming Xu , Connor Phillips

The increasing integration of large language models (LLMs) into mental health applications necessitates robust frameworks for evaluating professional safety alignment. Current evaluative approaches primarily rely on refusal-based safety…

Evaluating the value alignment of large language models (LLMs) has traditionally relied on single-sentence adversarial prompts, which directly probe models with ethically sensitive or controversial questions. However, with the rapid…

计算与语言 · 计算机科学 2025-03-31 Yazhou Zhang , Qimeng Liu , Qiuchi Li , Peng Zhang , Jing Qin

Many sets of ethics principles for responsible AI have been proposed to allay concerns about misuse and abuse of AI/ML systems. The underlying aspects of such sets of principles include privacy, accuracy, fairness, robustness,…

计算机与社会 · 计算机科学 2024-09-09 Conrad Sanderson , David Douglas , Qinghua Lu

The project of aligning machine behavior with human values raises a basic problem: whose moral expectations should guide AI decision-making? Much alignment research assumes that the appropriate benchmark is how humans themselves would act…

计算机与社会 · 计算机科学 2026-05-13 Benjamin Minhao Chen , Xinyu Xie

Artificial intelligence has demonstrated significant potential in clinical decision-making; however, developing models capable of adapting to diverse real-world scenarios and performing complex diagnostic reasoning remains a major…

计算机视觉与模式识别 · 计算机科学 2025-08-18 Ronghao Xu , Zhen Huang , Yangbo Wei , Xiaoqian Zhou , Zikang Xu , Ting Liu , Zihang Jiang , S. Kevin Zhou

Algorithmic discrimination is a critical concern as machine learning models are used in high-stakes decision-making in legally protected contexts. Although substantial research on algorithmic bias and discrimination has led to the…

计算机与社会 · 计算机科学 2025-06-18 Holli Sargeant , Måns Magnusson

[Context] Generative AI technologies, particularly Large Language Models (LLMs), have transformed numerous domains by enhancing convenience and efficiency in information retrieval, content generation, and decision-making processes. However,…

计算机与社会 · 计算机科学 2025-08-25 Yutan Huang , Chetan Arora , Wen Cheng Houng , Tanjila Kanij , Anuradha Madulgalla , John Grundy

This research develops advanced methodologies for Large Language Models (LLMs) to better manage linguistic behaviors related to emotions and ethics. We introduce DIKE, an adversarial framework that enhances the LLMs' ability to internalize…

计算与语言 · 计算机科学 2024-05-15 Edward Y. Chang

Demand for mental health support through AI chatbots is surging, though current systems present several limitations, like sycophancy or overvalidation, and reinforcement of maladaptive beliefs. A core obstacle to the creation of better…

计算与语言 · 计算机科学 2025-12-08 José Pombal , Maya D'Eon , Nuno M. Guerreiro , Pedro Henrique Martins , António Farinhas , Ricardo Rei

AI models are increasingly prevalent in high-stakes environments, necessitating thorough assessment of their capabilities and risks. Benchmarks are popular for measuring these attributes and for comparing model performance, tracking…

人工智能 · 计算机科学 2024-11-21 Anka Reuel , Amelia Hardy , Chandler Smith , Max Lamparth , Malcolm Hardy , Mykel J. Kochenderfer

In the last five years, private companies, research institutions as well as public sector organisations have issued principles and guidelines for ethical AI, yet there is debate about both what constitutes "ethical AI" and which ethical…

计算机与社会 · 计算机科学 2019-09-04 Anna Jobin , Marcello Ienca , Effy Vayena

In this research, we introduce BEATS, a novel framework for evaluating Bias, Ethics, Fairness, and Factuality in Large Language Models (LLMs). Building upon the BEATS framework, we present a bias benchmark for LLMs that measure performance…

计算与语言 · 计算机科学 2025-04-01 Alok Abhishek , Lisa Erickson , Tushar Bandopadhyay

In difficult decision-making scenarios, it is common to have conflicting opinions among expert human decision-makers as there may not be a single right answer. Such decisions may be guided by different attributes that can be used to…

计算与语言 · 计算机科学 2024-06-11 Brian Hu , Bill Ray , Alice Leung , Amy Summerville , David Joy , Christopher Funk , Arslan Basharat

As large language models (LLMs) become increasingly integrated into society, their alignment with human morals is crucial. To better understand this alignment, we created a large corpus of human- and LLM-generated responses to various moral…

人机交互 · 计算机科学 2024-10-11 Basile Garcia , Crystal Qian , Stefano Palminteri

The integration of Large Language Models (LLMs) in social robotics presents a unique set of ethical challenges and social impacts. This research is set out to identify ethical considerations that arise in the design and development of these…

机器人学 · 计算机科学 2024-06-13 Alva Markelius

As large language models (LLMs) are increasingly deployed in high-stakes settings, their ability to refuse ethically sensitive prompts-such as those involving hate speech or illegal activities-has become central to content moderation and…

人机交互 · 计算机科学 2025-05-22 Stefan Pasch

Artificial intelligence (AI) is advancing at a pace that raises urgent questions about how to align machine decision-making with human moral values. This working paper investigates how leading AI systems prioritize moral outcomes and what…

人工智能 · 计算机科学 2025-09-15 Eoin O'Doherty , Nicole Weinrauch , Andrew Talone , Uri Klempner , Xiaoyuan Yi , Xing Xie , Yi Zeng

While the operationalisation of high-level AI ethics principles into practical AI/ML systems has made progress, there is still a theory-practice gap in managing tensions between the underlying AI ethics aspects. We cover five approaches for…

计算机与社会 · 计算机科学 2024-12-25 Conrad Sanderson , Emma Schleiger , David Douglas , Petra Kuhnert , Qinghua Lu