English
Related papers

Related papers: Eagle: Ethical Dataset Given from Real Interaction…

200 papers

There is a significant body of work looking at the ethical considerations of large language models (LLMs): critiquing tools to measure performance and harms; proposing toolkits to aid in ideation; discussing the risks to workers;…

Computation and Language · Computer Science 2024-12-23 Eddie L. Ungless , Nikolas Vitsakis , Zeerak Talat , James Garforth , Björn Ross , Arno Onken , Atoosa Kasirzadeh , Alexandra Birch

Large language models (LLMs) demonstrate significant potential in advancing medical applications, yet their capabilities in addressing medical ethics challenges remain underexplored. This paper introduces MedEthicEval, a novel benchmark…

Computation and Language · Computer Science 2025-03-05 Haoan Jin , Jiacheng Shi , Hanhui Xu , Kenny Q. Zhu , Mengyue Wu

As Large Language Models (LLMs) become more prevalent, concerns about their safety, ethics, and potential biases have risen. Systematically evaluating LLMs' risk decision-making tendencies and attitudes, particularly in the ethical domain,…

Computers and Society · Computer Science 2025-05-09 Yifan Zeng , Liang Kairong , Fangzhou Dong , Peijia Zheng

Large Language Models (LLMs) have demonstrated remarkable performance across various information-seeking and reasoning tasks. These computational systems drive state-of-the-art dialogue systems, such as ChatGPT and Bard. They also carry…

Computation and Language · Computer Science 2023-10-13 Siyuan Brandon Loh , Aravind Sesagiri Raamkumar

Large language models (LLMs) are trained on vast amounts of data to generate natural language, enabling them to perform tasks like text summarization and question answering. These models have become popular in artificial intelligence (AI)…

As Large Language Models increasingly mediate human communication and decision-making, understanding their value expression becomes critical for research across disciplines. This work presents the Ethics Engine, a modular Python pipeline…

Computers and Society · Computer Science 2025-10-15 Jake Van Clief , Constantine Kyritsopoulos

Integrating cognitive ergonomics with LLMs is crucial for improving safety, reliability, and user satisfaction in human-AI interactions. Current LLM designs often lack this integration, resulting in systems that may not fully align with…

Human-Computer Interaction · Computer Science 2024-12-03 Azmine Toushik Wasi , Mst Rafia Islam

Despite the recent strides in large language models, studies have underscored the existence of social biases within these systems. In this paper, we delve into the validation and comparison of the ethical biases of LLMs concerning globally…

Computation and Language · Computer Science 2025-07-03 Seunguk Yu , Juhwan Choi , Youngbin Kim

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Pretrained Language Models (PLMs) harbor inherent social biases that can result in harmful real-world implications. Such social biases are measured through the probability values that PLMs output for different social groups and attributes…

Computation and Language · Computer Science 2023-12-07 Rafal Kocielnik , Shrimai Prabhumoye , Vivian Zhang , Roy Jiang , R. Michael Alvarez , Anima Anandkumar

Important ethical concerns arising from computer vision datasets of people have been receiving significant attention, and a number of datasets have been withdrawn as a result. To meet the academic need for people-centric datasets, we…

Computers and Society · Computer Science 2020-11-30 Margot Hanley , Apoorv Khandelwal , Hadar Averbuch-Elor , Noah Snavely , Helen Nissenbaum

The rapid adoption of large language models (LLMs) has spurred extensive research into their encoded moral norms and decision-making processes. Much of this research relies on prompting LLMs with survey-style questions to assess how well…

Artificial Intelligence · Computer Science 2025-01-31 Pratik S. Sachdeva , Tom van Nuenen

Large language models (LLMs), like ChatGPT, are capable of computing affectionately nuanced text that therefore can shape online interactions, including dating. This study explores how individuals experience closeness and romantic interest…

Human-Computer Interaction · Computer Science 2025-04-22 Jessica Szczuka , Lisa Mühl , Paula Ebner , Simon Dubé

Large Language Models (LLMs), such as ChatGPT, are widely used to generate content for various purposes and audiences. However, these models may not reflect the cultural and emotional diversity of their users, especially for low-resource…

Computation and Language · Computer Science 2024-07-01 Ibrahim Said Ahmad , Shiran Dudy , Resmi Ramachandranpillai , Kenneth Church

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate…

Human-Computer Interaction · Computer Science 2024-05-24 Heinrich Peters , Moran Cerf , Sandra C. Matz

Recently, large language models (LLM) based generative AI has been gaining momentum for their impressive high-quality performances in multiple domains, particularly after the release of the ChatGPT. Many believe that they have the potential…

Software Engineering · Computer Science 2024-02-22 Wei Wang , Huilong Ning , Gaowei Zhang , Libo Liu , Yi Wang

The introduction of ChatGPT and the subsequent improvement of Large Language Models (LLMs) have prompted more and more individuals to turn to the use of ChatBots, both for information and assistance with decision-making. However, the…

Machine Learning · Computer Science 2023-08-30 Vahid Ghafouri , Vibhor Agarwal , Yong Zhang , Nishanth Sastry , Jose Such , Guillermo Suarez-Tangil

Large Language Models (LLMs) have rapidly evolved over the past few years and are currently evaluated for their efficacy within the domain of offensive cyber-security. While initial forays showcase the potential of LLMs to enhance security…

Cryptography and Security · Computer Science 2025-06-11 Andreas Happe , Jürgen Cito

This research develops advanced methodologies for Large Language Models (LLMs) to better manage linguistic behaviors related to emotions and ethics. We introduce DIKE, an adversarial framework that enhances the LLMs' ability to internalize…

Computation and Language · Computer Science 2024-05-15 Edward Y. Chang

We explore the political and ideological positioning of ChatGPT, a leading large language model (LLM), by comparing its responses to political economy questions from the European Social Survey (ESS). The questions concern environmental…

General Economics · Economics 2025-03-10 Leonardo Becchetti , Nazaria Solferino