English
Related papers

Related papers: Evaluating Language Models for Harmful Manipulatio…

200 papers

Recent gains in popularity of AI conversational agents have led to their increased use for improving productivity and supporting well-being. While previous research has aimed to understand the risks associated with interactions with AI…

While demands for change and accountability for harmful AI consequences mount, foreseeing the downstream effects of deploying AI systems remains a challenging task. We developed AHA! (Anticipating Harms of AI), a generative framework to…

Human-Computer Interaction · Computer Science 2023-06-07 Zana Buçinca , Chau Minh Pham , Maurice Jakesch , Marco Tulio Ribeiro , Alexandra Olteanu , Saleema Amershi

Calls for new metrics, technical standards and governance mechanisms to guide the adoption of Artificial Intelligence (AI) in institutions and public administration are now commonplace. Yet, most research and policy efforts aimed at…

Computers and Society · Computer Science 2023-07-21 Vincent J. Straub , Deborah Morgan , Youmna Hashem , John Francis , Saba Esnaashari , Jonathan Bright

Although general-purpose AI systems offer transformational opportunities in science and industry, they simultaneously raise critical concerns about safety, misuse, and potential loss of control. Despite these risks, methods for assessing…

Computers and Society · Computer Science 2025-12-12 Malcolm Murray , Steve Barrett , Henry Papadatos , Otter Quarks , Matt Smith , Alejandro Tlaie Boria , Chloé Touzet , Siméon Campos

The growing influence of Artificial Intelligence (AI) systems on decision-making in critical domains has exposed their potential to cause significant harms, often rooted in biases embedded across the AI lifecycle. While existing frameworks…

Computers and Society · Computer Science 2025-12-04 Nicoleta Tantalaki , Sophia Vei , Athena Vakali

Language data and models demonstrate various types of bias, be it ethnic, religious, gender, or socioeconomic. AI/NLP models, when trained on the racially biased dataset, AI/NLP models instigate poor model explainability, influence user…

Computation and Language · Computer Science 2022-11-28 Kinshuk Sengupta , Praveen Ranjan Srivastava

Evaluating the safety of AI Systems is a pressing concern for organizations deploying them. In addition to the societal damage done by the lack of fairness of those systems, deployers are concerned about the legal repercussions and the…

AI agents that take actions in their environment autonomously over extended time horizons require robust governance interventions to curb their potentially consequential risks. Prior proposals for governing AI agents primarily target…

Computers and Society · Computer Science 2025-12-02 K. J. Kevin Feng , Tae Soo Kim , Rock Yuren Pang , Faria Huq , Tal August , Amy X. Zhang

The proliferation of applications using artificial intelligence (AI) systems has led to a growing number of users interacting with these systems through sophisticated interfaces. Human-computer interaction research has long shown that…

Human-Computer Interaction · Computer Science 2024-05-22 Lujain Ibrahim , Luc Rocher , Ana Valdivia

The rapid advancement of Large Language Models (LLMs), reasoning models, and agentic AI approaches coincides with a growing global mental health crisis, where increasing demand has not translated into adequate access to professional…

Human-Computer Interaction · Computer Science 2025-04-03 Kellie Yu Hui Sim , Kenny Tsu Wei Choo

AI and humans bring complementary skills to group deliberations. Modeling this group decision making is especially challenging when the deliberations include an element of risk and an exploration-exploitation process of appraising the…

Human-Computer Interaction · Computer Science 2022-01-11 Wei Ye , Francesco Bullo , Noah Friedkin , Ambuj K Singh

Despite impressive performance in many benchmark datasets, AI models can still make mistakes, especially among out-of-distribution examples. It remains an open question how such imperfect models can be used effectively in collaboration with…

Artificial Intelligence · Computer Science 2022-04-26 Vivian Lai , Samuel Carton , Rajat Bhatnagar , Q. Vera Liao , Yunfeng Zhang , Chenhao Tan

Following the rapid increase in Artificial Intelligence (AI) capabilities in recent years, the AI community has voiced concerns regarding possible safety risks. To support decision-making on the safe use and development of AI systems, there…

Machine Learning · Computer Science 2025-04-01 Gil Gekker , Meirav Segal , Dan Lahav , Omer Nevo

Many real-world applications of language models (LMs), such as writing assistance and code autocomplete, involve human-LM interaction. However, most benchmarks are non-interactive in that a model produces output without human involvement.…

Artificial Intelligence (AI) models are now being utilized in all facets of our lives such as healthcare, education and employment. Since they are used in numerous sensitive environments and make decisions that can be life altering,…

Artificial Intelligence · Computer Science 2024-03-27 Tahsin Alamgir Kheya , Mohamed Reda Bouadjenek , Sunil Aryal

The paradigm of pretrained deep learning models has recently emerged in artificial intelligence practice, allowing deployment in numerous societal settings with limited computational resources, but also embedding biases and enabling…

Computers and Society · Computer Science 2019-09-10 Lav R. Varshney , Nitish Shirish Keskar , Richard Socher

Artificial Intelligence (AI) is one of the most transformative technologies of the 21st century. The extent and scope of future AI capabilities remain a key uncertainty, with widespread disagreement on timelines and potential impacts. As…

Artificial Intelligence · Computer Science 2023-11-27 Kyle A. Kilian , Christopher J. Ventura , Mark M. Bailey

AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only…

Computation and Language · Computer Science 2026-04-20 Myke C. Cohen , Mingqian Zheng , Neel Bhandari , Hsien-Te Kao , Xuhui Zhou , Daniel Nguyen , Laura Cassani , Maarten Sap , Svitlana Volkova

AI-based systems have been used widely across various industries for different decisions ranging from operational decisions to tactical and strategic ones in low- and high-stakes contexts. Gradually the weaknesses and issues of these…

Human-Computer Interaction · Computer Science 2022-01-13 Morteza Saberi

Artificial Intelligence (AI) is reshaping many societal domains, raising critical questions about its risks, benefits, and the potential misalignment between public and academic perspectives. This study examines how the general public…

Computers and Society · Computer Science 2026-05-05 Philipp Brauner , Felix Glawe , Gian Luca Liehner , Luisa Vervier , Martina Ziefle