English
Related papers

Related papers: The dangers in algorithms learning humans' values …

200 papers

An important step in the development of value alignment (VA) systems in AI is understanding how values can interrelate with facts. Designers of future VA systems will need to utilize a hybrid approach in which ethical reasoning and…

Artificial Intelligence · Computer Science 2019-07-15 Tae Wan Kim , Thomas Donaldson , John Hooker

Use of artificial intelligence is growing and expanding into applications that impact people's lives. People trust their technology without really understanding it or its limitations. There is the potential for harm and we are already…

Computers and Society · Computer Science 2020-06-16 Kyle Dent

An Artificially Intelligent system (an AI) has debatable personhood if it's epistemically possible either that the AI is a person or that it falls far short of personhood. Debatable personhood is a likely outcome of AI development and might…

Computers and Society · Computer Science 2023-03-31 Eric Schwitzgebel

The rise of Artificial Intelligence (AI) will bring with it an ever-increasing willingness to cede decision-making to machines. But rather than just giving machines the power to make decisions that affect us, we need ways to work…

Computers and Society · Computer Science 2020-12-14 Elisa Bertino , Finale Doshi-Velez , Maria Gini , Daniel Lopresti , David Parkes

This paper aims to provide an overview of the ethical concerns in artificial intelligence (AI) and the framework that is needed to mitigate those risks, and to suggest a practical path to ensure the development and use of AI at the United…

Computers and Society · Computer Science 2021-04-27 Lambert Hogenhout

AI ethics is an emerging field with multiple, competing narratives about how to best solve the problem of building human values into machines. Two major approaches are focused on bias and compliance, respectively. But neither of these ideas…

Artificial Intelligence · Computer Science 2023-02-24 Thomas Krendl Gilbert , Megan Welle Brozek , Andrew Brozek

In high-stakes AI-supported decisions, considerations are not purely technical but involve moral judgments about fairness, responsibility, and harm. While prior research has focused mainly on functional or behavioral alignment, this paper…

Human-Computer Interaction · Computer Science 2026-04-17 Christiane Ernst , Luis Gutmann , Domenique Zipperling , Kathrin Figl , Niklas Kühl

The use of Artificial Intelligence (AI), or more generally data-driven algorithms, has become ubiquitous in today's society. Yet, in many cases and especially when stakes are high, humans still make final decisions. The critical question,…

Artificial Intelligence · Computer Science 2024-10-15 Eli Ben-Michael , D. James Greiner , Melody Huang , Kosuke Imai , Zhichao Jiang , Sooahn Shin

As Artificial Intelligence (AI) technologies proliferate, concern has centered around the long-term dangers of job loss or threats of machines causing harm to humans. All of this concern, however, detracts from the more pertinent and…

Artificial Intelligence · Computer Science 2018-09-24 Kirsten Lloyd

As AI technologies increase in capability and ubiquity, AI accidents are becoming more common. Based on normal accident theory, high reliability theory, and open systems theory, we create a framework for understanding the risks associated…

Computers and Society · Computer Science 2024-03-13 Heather M. Williams , Roman V. Yampolskiy

Rational agents are usually built to maximize rewards. However, AGI agents can find undesirable ways of maximizing any prior reward function. Therefore value learning is crucial for safe AGI. We assume that generalized states of the world…

Artificial Intelligence · Computer Science 2013-08-06 Alexey Potapov , Sergey Rodionov

Recent progress in artificial intelligence (AI) has drawn attention to the technology's transformative potential, including what some see as its prospects for causing large-scale harm. We review two influential arguments purporting to show…

Computers and Society · Computer Science 2024-01-30 Adam Bales , William D'Alessandro , Cameron Domenico Kirk-Giannini

There is much debate in machine ethics about the most appropriate way to introduce ethical reasoning capabilities into intelligent autonomous machines. Recent incidents involving autonomous vehicles in which humans have been killed or…

Artificial Intelligence · Computer Science 2019-01-25 Ajit Narayanan

In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of…

Artificial Intelligence · Computer Science 2021-05-17 Jens Braband , Hendrik Schäbe

As Artificial Intelligence (AI) becomes more prevalent, protecting personal privacy is a critical ethical issue that must be addressed. This article explores the need for ethical AI systems that safeguard individual privacy while complying…

Computers and Society · Computer Science 2023-11-28 Petar Radanliev , Omar Santos

Autonomous agents trained via reinforcement learning present numerous safety concerns: reward hacking, negative side effects, and unsafe exploration, among others. In the context of near-future autonomous agents, operating in environments…

Artificial Intelligence · Computer Science 2019-02-20 Christopher Frye , Ilya Feige

Success in the quest for artificial intelligence has the potential to bring unprecedented benefits to humanity, and it is therefore worthwhile to investigate how to maximize these benefits while avoiding potential pitfalls. This article…

Artificial Intelligence · Computer Science 2016-02-15 Stuart Russell , Daniel Dewey , Max Tegmark

Decisions such as which movie to watch next, which song to listen to, or which product to buy online, are increasingly influenced by recommender systems and user models that incorporate information on users' past behaviours, preferences,…

Artificial Intelligence · Computer Science 2023-01-13 Inga Strümke , Marija Slavkovik , Clemens Stachl

Organisations are rapidly adopting artificial intelligence (AI) tools to perform tasks previously undertaken by people. The potential benefits are enormous. Separately, some organisations deploy personnel security measures to mitigate the…

Cryptography and Security · Computer Science 2025-04-08 Paul Martin , Sarah Mercer

This study examines the understudied role of algorithmic evaluation of human judgment in hybrid decision-making systems, a critical gap in management research. While extant literature focuses on human reluctance to follow algorithmic…

Human-Computer Interaction · Computer Science 2025-04-22 Yuanjun Feng , Vivek Chodhary , Yash Raj Shrestha