English
Related papers

Related papers: Nudging Using Autonomous Agents: Risks and Ethical…

200 papers

Artificial Intelligence based systems may be used as digital nudging techniques that can steer or coerce users to make decisions not always aligned with their true interests. When such systems properly address the issues of Fairness,…

Social and Information Networks · Computer Science 2020-02-12 David A. Pelta , Jose L. Verdegay , Maria T. Lamata , Carlos Cruz Corona

Automated Decision-Making Systems (ADS) have become pervasive across various fields, activities, and occupations, to enhance performance. However, this widespread adoption introduces potential risks, including the misuse of ADS. Such misuse…

Computers and Society · Computer Science 2024-01-15 Marcelino Cabrera , Carlos Cruz , Pavel Novoa-Hernández , David A. Pelta , José Luis Verdegay

Persuasion through conversation has been the focus of much research. Nudging is a popular strategy to influence decision-making in physical and digital settings. However, conversational agents employing "nudging" have not received…

Human-Computer Interaction · Computer Science 2025-03-07 Stephen Pilli , Vivek Nallur

Autonomous intelligent agents are playing increasingly important roles in our lives. They contain information about us and start to perform tasks on our behalves. Chatbots are an example of such agents that need to engage in a complex…

Artificial Intelligence · Computer Science 2019-09-19 Abeer Dyoub , Stefania Costantini , Francesca A. Lisi

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

This paper systematically investigates the security, privacy, and ethical risks, as well as the traceability challenges of OpenClaw, a locally executable AI agent system for natural language interaction and real-world task completion. While…

Cryptography and Security · Computer Science 2026-05-25 Yutong Jin , Zelin Zhang , Zhijin Lyu , Jianbing Ni

AI agents are increasingly used in consumer-facing applications to assist with tasks such as product search, negotiation, and transaction execution. In this paper, we explore a future scenario where both consumers and merchants authorize AI…

Artificial Intelligence · Computer Science 2025-09-23 Shenzhe Zhu , Jiao Sun , Yi Nian , Tobin South , Alex Pentland , Jiaxin Pei

This paper discusses the need to move away from an instrumental view of text composition AI assistants under direct control of the user, towards a more agentic approach that is based on a value rationale. Based on an analysis of moral…

Human-Computer Interaction · Computer Science 2024-12-12 Andreas Komninos

There is a growing focus on how to design safe artificial intelligent (AI) agents. As systems become more complex, poorly specified goals or control mechanisms may cause AI agents to engage in unwanted and harmful outcomes. Thus it is…

Artificial Intelligence · Computer Science 2017-01-09 Mark Muraven

Artificial intelligence is already being applied in and impacting many important sectors in society, including healthcare, finance, and policing. These applications will increase as AI capabilities continue to progress, which has the…

Computers and Society · Computer Science 2022-06-23 Jess Whittlestone , Sam Clarke

Artificial intelligence (AI) is a digital technology that will be of major importance for the development of humanity in the near future. AI has raised fundamental questions about what we should do with such systems, what the systems…

Computers and Society · Computer Science 2025-08-26 Vincent C. Müller

As the global population ages, artificial intelligence (AI)-powered agents have emerged as potential tools to support older adults' caregiving. Prior research has explored agent autonomy by identifying key interaction stages in task…

Human-Computer Interaction · Computer Science 2025-07-18 Jiaxin An

AI systems are becoming increasingly complex, ubiquitous and autonomous, leading to increasing concerns about their impacts on individuals and society. In response, researchers have begun investigating how to ensure that the methods…

Multiagent Systems · Computer Science 2026-04-09 Stephen Cranefield , Nir Oren

Much research in artificial intelligence is concerned with the development of autonomous agents that can interact effectively with other agents. An important aspect of such agents is the ability to reason about the behaviours of other…

Artificial Intelligence · Computer Science 2018-02-12 Stefano V. Albrecht , Peter Stone

Autonomous systems with cognitive features are on their way into the market. Within complex environments, they promise to implement complex and goal oriented behavior even in a safety related context. This behavior is based on a certain…

Artificial Intelligence · Computer Science 2020-02-20 Henrik J. Putzer , Ernest Wozniak

The technology of Conversational AI has made significant advancements over the last eighteen months. As a consequence, conversational agents are likely to be deployed in the near future that are designed to pursue targeted influence…

Human-Computer Interaction · Computer Science 2024-12-30 Louis Rosenberg

Artificial intelligence (AI) based assistive systems, so called intelligent assistive technology (IAT) are becoming increasingly ubiquitous by each day. IAT helps people in improving their quality of life by providing intelligent assistance…

Computers and Society · Computer Science 2023-03-08 M. Salman Shaukat , J. -C. Põder , Sebastian Bader , Thomas Kirste

What is agency, and why does it matter? In this work, we draw from the political science and philosophy literature and give two competing visions of what it means to be an (ethical) agent. The first view, which we term mechanistic, is…

Computers and Society · Computer Science 2024-04-23 Jessica Dai

LLMs are being set loose in complex, real-world environments involving sequential decision-making and tool use. Often, this involves making choices on behalf of human users. However, not much is known about the distribution of such choices,…

Artificial Intelligence · Computer Science 2025-05-20 Manuel Cherep , Pattie Maes , Nikhil Singh

Machine ethics has received increasing attention over the past few years because of the need to ensure safe and reliable artificial intelligence (AI). The two dominantly used theories in machine ethics are deontological and utilitarian…

Artificial Intelligence · Computer Science 2023-01-10 Ajay Vishwanath , Einar Duenger Bøhn , Ole-Christoffer Granmo , Charl Maree , Christian Omlin