中文
相关论文

相关论文: Should Robots be Obedient?

200 篇论文

Machine learning algorithms enable advanced decision making in contemporary intelligent systems. Research indicates that there is a tradeoff between their model performance and explainability. Machine learning models with higher performance…

机器学习 · 计算机科学 2022-06-23 Lukas-Valentin Herm , Kai Heinrich , Jonas Wanner , Christian Janiesch

When robots enter everyday human environments, they need to understand their tasks and how they should perform those tasks. To encode these, reward functions, which specify the objective of a robot, are employed. However, designing reward…

机器人学 · 计算机科学 2022-10-21 Erdem Bıyık

To facilitate human-robot interaction and gain human trust, a robot should recognize and adapt to changes in human behavior. This work documents different human behaviors observed while taking objects from an interactive robot in an…

机器人学 · 计算机科学 2025-01-07 Parag Khanna , Elmira Yadollahi , Iolanda Leite , Mårten Björkman , Christian Smith

It is intractable for assistive robots to have all functionalities pre-programmed prior to deployment. Rather, it is more realistic for robots to perform supplemental, on-site learning about user's needs and preferences, and particularities…

机器人学 · 计算机科学 2022-10-19 Nina Moorman , Erin Hedlund-Botti , Matthew Gombolay

Previous research found that robots should best be designed to fit their given task, whilst others identified gender effects in people's evaluations of robots. This study combines this knowledge to investigate stereotyping effects of robot…

机器人学 · 计算机科学 2021-04-14 Sven Y. Neuteboom , Maartje M. A. de Graaf

AI systems increasingly support human decision-making. In many cases, despite the algorithm's superior performance, the final decision remains in human hands. For example, an AI may assist doctors in determining which diagnostic tests to…

人工智能 · 计算机科学 2026-02-20 Gali Noti , Kate Donahue , Jon Kleinberg , Sigal Oren

Learning robot objective functions from human input has become increasingly important, but state-of-the-art techniques assume that the human's desired objective lies within the robot's hypothesis space. When this is not true, even methods…

机器学习 · 计算机科学 2018-10-29 Andreea Bobu , Andrea Bajcsy , Jaime F. Fisac , Anca D. Dragan

Human-robot interaction exerts influence towards the human, which often changes behavior. This article explores an externality of this changed behavior - preference change. It expands on previous work on preference change in AI systems.…

机器人学 · 计算机科学 2022-06-22 Matija Franklin , Hal Ashton

Specifying reward functions for robots that operate in environments without a natural reward signal can be challenging, and incorrectly specified rewards can incentivise degenerate or dangerous behavior. A promising alternative to manually…

人工智能 · 计算机科学 2021-01-20 Rachel Freedman , Rohin Shah , Anca Dragan

Robots can learn the right reward function by querying a human expert. Existing approaches attempt to choose questions where the robot is most uncertain about the human's response; however, they do not consider how easy it will be for the…

机器人学 · 计算机科学 2019-10-11 Erdem Bıyık , Malayandi Palan , Nicholas C. Landolfi , Dylan P. Losey , Dorsa Sadigh

Trust is a critical issue in Human Robot Interactions as it is the core of human desire to accept and use a non human agent. Theory of Mind has been defined as the ability to understand the beliefs and intentions of others that may differ…

机器人学 · 计算机科学 2021-01-27 Wenxuan Mou , Martina Ruocco , Debora Zanatto , Angelo Cangelosi

A robot operating in isolation needs to reason over the uncertainty in its model of the world and adapt its own actions to account for this uncertainty. Similarly, a robot interacting with people needs to reason over its uncertainty over…

机器人学 · 计算机科学 2017-08-07 Stefanos Nikolaidis , Jodi Forlizzi , David Hsu , Julie Shah , Siddhartha Srinivasa

Predictive human models often need to adapt their parameters online from human data. This raises previously ignored safety-related questions for robots relying on these models such as what the model could learn online and how quickly could…

机器人学 · 计算机科学 2021-10-01 Andrea Bajcsy , Anand Siththaranjan , Claire J. Tomlin , Anca D. Dragan

Robot understanding of human intentions is essential for fluid human-robot interaction. Intentions, however, cannot be directly observed and must be inferred from behaviors. We learn a model of adaptive human behavior conditioned on the…

机器人学 · 计算机科学 2019-01-23 Min Chen , David Hsu , Wee Sun Lee

Deep learning's success in perception, natural language processing, etc. inspires hopes for advancements in autonomous robotics. However, real-world robotics face challenges like variability, high-dimensional state spaces, non-linear…

机器人学 · 计算机科学 2025-01-28 Sven Behnke

People are known to judge artificial intelligence using a utilitarian moral philosophy and humans using a moral philosophy emphasizing perceived intentions. But why do people judge humans and machines differently? Psychology suggests that…

计算机与社会 · 计算机科学 2023-09-20 Jingling Zhang , Jane Conway , César A. Hidalgo

Language-capable robots hold unique persuasive power over humans, and thus can help regulate people's behavior and preserve a better moral ecosystem, by rejecting unethical commands and calling out norm violations. However, miscalibrated…

机器人学 · 计算机科学 2022-10-18 Ruchen Wen , Tom Williams

Humans have an extraordinary ability to communicate and read the properties of objects by simply watching them being carried by someone else. This level of communicative skills and interpretation, available to humans, is essential for…

Robotic agents that share autonomy with a human should leverage human domain knowledge and account for their preferences when completing a task. This extra knowledge can dramatically improve plan efficiency and user-satisfaction, but these…

机器人学 · 计算机科学 2018-05-22 Rosario Scalise , Yonatan Bisk , Maxwell Forbes , Daqing Yi , Yejin Choi , Siddhartha Srinivasa

With the introduction of collaborative robots, humans and robots can now work together in close proximity and share the same workspace. However, this collaboration presents various challenges that need to be addressed to ensure seamless…

机器人学 · 计算机科学 2023-07-24 Ali Noormohammadi-Asl , Ali Ayub , Stephen L. Smith , Kerstin Dautenhahn