English
Related papers

Related papers: On the possibility of deep alignment

200 papers

AI Safety researchers attempting to align values of highly capable intelligent systems with those of humanity face a number of challenges including personal value extraction, multi-agent value merger and finally in-silico encoding.…

Artificial Intelligence · Computer Science 2019-01-08 Roman V. Yampolskiy

Understanding the emergence of cooperation in systems of computational agents is crucial for the development of effective cooperative AI. Interaction among individuals in real-world settings are often sparse and occur within a broad…

Multiagent Systems · Computer Science 2024-01-24 Nicole Orzan , Erman Acar , Davide Grossi , Roxana Rădulescu

Practical uses of Artificial Intelligence (AI) in the real world have demonstrated the importance of embedding moral choices into intelligent agents. They have also highlighted that defining top-down ethical constraints on AI according to…

Multiagent Systems · Computer Science 2023-08-31 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

There is a consensus that human and non-human subjects experience temporal distortions in many stages of their perceptual and decision-making systems. Similarly, intertemporal choice research has shown that decision-makers undervalue future…

Neurons and Cognition · Quantitative Biology 2016-05-31 Pedro A. Ortega , Naftali Tishby

The ongoing evolution of AI paradigms has propelled AI research into the agentic AI stage. Consequently, the focus of research has shifted from single agents and simple applications towards multi-agent autonomous decision-making and task…

Artificial Intelligence · Computer Science 2025-08-08 Wei Zeng , Hengshu Zhu , Chuan Qin , Han Wu , Yihang Cheng , Sirui Zhang , Xiaowei Jin , Yinuo Shen , Zhenxing Wang , Feimin Zhong , Hui Xiong

We discuss the possibility of world models and active exploration as emergent properties of open-ended behavior optimization in autonomous agents. In discussing the source of the open-endedness of living things, we start from the…

Neural and Evolutionary Computing · Computer Science 2024-11-20 Kazuya Horibe , Naoto Yoshida

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

Machine Learning · Computer Science 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Cognitive modeling, which explores the essence of cognition, including motivation, emotion, and perception, has been widely applied in the artificial intelligence (AI) agent domains, such as robotics. From the computational perspective,…

Robotics · Computer Science 2026-03-10 Qin Yang

Artificial life aims to understand the fundamental principles of biological life by creating computational models that exhibit life-like properties. Although artificial life systems show promise for simulating biological evolution,…

Neural and Evolutionary Computing · Computer Science 2025-06-04 Niko Lorantos , Lee Spector

Achieving human-AI alignment in complex multi-agent games is crucial for creating trustworthy AI agents that enhance gameplay. We propose a method to evaluate this alignment using an interpretable task-sets framework, focusing on high-level…

Artificial Intelligence · Computer Science 2024-06-21 Sugandha Sharma , Guy Davidson , Khimya Khetarpal , Anssi Kanervisto , Udit Arora , Katja Hofmann , Ida Momennejad

Computational agents support humans in many areas of life and are therefore found in heterogeneous contexts. This means they operate in rapidly changing environments and can be confronted with huge state and action spaces. In order to…

Artificial Intelligence · Computer Science 2023-08-31 Nicole Merkle , Ralf Mikut

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view each time examining…

Information Theory · Computer Science 2015-12-03 Panteleimon Rodis

In this paper, we consider a general distributed system with multiple agents who select and then implement actions in the system. The system has an operator with a centralized objective. The agents, on the other hand, are selfinterested and…

Computer Science and Game Theory · Computer Science 2020-01-15 Donya Ghavidel , Pratyush Chakraborty , Enrique Baeyens , Vijay Gupta , Pramod P. Khargonekar

In this paper we present a computational modeling account of an active self in artificial agents. In particular we focus on how an agent can be equipped with a sense of control and how it arises in autonomous situated action and, in turn,…

Artificial Intelligence · Computer Science 2021-12-13 Sebastian Kahl , Sebastian Wiese , Nele Russwinkel , Stefan Kopp

With recent and rapid advancements in artificial intelligence (AI), understanding the foundation of purposeful behaviour in autonomous agents is crucial for developing safe and efficient systems. While artificial neural networks have…

Artificial Intelligence · Computer Science 2025-08-12 Aswin Paul , Moein Khajehnejad , Forough Habibollahi , Brett J. Kagan , Adeel Razi

We argue that an explainable artificial intelligence must possess a rationale for its decisions, be able to infer the purpose of observed behaviour, and be able to explain its decisions in the context of what its audience understands and…

Artificial Intelligence · Computer Science 2021-04-26 Michael Timothy Bennett , Yoshihiro Maruyama

I model the belief formation and decision making processes of economic agents during a monetary policy regime change (an acceleration in the money supply) with a deep reinforcement learning algorithm in the AI literature. I show that when…

Theoretical Economics · Economics 2022-10-25 Rui , Shi

A primary motivation for our research in Digital Ecosystems is the desire to exploit the self-organising properties of biological ecosystems. Ecosystems are thought to be robust, scalable architectures that can automatically solve complex,…

Neural and Evolutionary Computing · Computer Science 2009-10-05 Gerard Briscoe , Philippe De Wilde

Contextual policy search allows adapting robotic movement primitives to different situations. For instance, a locomotion primitive might be adapted to different terrain inclinations or desired walking speeds. Such an adaptation is often…

Machine Learning · Statistics 2015-11-17 Jan Hendrik Metzen

Intrinsic Motivation (IM) aims to train agents without external rewards, enabling useful behavior to emerge from the agent's interaction with its environment alone. However, the dominant IM approaches rely on information-theoretic…

Artificial Intelligence · Computer Science 2026-05-12 Tristan Shah , Stas Tiomkin
‹ Prev 1 8 9 10 Next ›