English
Related papers

Related papers: Novelty Search makes Evolvability Inevitable

200 papers

What drives exploration? Understanding intrinsic motivation is a long-standing challenge in both cognitive science and artificial intelligence; numerous objectives have been proposed and used to train agents, yet there remains a gap between…

Artificial Intelligence · Computer Science 2025-05-29 Aly Lidayan , Yuqing Du , Eliza Kosoy , Maria Rufova , Pieter Abbeel , Alison Gopnik

Cooperation is fundamental to human societies. While several basic theoretical mechanisms underlying its evolution have been established, research addressing more realistic settings remains underdeveloped. Drawing on the hypothesis that…

Physics and Society · Physics 2025-09-01 Masaaki Inaba , Eizo Akiyama

Innovation and evolution are two processes of paramount relevance for social and biological systems. In general, the former allows to introduce elements of novelty, while the latter is responsible for the motion of a system in its phase…

Physics and Society · Physics 2018-04-11 Marco Antonio Amaral , Marco Alberto Javarone

Phenotypic plasticity and its evolution may help evolutionary rescue in a novel and stressful environment, especially if environmental novelty reveals cryptic genetic variation that enables the evolution of increased plasticity. However,…

Populations and Evolution · Quantitative Biology 2016-09-23 Jaime Ashander , Luis-Miguel Chevin , Marissa L. Baskett

We identify a distinct motive for search, termed catalytic exploration, where agents rationally explore alternatives they expect to reject to resolve uncertainty about the status quo. By decomposing option value into switching and catalytic…

Theoretical Economics · Economics 2025-11-25 Zeyu He

Tasks with large state space and sparse rewards present a longstanding challenge to reinforcement learning. In these tasks, an agent needs to explore the state space efficiently until it finds a reward. To deal with this problem, the…

Machine Learning · Computer Science 2023-10-16 Jiaheng Hu , Zizhao Wang , Peter Stone , Roberto Martin-Martin

Humans perceive and interact with the world with the awareness of equivariance, facilitating us in manipulating different objects in diverse poses. For robotic manipulation, such equivariance also exists in many scenarios. For example, no…

Robotics · Computer Science 2024-08-08 Yue Chen , Chenrui Tie , Ruihai Wu , Hao Dong

Robots must know how to be gentle when they need to interact with fragile objects, or when the robot itself is prone to wear and tear. We propose an approach that enables deep reinforcement learning to train policies that are gentle, both…

A learning process with the plasticity property often requires reinforcement signals to guide the process. However, in some tasks (e.g. maze-navigation), it is very difficult (or impossible) to measure the performance of an agent (i.e. a…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

In human societies the probability of strategy adoption from a given person may be affected by the personal features. Now we investigate how an artificially imposed restricted ability to reproduce, overruling ones fitness, affects an…

Populations and Evolution · Quantitative Biology 2008-04-10 A. Szolnoki , M. Perc , G. Szabo

Swarming behaviors in animals have been extensively studied due to their implications for the evolution of cooperation, social cognition, and predator-prey dynamics. An important goal of these studies is discerning which evolutionary…

Populations and Evolution · Quantitative Biology 2015-03-13 Randal S. Olson , Arend Hintze , Fred C. Dyer , David B. Knoester , Christoph Adami

Affordance refers to the perception of possible actions allowed by an object. Despite its relevance to human-computer interaction, no existing theory explains the mechanisms that underpin affordance-formation; that is, how affordances are…

Human-Computer Interaction · Computer Science 2022-01-10 Yi-Chi Liao , Kashyap Todi , Aditya Acharya , Antti Keurulainen , Andrew Howes , Antti Oulasvirta

Quality-Diversity is a family of evolutionary algorithms that generate diverse, high-performing solutions through local competition principles inspired by natural evolution. While research has focused on improving specific aspects of…

Neural and Evolutionary Computing · Computer Science 2025-02-04 Ryan Bahlous-Boldi , Maxence Faldor , Luca Grillotti , Hannah Janmohamed , Lisa Coiffard , Lee Spector , Antoine Cully

In classical evolutionary theory, genetic variation provides the source of heritable phenotypic variation on which natural selection acts. Against this classical view, several theories have emphasized that developmental variability and…

Populations and Evolution · Quantitative Biology 2011-11-08 Steven A. Frank

Feature interaction selection is a fundamental problem in commercial recommender systems. Most approaches equally enumerate all features and interactions by the same pre-defined operation under expert guidance. Their recommendation is…

Artificial Intelligence · Computer Science 2024-05-30 Runlong Yu , Qixiang Shao , Qi Liu , Huan Liu , Enhong Chen

Curiosity is a vital metacognitive skill in educational contexts. Yet, little is known about how social factors influence curiosity in group work. We argue that curiosity is evoked not only through individual, but also interpersonal…

Human-Computer Interaction · Computer Science 2017-10-24 Tanmay Sinha , Zhen Bai , Justine Cassell

Self-training systems often degenerate due to the lack of an external criterion for judging data quality, leading to reward hacking and semantic drift. This paper provides a proof-of-concept system architecture for stable self-training…

When predictions support decisions they may influence the outcome they aim to predict. We call such predictions performative; the prediction influences the target. Performativity is a well-studied phenomenon in policy-making that has so far…

Machine Learning · Computer Science 2021-03-02 Juan C. Perdomo , Tijana Zrnic , Celestine Mendler-Dünner , Moritz Hardt

Direct reciprocity facilitates the evolution of cooperation when individuals interact repeatedly. Most previous studies on direct reciprocity implicitly assume compulsory interactions. Yet, interactions are often voluntary in human…

Physics and Society · Physics 2023-11-17 Fang Chen , Lei Zhou , Long Wang

Generative AI brings novel and impressive abilities to help people in everyday tasks. There are many AI workflows that solve real and complex problems by chaining AI outputs together with human interaction. Although there is an undeniable…

Human-Computer Interaction · Computer Science 2024-06-03 Tao Long , Katy Ilonka Gero , Lydia B. Chilton