English
Related papers

Related papers: Worm-level Control through Search-based Reinforcem…

200 papers

Training highly recurrent networks in continuous action spaces is a technical challenge: gradient-based methods suffer from exploding or vanishing gradients, while purely evolutionary searches converge slowly in high-dimensional weight…

Neural and Evolutionary Computing · Computer Science 2025-08-14 Miles Walter Churchland , Jordi Garcia-Ojalvo

We address the problem of learning feedback control where the controller is a network constructed solely of deterministic spiking neurons. In contrast to previous investigations that were based on a spike rate model of the neuron, the…

Neurons and Cognition · Quantitative Biology 2018-09-27 Tae Seung Kang , Arunava Banerjee

Animals ranging from rats to humans can demonstrate cognitive map capabilities. We evolved weights in a biologically plausible recurrent neural network (RNN) using an evolutionary algorithm to replicate the behavior and neural activity…

Neural and Evolutionary Computing · Computer Science 2021-02-26 Xinyun Zou , Eric O. Scott , Alexander B. Johnson , Kexin Chen , Douglas A. Nitz , Kenneth A. De Jong , Jeffrey L. Krichmar

The role of T-cells within the immune system is to confirm and assess anomalous situations and then either respond to or tolerate the source of the effect. To illustrate how these mechanisms can be harnessed to solve real-world problems, we…

Artificial Intelligence · Computer Science 2010-07-05 Jungwon Kim , William Wilson , Uwe Aickelin , Julie McLeod

Efficient exploration has presented a long-standing challenge in reinforcement learning, especially when rewards are sparse. A developmental system can overcome this difficulty by learning from both demonstrations and self-exploration.…

Machine Learning · Computer Science 2021-02-19 Siqing Hou , Dongqi Han , Jun Tani

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

{\it Caenorhabditis elegans} nematode worms are the only animals with the known detailed neural connectivity diagram, well characterized genomics, and relatively simple quantifiable behavioral output. With this in mind, many researchers…

Neurons and Cognition · Quantitative Biology 2019-10-17 Jan Karbowski

Most reinforcement-learning (RL) controllers used in continuous control are architecturally centralized: observations are compressed into a single latent state from which both value estimates and actions are produced. Biological control…

Machine Learning · Computer Science 2026-04-27 Anne E. Staples

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

Given the inner complexity of the human nervous system, insight into the dynamics of brain activity can be gained from understanding smaller and simpler organisms, such as the nematode C. Elegans. The behavioural and structural biology of…

Neurons and Cognition · Quantitative Biology 2021-07-15 Gonçalo Mestre , Ruxandra Barbulescu , Arlindo L. Oliveira , L. Miguel Silveira

How can animals behave effectively in conditions involving different motivational contexts? Here, we propose how reinforcement learning neural networks can learn optimal behavior for dynamically changing motivational salience vectors.…

Neurons and Cognition · Quantitative Biology 2019-11-20 Sergey A. Shuvaev , Ngoc B. Tran , Marcus Stephenson-Jones , Bo Li , Alexei A. Koulakov

The nervous system of the nematode soil worm Caenorhabditis elegans exhibits remarkable complexity despite the worm's small size. A general challenge is to better understand the relationship between neural organization and neural activity…

Neurons and Cognition · Quantitative Biology 2020-10-30 Alejandro Morales , Tom Froese

Active nematics, formed from a liquid crystalline suspension of active force dipoles, are a paradigmatic active matter system whose study provides insights into how chemical driving produces the cellular mechanical forces essential for…

Soft Condensed Matter · Physics 2024-11-15 Carlos Floyd , Aaron R. Dinner , Suriyanarayanan Vaikuntanathan

A fundamental question in neuroscience is how the brain creates an internal model of the world to guide actions using sequences of ambiguous sensory information. This is naturally formulated as a reinforcement learning problem under partial…

Machine Learning · Computer Science 2020-11-02 Minhae Kwon , Saurabh Daptardar , Paul Schrater , Xaq Pitkow

Recent advancements in model-free deep reinforcement learning have enabled efficient agent training. However, challenges arise when determining the region of attraction for these controllers, especially if the region does not fully cover…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Armin Ghanbarzadeh , Esmaeil Najafi

This study investigates a method to guide and control fish schools using virtual fish trained with reinforcement learning. We utilize 2D virtual fish displayed on a screen to overcome technical challenges such as durability and movement…

Robotics · Computer Science 2026-03-18 Yusuke Nishii , Hiroaki Kawashima

This paper proposes a robust control design method using reinforcement-learning for controlling partially-unknown dynamical systems under uncertain conditions. The method extends the optimal reinforcement-learning algorithm with a new…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Phuong D. Ngo , Fred Godtliebsen

We consider a problem of learning the reward and policy from expert examples under unknown dynamics. Our proposed method builds on the framework of generative adversarial networks and introduces the empowerment-regularized maximum-entropy…

Machine Learning · Computer Science 2019-02-26 Ahmed H. Qureshi , Byron Boots , Michael C. Yip

Search engines play an important role in our everyday lives by assisting us in finding the information we need. When we input a complex query, however, results are often far from satisfactory. In this work, we introduce a query…

Information Retrieval · Computer Science 2017-09-26 Rodrigo Nogueira , Kyunghyun Cho

A model of an Ant System where ants are controlled by a spiking neural circuit and a second order pheromone mechanism in a foraging task is presented. A neural circuit is trained for individual ants and subsequently the ants are exposed to…

Neural and Evolutionary Computing · Computer Science 2015-09-21 Cristian Jimenez-Romero , David Sousa-Rodrigues , Jeffrey H. Johnson , Vitorino Ramos