English
Related papers

Related papers: Harnessing intuitive local evolution rules for phy…

200 papers

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Large language models (LLMs) are trained for downstream tasks by updating their parameters (e.g., via RL). However, updating parameters forces them to absorb task-specific information, which can result in catastrophic forgetting and loss of…

Due to brain-body co-evolution, animals' intrinsic body dynamics play a crucial role in energy-efficient locomotion, which shares control effort between active muscles and passive body dynamics -- a principle known as Embodied Physical…

Robotics · Computer Science 2026-04-02 Huyue Ma , Yurui Jin , Helmut Hauser , Rui Wu

Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial…

Robotics · Computer Science 2025-06-06 Xinyu Cui , Boai Sun , Yi Zhu , Ning Yang , Haifeng Zhang , Weicheng Cui , Dixia Fan , Jun Wang

Recent progress in diverse intelligence has shown simple learning capacities below the organism level - single cells and even molecular networks. However, there are still many knowledge gaps around learning capacity above the organism…

Populations and Evolution · Quantitative Biology 2026-05-29 Adrita Samanta , Hananel Hazan , Michael Levin

Biological intelligence can learn to solve many diverse tasks in a data efficient manner by re-using basic knowledge and skills from one task to another. Furthermore, many of such skills are acquired without explicit supervision in an…

Brain representations must strike a balance between generalizability and adaptability. Neural codes capture general statistical regularities in the world, while dynamically adjusting to reflect current goals. One aspect of this adaptation…

Machine Learning · Computer Science 2023-11-28 Gauthier Boeshertz , Caroline Haimerl , Cristina Savin

Continuous-time reinforcement learning (CTRL) provides a natural framework for sequential decision-making in dynamic environments where interactions evolve continuously over time. While CTRL has shown growing empirical success, its ability…

Machine Learning · Computer Science 2025-12-04 Runze Zhao , Yue Yu , Ruhan Wang , Chunfeng Huang , Dongruo Zhou

Deep learning has shown substantial progress in image analysis. However, the computational demands of large, fully trained models remain a consideration. Transfer learning offers a strategy for adapting pre-trained models to new tasks.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

We present a benchmark study of autonomous, chemical agents exhibiting associative learning of an environmental feature. Associative learning has been widely studied in cognitive science and artificial intelligence, but are most commonly…

Adaptation and Self-Organizing Systems · Physics 2022-10-12 Stuart Bartlett , David Louapre

Simulated virtual environments serve as one of the main driving forces behind developing and evaluating skill learning algorithms. However, existing environments typically only simulate rigid body physics. Additionally, the simulation…

Machine Learning · Computer Science 2021-04-08 Zhiao Huang , Yuanming Hu , Tao Du , Siyuan Zhou , Hao Su , Joshua B. Tenenbaum , Chuang Gan

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

Machine Learning · Computer Science 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

We use model-free reinforcement learning, extensive simulation, and transfer learning to develop a continuous control algorithm that has good zero-shot performance in a real physical environment. We train a simulated agent to act optimally…

Artificial Intelligence · Computer Science 2018-03-09 M Ferguson , K. H. Law

We propose a $\tau$-leaping simulation algorithm for stochastic systems subject to fast environmental changes. Similar to conventional $\tau$-leaping the algorithm proceeds in discrete time steps, but as a principal addition it captures…

Statistical Mechanics · Physics 2021-07-28 Ernesto Berríos-Caro , Tobias Galla

Animal learning has interested ecologists and psychologists for over a century. Mathematical models that explain how animals store and recall information have gained attention recently. Central to this work is statistical decision theory…

Quantitative Methods · Quantitative Biology 2022-08-29 Peter R. Thompson , Melodie Kunegel-Lion , Mark A. Lewis

A self-learning adaptive system (SLAS) uses machine learning to enable and enhance its adaptability. Such systems are expected to perform well in dynamic situations. For learning high-performance adaptation policy, some assumptions must be…

Software Engineering · Computer Science 2021-05-12 Mingyue Zhang , Jialong Li , Haiyan Zhao , Kenji Tei , Shinichi Honiden , Zhi Jin

Learning adaptable policies is crucial for robots to operate autonomously in our complex and quickly changing world. In this work, we present a new meta-learning method that allows robots to quickly adapt to changes in dynamics. In contrast…

Robotics · Computer Science 2020-07-31 Xingyou Song , Yuxiang Yang , Krzysztof Choromanski , Ken Caluwaerts , Wenbo Gao , Chelsea Finn , Jie Tan

Reinforcement learning (RL) promises to enable autonomous acquisition of complex behaviors for diverse agents. However, the success of current reinforcement learning algorithms is predicated on an often under-emphasised requirement -- each…

Machine Learning · Computer Science 2021-10-29 Archit Sharma , Abhishek Gupta , Sergey Levine , Karol Hausman , Chelsea Finn

Split learning (SL) is a promising approach for training artificial intelligence (AI) models, in which devices collaborate with a server to train an AI model in a distributed manner, based on a same fixed split point. However, due to the…

Machine Learning · Computer Science 2025-03-14 Zuguang Li , Wen Wu , Shaohua Wu , Wei Wang