English
Related papers

Related papers: Neuron-level Balance between Stability and Plastic…

200 papers

The objective of lifelong reinforcement learning (RL) is to optimize agents which can continuously adapt and interact in changing environments. However, current RL approaches fail drastically when environments are non-stationary and…

Machine Learning · Computer Science 2021-06-17 Kevin Lu , Aditya Grover , Pieter Abbeel , Igor Mordatch

Representation learning (RL) methods learn objects' latent embeddings where information is preserved by distances. Since distances are invariant to certain linear transformations, one may obtain different embeddings while preserving the…

Machine Learning · Computer Science 2021-01-19 Furkan Gürsoy , Mounir Haddad , Cécile Bothorel

This paper presents an efficient deep reinforcement learning (DRL) framework for online 3D bin packing (3D-BPP). The 3D-BPP is an NP-hard problem significant in logistics, warehousing, and transportation, involving the optimal arrangement…

Robotics · Computer Science 2024-08-20 Peiwen Zhou , Ziyan Gao , Chenghao Li , Nak Young Chong

Plasticity Loss is an increasingly important phenomenon that refers to the empirical observation that as a neural network is continually trained on a sequence of changing tasks, its ability to adapt to a new task diminishes over time. We…

Machine Learning · Computer Science 2025-09-30 Vivek F. Farias , Adam D. Jozefiak

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

The stability-plasticity dilemma, closely related to a neural network's (NN) capacity-its ability to represent tasks-is a fundamental challenge in continual learning (CL). Within this context, we introduce CL's effective model capacity…

Machine Learning · Computer Science 2025-08-15 Supriyo Chakraborty , Krishnan Raghavan

Deep Reinforcement Learning (DRL) has achieved remarkable advances in sequential decision tasks. However, recent works have revealed that DRL agents are susceptible to slight perturbations in observations. This vulnerability raises concerns…

Machine Learning · Computer Science 2023-12-15 Buqing Nie , Jingtian Ji , Yangqing Fu , Yue Gao

Developmental plasticity plays a prominent role in shaping the brain's structure during ongoing learning in response to dynamically changing environments. However, the existing network compression methods for deep artificial neural networks…

Neural and Evolutionary Computing · Computer Science 2024-10-29 Bing Han , Feifei Zhao , Yi Zeng , Guobin Shen

Reinforcement Learning (RL) is a well-established framework for sequential decision-making in complex environments. However, state-of-the-art Deep RL (DRL) algorithms typically require large training datasets and often struggle to…

Artificial Intelligence · Computer Science 2026-04-13 Celeste Veronese , Alessandro Farinelli , Daniele Meli

Small neural networks with a constrained number of trainable parameters, can be suitable resource-efficient candidates for many simple tasks, where now excessively large models are used. However, such models face several problems during the…

Machine Learning · Computer Science 2021-09-21 Alexander Kovalenko , Pavel Kordík , Magda Friedjungová

The design and deployment of autonomous systems for space missions require robust solutions to navigate strict reliability constraints, extended operational duration, and communication challenges. This study evaluates the stability and…

Robotics · Computer Science 2025-03-04 Henry Lei , Zachary S. Lippay , Anonto Zaman , Joshua Aurand , Amin Maghareh , Sean Phillips

Rapidly learning from ongoing experiences and remembering past events with a flexible memory system are two core capacities of biological intelligence. While the underlying neural mechanisms are not fully understood, various evidence…

Neural and Evolutionary Computing · Computer Science 2023-02-08 Yu Duan , Zhongfan Jia , Qian Li , Yi Zhong , Kaisheng Ma

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

Robotics · Computer Science 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

It's challenging to balance the networks stability and plasticity in continual learning scenarios, considering stability suffers from the update of model and plasticity benefits from it. Existing works usually focus more on the stability…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Yi Sun , Xin Xu , Jian Li , Guanglei Xie , Yifei Shi , Qiang Fang

Autonomous mobile robots are increasingly used in pedestrian-rich environments where safe navigation and appropriate human interaction are crucial. While Deep Reinforcement Learning (DRL) enables socially integrated robot behavior,…

Robotics · Computer Science 2025-07-10 Daniel Flögel , Marcos Gómez Villafañe , Joshua Ransiek , Sören Hohmann

The market for domestic robots made to perform household chores is growing as these robots relieve people of everyday responsibilities. Domestic robots are generally welcomed for their role in easing human labor, in contrast to industrial…

Robotics · Computer Science 2024-05-30 Arpita Soni , Sujatha Alla , Suresh Dodda , Hemanth Volikatla

A learning process with the plasticity property often requires reinforcement signals to guide the process. However, in some tasks (e.g. maze-navigation), it is very difficult (or impossible) to measure the performance of an agent (i.e. a…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

The dynamic job-shop scheduling problem (DJSP) is a class of scheduling tasks that specifically consider the inherent uncertainties such as changing order requirements and possible machine breakdown in realistic smart manufacturing…

Artificial Intelligence · Computer Science 2022-01-04 Yunhui Zeng , Zijun Liao , Yuanzhi Dai , Rong Wang , Xiu Li , Bo Yuan

Neural Persistence is a prominent measure for quantifying neural network complexity, proposed in the emerging field of topological data analysis in deep learning. In this work, however, we find both theoretically and empirically that the…

Machine Learning · Computer Science 2023-11-22 Leander Girrbach , Anders Christensen , Ole Winther , Zeynep Akata , A. Sophia Koepke

The adaptive learning capabilities seen in biological neural networks are largely a product of the self-modifying behavior emerging from online plastic changes in synaptic connectivity. Current methods in Reinforcement Learning (RL) only…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Samuel Schmidgall