English
Related papers

Related papers: Dream2Learn: Structured Generative Dreaming for Co…

200 papers

In this work, we introduce Adapt & Align, a method for continual learning of neural networks by aligning latent representations in generative models. Neural Networks suffer from abrupt loss in performance when retrained with additional…

Machine Learning · Computer Science 2023-12-22 Kamil Deja , Bartosz Cywiński , Jan Rybarczyk , Tomasz Trzciński

Meta reinforcement learning (Meta RL) has been amply explored to quickly learn an unseen task by transferring previously learned knowledge from similar tasks. However, most state-of-the-art algorithms require the meta-training tasks to have…

Machine Learning · Computer Science 2023-11-14 Lu Wen , Songan Zhang , H. Eric Tseng , Huei Peng

We present a new "learning-to-learn"-type approach that enables rapid learning of concepts from small-to-medium sized training sets and is primarily designed for web-initialized image retrieval. At the core of our approach is a deep…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 A. Vakhitov , A. Kuzmin , V. Lempitsky

Reinforcement learning is typically treated as a uniform, data-driven optimization process, where updates are guided by rewards and temporal-difference errors without explicitly exploiting global structure. In contrast, dynamic programming…

Machine Learning · Computer Science 2026-04-21 Ivo Nowak

Continual Learning (CL) is a field dedicated to devise algorithms able to achieve lifelong learning. Overcoming the knowledge disruption of previously acquired concepts, a drawback affecting deep learning models and that goes by the name of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Francesco Pelosin

Most design methods contain a forward framework, asking for primary specifications of a building to generate an output or assess its performance. However, architects urge for specific objectives though uncertain of the proper design…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Zohreh Shaghaghian , Wei Yan

Advancements in deep learning are revolutionizing science and engineering. The immense success of deep learning is largely due to its ability to extract essential high-dimensional (HD) features from input data and make inference decisions…

Machine Learning · Computer Science 2025-01-30 Md Tauhidul Islam , Lei Xing

Deep Neural Network (DNN) has achieved great success on datasets of closed class set. However, new classes, like new categories of social media topics, are continuously added to the real world, making it necessary to incrementally learn.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Wenzhuo Liu , Xinjian Wu , Fei Zhu , Mingming Yu , Chuang Wang , Cheng-Lin Liu

Artificial intelligence (AI) and neuroscience share a rich history, with advancements in neuroscience shaping the development of AI systems capable of human-like knowledge retention. Leveraging insights from neuroscience and existing…

Machine Learning · Computer Science 2024-04-24 Hikmat Khan , Nidhal Carla Bouaynaya , Ghulam Rasool

The present paper proposes a novel reinforcement learning method with world models, DreamingV2, a collaborative extension of DreamerV2 and Dreaming. DreamerV2 is a cutting-edge model-based reinforcement learning from pixels that uses…

Machine Learning · Computer Science 2022-03-02 Masashi Okada , Tadahiro Taniguchi

Given the inherent non-stationarity prevalent in real-world applications, continual Reinforcement Learning (RL) aims to equip the agent with the capability to address a series of sequentially presented decision-making tasks. Within this…

Machine Learning · Computer Science 2024-11-19 Feng Chen , Fuguang Han , Cong Guan , Lei Yuan , Zhilong Zhang , Yang Yu , Zongzhang Zhang

Reinforcement Learning (RL) has been successful in various domains like robotics, game playing, and simulation. While RL agents have shown impressive capabilities in their specific tasks, they insufficiently adapt to new tasks. In…

Machine Learning · Computer Science 2023-10-30 Thomas Schmied , Markus Hofmarcher , Fabian Paischer , Razvan Pascanu , Sepp Hochreiter

We propose Wake-Sleep Consolidated Learning (WSCL), a learning strategy leveraging Complementary Learning System theory and the wake-sleep phases of the human brain to improve the performance of deep neural networks for visual…

Neural and Evolutionary Computing · Computer Science 2024-01-18 Amelia Sorrenti , Giovanni Bellitto , Federica Proietto Salanitri , Matteo Pennisi , Simone Palazzo , Concetto Spampinato

Continual or lifelong learning has been a long-standing challenge in machine learning to date, especially in natural language processing (NLP). Although state-of-the-art language models such as BERT have ushered in a new era in this field…

Computation and Language · Computer Science 2021-09-21 Kyra Ahrens , Fares Abawi , Stefan Wermter

Biological evolution has distilled the experiences of many learners into the general learning algorithms of humans. Our novel meta reinforcement learning algorithm MetaGenRL is inspired by this process. MetaGenRL distills the experiences of…

Machine Learning · Computer Science 2020-02-17 Louis Kirsch , Sjoerd van Steenkiste , Jürgen Schmidhuber

Deep metric learning aims to learn an embedding space where the distance between data reflects their class equivalence, even when their classes are unseen during training. However, the limited number of classes available in training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Kyungmoon Lee , Sungyeon Kim , Seunghoon Hong , Suha Kwak

Humans and animals can learn new skills after practicing for a few hours, while current reinforcement learning algorithms require a large amount of data to achieve good performances. Recent model-based approaches show promising results by…

Machine Learning · Computer Science 2023-06-09 Cristiano Capone , Pier Stanislao Paolucci

Agentic RL can benefit substantially from reusable experience, yet existing skill-based methods mainly extract trajectory-level guidance and often lack principled mechanisms for maintaining an evolving skill memory. We propose D2Skill, a…

Artificial Intelligence · Computer Science 2026-05-26 Songjun Tu , Chengdong Xu , Qichao Zhang , Yaocheng Zhang , Xiangyuan Lan , Linjing Li , Dong Li , Dongbin Zhao

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

Both generative learning and discriminative learning have recently witnessed remarkable progress using Deep Neural Networks (DNNs). For structured input synthesis and structured output prediction problems (e.g., layout-to-image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Wei Sun , Tianfu Wu