English
Related papers

Related papers: Fixed $\beta$-VAE Encoding for Curious Exploration…

200 papers

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism…

Artificial Intelligence · Computer Science 2018-06-19 Ildefons Magrans de Abril , Ryota Kanai

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and…

Machine Learning · Computer Science 2025-04-28 Mingqi Yuan , Roger Creus Castanyer , Bo Li , Xin Jin , Wenjun Zeng , Glen Berseth

In humans, intrinsic motivation is an important mechanism for open-ended cognitive development; in robots, it has been shown to be valuable for exploration. An important aspect of human cognitive development is $\textit{episodic memory}$…

Robotics · Computer Science 2024-05-21 Jack Vice , Natalie Ruiz-Sanchez , Pamela K. Douglas , Gita Sukthankar

The latent variables learned by VAEs have seen considerable interest as an unsupervised way of extracting features, which can then be used for downstream tasks. There is a growing interest in the question of whether features learned on one…

Machine Learning · Computer Science 2020-05-13 Saeid Asgari Taghanaki , Mohammad Havaei , Alex Lamb , Aditya Sanghi , Ara Danielyan , Tonya Custis

Although unsupervised generative modeling of an image dataset using a Variational AutoEncoder (VAE) has been used to detect anomalous images, or anomalous regions in images, recent works have shown that this method often identifies images…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 David Dehaene , Pierre Eline

One noted issue of vector-quantized variational autoencoder (VQ-VAE) is that the learned discrete representation uses only a fraction of the full capacity of the codebook, also known as codebook collapse. We hypothesize that the training…

We propose regularity as a novel reward signal for intrinsically-motivated reinforcement learning. Taking inspiration from child development, we postulate that striving for structure and order helps guide exploration towards a subspace of…

Machine Learning · Computer Science 2023-12-05 Cansu Sancaktar , Justus Piater , Georg Martius

In this paper, we propose a novel model called Learnable VAE (L-VAE), which learns a disentangled representation together with the hyperparameters of the cost function. L-VAE can be considered as an extension of \b{eta}-VAE, wherein the…

Machine Learning · Computer Science 2025-07-04 Hazal Mogultay Ozcan , Sinan Kalkan , Fatos T. Yarman-Vural

Semantic hashing has become a crucial component of fast similarity search in many large-scale information retrieval systems, in particular, for text data. Variational auto-encoders (VAEs) with binary latent variables as hashing codes…

Machine Learning · Computer Science 2020-05-22 Siamak Zamani Dadaneh , Shahin Boluki , Mingzhang Yin , Mingyuan Zhou , Xiaoning Qian

This paper introduces a novel combination of scheduling control on a flexible robot manufacturing cell with curiosity based reinforcement learning. Reinforcement learning has proved to be highly successful in solving tasks like robotics and…

Robotics · Computer Science 2020-11-18 Mohammed Sharafath Abdul Hameed , Md Muzahid Khan , Andreas Schwung

Anomaly detection in time series data is important for applications in finance, healthcare, sensor networks, and industrial monitoring. Traditional methods usually struggle with limited labeled data, high false-positive rates, and…

Machine Learning · Computer Science 2025-09-01 Bahareh Golchin , Banafsheh Rekabdar , Kunpeng Liu

We propose Structured Exploration with Achievements (SEA), a multi-stage reinforcement learning algorithm designed for achievement-based environments, a particular type of environment with an internal achievement set. SEA first uses offline…

Machine Learning · Computer Science 2023-05-02 Zihan Zhou , Animesh Garg

Efficient exploration in reinforcement learning is a challenging problem commonly addressed through intrinsic rewards. Recent prominent approaches are based on state novelty or variants of artificial curiosity. However, directly applying…

Machine Learning · Computer Science 2022-11-21 Aditya Ramesh , Louis Kirsch , Sjoerd van Steenkiste , Jürgen Schmidhuber

Effective exploration is critical for reinforcement learning agents in environments with sparse rewards or high-dimensional state-action spaces. Recent works based on state-visitation counts, curiosity and entropy-maximization generate…

Machine Learning · Computer Science 2022-09-13 Bang You , Jingming Xie , Youping Chen , Jan Peters , Oleg Arenz

Learning rich data representations from unlabeled data is a key challenge towards applying deep learning algorithms in downstream tasks. Several variants of variational autoencoders (VAEs) have been proposed to learn compact data…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Pan Xiao , Peijie Qiu , Sungmin Ha , Abdalla Bani , Shuang Zhou , Aristeidis Sotiras

Imitation learning (IL) has shown promise in various applications (e.g. robot locomotion) but is often limited to learning a single expert policy, constraining behavior diversity and robustness in unpredictable real-world scenarios. To…

Machine Learning · Computer Science 2025-08-15 Zhenglin Wan , Xingrui Yu , David Mark Bossens , Yueming Lyu , Qing Guo , Flint Xiaofeng Fan , Yew Soon Ong , Ivor Tsang

Reinforcement learning in sparse-reward navigation environments with expensive and limited interactions is challenging and poses a need for effective exploration. Motivated by complex navigation tasks that require real-world training (when…

Optimization and Control · Mathematics 2023-10-13 Yijia Wang , Matthias Poloczek , Daniel R. Jiang

We present a conditional variational auto-encoder (VAE) which, to avoid the substantial cost of training from scratch, uses an architecture and training objective capable of leveraging a foundation model in the form of a pretrained…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 William Harvey , Saeid Naderiparizi , Frank Wood

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

Machine Learning · Statistics 2017-07-12 Gautam Ramachandra

Deep metric learning has been demonstrated to be highly effective in learning semantic representation and encoding information that can be used to measure data similarity, by relying on the embedding learned from metric learning. At the…

Machine Learning · Statistics 2023-02-09 Haque Ishfaq , Assaf Hoogi , Daniel Rubin
‹ Prev 1 8 9 10 Next ›