English
Related papers

Related papers: Autoencoder-augmented Neuroevolution for Visual Do…

200 papers

We propose a new method for training an agent via an evolutionary strategy (ES), in which we iteratively improve a set of samples to imitate: Starting with a random set, in every iteration we replace a subset of the samples with samples…

Neural and Evolutionary Computing · Computer Science 2020-09-18 Roy Eliya , J. Michael Herrmann

Previous work explored blending levels from existing games to create levels for a new game that mixes properties of the original games. In this paper, we use Variational Autoencoders (VAEs) for improving upon such techniques. VAEs are…

Machine Learning · Computer Science 2020-02-28 Anurag Sarkar , Zhihan Yang , Seth Cooper

A rapidly growing area of research is the use of machine learning approaches such as autoencoders for dimensionality reduction of data and models in scientific applications. We show that the canonical formulation of autoencoders suffers…

Machine Learning · Computer Science 2022-07-28 Andrey A. Popov , Arash Sarshar , Austin Chennault , Adrian Sandu

We introduce environment predictive coding, a self-supervised approach to learn environment-level representations for embodied agents. In contrast to prior work on self-supervised learning for images, we aim to jointly encode a series of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Santhosh K. Ramakrishnan , Tushar Nagarajan , Ziad Al-Halah , Kristen Grauman

Through natural evolution, nervous systems of organisms formed near-optimal structures to express behavior. Here, we propose an effective way to create control agents, by \textit{re-purposing} the function of biological neural circuit…

Neural and Evolutionary Computing · Computer Science 2017-11-10 Mathias Lechner , Radu Grosu , Ramin M. Hasani

The ability to learn robust policies while generalizing over large discrete action spaces is an open challenge for intelligent systems, especially in noisy environments that face the curse of dimensionality. In this paper, we present a…

Machine Learning · Computer Science 2023-06-29 Pranavi Pathakota , Hardik Meisheri , Harshad Khadilkar

Commonly-used transformer language models depend on a tokenization schema which sets an unchangeable subword vocabulary prior to pre-training, destined to be applied to all downstream tasks regardless of domain shift, novel word formations,…

Computation and Language · Computer Science 2021-08-03 Yuval Pinter , Amanda Stent , Mark Dredze , Jacob Eisenstein

As Neural Cellular Automata (NCAs) are increasingly applied outside of the toy models in Artificial Life, there is a pressing need to understand how they behave and to build appropriate routes to interpret what they have learnt. By their…

Neural and Evolutionary Computing · Computer Science 2026-04-14 James Stovold , Mia-Katrin Kvalsund , Harald Michael Ludwig , Varun Sharma , Alexander Mordvintsev

Robust reinforcement learning agents using high-dimensional observations must be able to identify relevant state features amidst many exogeneous distractors. A representation that captures controllability identifies these state elements by…

Machine Learning · Computer Science 2024-06-25 Max Rudolph , Caleb Chuck , Kevin Black , Misha Lvovsky , Scott Niekum , Amy Zhang

Masked autoencoders (MAEs) have established themselves as a powerful method for unsupervised pre-training for computer vision tasks. While vanilla MAEs put equal emphasis on reconstructing the individual parts of the image, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski

This contribution comprises the interplay between a multi-modal variational autoencoder and an environment to a perceived environment, on which an agent can act. Furthermore, we conclude our work with a comparison to curiosity-driven…

Robotics · Computer Science 2019-11-05 Timo Korthals , Malte Schilling , Jürgen Leitner

Supervised deep convolutional neural networks (DCNNs) are currently one of the best computational models that can explain how the primate ventral visual stream solves object recognition. However, embodied cognition has not been considered…

Machine Learning · Computer Science 2021-06-21 Maytus Piriyajitakonkij , Sirawaj Itthipuripat , Theerawit Wilaiprasitporn , Nat Dilokthanakul

We aim to build complex humanoid agents that integrate perception, motor control, and memory. In this work, we partly factor this problem into low-level motor control from proprioception and high-level coordination of the low-level skills…

Artificial Intelligence · Computer Science 2019-01-16 Josh Merel , Arun Ahuja , Vu Pham , Saran Tunyasuvunakool , Siqi Liu , Dhruva Tirumala , Nicolas Heess , Greg Wayne

In motor neuroscience, artificial recurrent neural networks models often complement animal studies. However, most modeling efforts are limited to data-fitting, and the few that examine virtual embodied agents in a reinforcement learning…

Neurons and Cognition · Quantitative Biology 2023-05-19 Eugene R. Rush , Kaushik Jayaram , J. Sean Humbert

Neuroevolution (NE) has recently proven a competitive alternative to learning by gradient descent in reinforcement learning tasks. However, the majority of NE methods and associated simulation environments differ crucially from biological…

Neural and Evolutionary Computing · Computer Science 2023-08-07 Gautier Hamon , Eleni Nisioti , Clément Moulin-Frier

Visual reinforcement learning agents typically face serious performance declines in real-world applications caused by visual distractions. Existing methods rely on fine-tuning the policy's representations with hand-crafted augmentations. In…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xinning Zhou , Chengyang Ying , Yao Feng , Hang Su , Jun Zhu

We demonstrate a method for training a convolutional neural network with simulated images for usage on real-world experimental data. Modern machine learning methods require large, robust training data sets to generate accurate predictions.…

Soft Condensed Matter · Physics 2019-08-15 Eric N. Minor , Stian D. Howard , Adam A. S. Green , Cheol S. Park , Noel A. Clark

In this work, a data-driven framework based on Phase-Field simulations data is proposed to highlight the capabilities of neural networks to ensure accurate low dimensionality reduction of simulated microstructural images and to provide…

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Learning a common latent embedding by aligning the latent spaces of cross-modal autoencoders is an effective strategy for Generalized Zero-Shot Classification (GZSC). However, due to the lack of fine-grained instance-wise annotations, it…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Zhiyu Fang , Xiaobin Zhu , Chun Yang , Zheng Han , Jingyan Qin , Xu-Cheng Yin