English
Related papers

Related papers: Recurrent Environment Simulators

200 papers

The predictive learning of spatiotemporal sequences aims to generate future images by learning from the historical context, where the visual dynamics are believed to have modular structures that can be learned with compositional subsystems.…

Machine Learning · Computer Science 2022-04-12 Yunbo Wang , Haixu Wu , Jianjin Zhang , Zhifeng Gao , Jianmin Wang , Philip S. Yu , Mingsheng Long

Agents should avoid unsafe behaviour during both training and deployment. This typically requires a simulator and a procedural specification of unsafe behaviour. Unfortunately, a simulator is not always available, and procedurally…

Machine Learning · Computer Science 2022-01-24 Matthew Rahtz , Vikrant Varma , Ramana Kumar , Zachary Kenton , Shane Legg , Jan Leike

Simulators based on neural networks offer a path to orders-of-magnitude faster electromagnetic wave simulations. Existing models, however, only address narrowly tailored classes of problems and only scale to systems of a few dozen degrees…

Optics · Physics 2024-04-02 Charles Dove , Jatearoon Boondicharern , Laura Waller

An agent in a nonstationary contextual bandit problem should balance between exploration and the exploitation of (periodic or structured) patterns present in its previous experiences. Handcrafting an appropriate historical context is an…

Machine Learning · Computer Science 2023-11-06 Aditya Ramesh , Paulo Rauber , Michelangelo Conserva , Jürgen Schmidhuber

Running agent-based models (ABMs) is a burdensome computational task, specially so when considering the flexibility ABMs intrinsically provide. This paper uses a bundle of model configuration parameters along with obtained results from a…

Multiagent Systems · Computer Science 2020-01-14 Bernardo Alves Furtado

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

Machine Learning · Computer Science 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

Recurrent neural networks (RNNs) provide state-of-the-art performance in processing sequential data but are memory intensive to train, limiting the flexibility of RNN models which can be trained. Reversible RNNs---RNNs for which the…

Machine Learning · Computer Science 2018-10-26 Matthew MacKay , Paul Vicol , Jimmy Ba , Roger Grosse

The behavioral dynamics of multi-agent systems have a rich and orderly structure, which can be leveraged to understand these systems, and to improve how artificial agents learn to operate in them. Here we introduce Relational Forward Models…

Planning with generative models has emerged as an effective decision-making paradigm across a wide range of domains, including reinforcement learning and autonomous navigation. While continuous replanning at each timestep might seem…

Robotics · Computer Science 2024-08-06 Pascal Jutras-Dubé , Ruqi Zhang , Aniket Bera

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Established recurrent neural networks are well-suited to solve a wide variety of prediction tasks involving discrete sequences. However, they do not perform as well in the task of dynamical system identification, when dealing with…

Machine Learning · Computer Science 2019-11-22 Thomas Demeester

Diffusion models have risen as a promising approach to data-driven planning, and have demonstrated impressive robotic control, reinforcement learning, and video planning performance. Given an effective planner, an important question to…

Robotics · Computer Science 2023-10-17 Siyuan Zhou , Yilun Du , Shun Zhang , Mengdi Xu , Yikang Shen , Wei Xiao , Dit-Yan Yeung , Chuang Gan

Recently, Neural Networks have been proven extremely effective in many natural language processing tasks such as sentiment analysis, question answering, or machine translation. Aiming to exploit such advantages in the Ontology Learning…

Computation and Language · Computer Science 2016-07-15 Giulio Petrucci , Chiara Ghidini , Marco Rospocher

Predictive models in acute care settings must be able to immediately recognize precipitous changes in a patient's status when presented with data reflecting such changes. Recurrent neural networks (RNNs) have become common for training and…

Machine Learning · Computer Science 2020-07-30 David Ledbetter , Eugene Laksana , Melissa Aczon , Randall Wetzel

The meteoric rise in the adoption of deep neural networks as computational models of vision has inspired efforts to "align" these models with humans. One dimension of interest for alignment includes behavioral choices, but moving beyond…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Lore Goetschalckx , Lakshmi Narasimhan Govindarajan , Alekh Karkada Ashok , Aarit Ahuja , David L. Sheinberg , Thomas Serre

Neuroscience models commonly have a high number of degrees of freedom and only specific regions within the parameter space are able to produce dynamics of interest. This makes the development of tools and strategies to efficiently find…

Successful Human-Robot collaboration requires a predictive model of human behavior. The robot needs to be able to recognize current goals and actions and to predict future activities in a given context. However, the spatio-temporal sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-09-20 Judith Bütepage , Danica Kragic

Deep neural networks, including recurrent networks, have been successfully applied to human activity recognition. Unfortunately, the final representation learned by recurrent networks might encode some noise (irrelevant signal components,…

Machine Learning · Computer Science 2018-10-10 Ming Zeng , Haoxiang Gao , Tong Yu , Ole J. Mengshoel , Helge Langseth , Ian Lane , Xiaobing Liu

We study the quality of outcomes in repeated games when the population of players is dynamically changing and participants use learning algorithms to adapt to the changing environment. Game theory classically considers Nash equilibria of…

Computer Science and Game Theory · Computer Science 2020-05-25 Thodoris Lykouris , Vasilis Syrgkanis , Eva Tardos

Deep artificial neural networks, trained with labeled data sets are widely used in numerous vision and robotics applications today. In terms of AI, these are called reflex models, referring to the fact that they do not self-evolve or…

Computer Vision and Pattern Recognition · Computer Science 2020-02-20 Hai Xiao , Jin Shang , Mengyuan Huang