English
Related papers

Related papers: Learning Compositional Neural Programs for Continu…

200 papers

We consider the problem of learning control policies that optimize a reward function while satisfying constraints due to considerations of safety, fairness, or other costs. We propose a new algorithm, Projection-Based Constrained Policy…

Machine Learning · Computer Science 2020-10-08 Tsung-Yen Yang , Justinian Rosca , Karthik Narasimhan , Peter J. Ramadge

We describe a simple scheme that allows an agent to learn about its environment in an unsupervised manner. Our scheme pits two versions of the same agent, Alice and Bob, against one another. Alice proposes a task for Bob to complete; and…

Machine Learning · Computer Science 2018-05-01 Sainbayar Sukhbaatar , Zeming Lin , Ilya Kostrikov , Gabriel Synnaeve , Arthur Szlam , Rob Fergus

In this paper, we propose a novel Reinforcement Learning approach for solving the Active Information Acquisition problem, which requires an agent to choose a sequence of actions in order to acquire information about a process of interest…

Machine Learning · Computer Science 2019-10-25 Heejin Jeong , Brent Schlotfeldt , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

A self-learning optimal control algorithm for episodic fixed-horizon manufacturing processes with time-discrete control actions is proposed and evaluated on a simulated deep drawing process. The control model is built during consecutive…

Systems and Control · Computer Science 2020-01-07 Johannes Dornheim , Norbert Link , Peter Gumbsch

The integration of algorithmic components into neural architectures has gained increased attention recently, as it allows training neural networks with new forms of supervision such as ordering constraints or silhouettes instead of using…

Machine Learning · Computer Science 2021-10-27 Felix Petersen , Christian Borgelt , Hilde Kuehne , Oliver Deussen

Real-world autonomous missions often require rich interaction with nearby objects, such as doors or switches, along with effective navigation. However, such complex behaviors are difficult to learn because they involve both high-level…

Robotics · Computer Science 2022-12-20 K. Niranjan Kumar , Irfan Essa , Sehoon Ha

We present a data-driven optimal control framework that can be viewed as a generalization of the path integral (PI) control approach. We find iterative feedback control laws without parameterization based on probabilistic representation of…

Systems and Control · Computer Science 2016-02-02 Yunpeng Pan , Evangelos A. Theodorou , Michail Kontitsis

Our brains extract durable, generalizable knowledge from transient experiences of the world. Artificial neural networks come nowhere close to this ability. When tasked with learning to classify objects by training on non-repeating video…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Morgan B. Talbot , Rushikesh Zawar , Rohil Badkundri , Mengmi Zhang , Gabriel Kreiman

Composing previously mastered skills to solve novel tasks promises dramatic improvements in the data efficiency of reinforcement learning. Here, we analyze two recent works composing behaviors represented in the form of action-value…

Machine Learning · Computer Science 2019-07-08 Jonathan J Hunt , Andre Barreto , Timothy P Lillicrap , Nicolas Heess

This work proposes a two-layered control scheme for constrained nonlinear systems represented by a class of recurrent neural networks and affected by additive disturbances. In particular, a base controller ensures global or regional…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Daniele Ravasio , Danilo Saccani , Marcello Farina , Giancarlo Ferrari-Trecate

Continual acquisition of novel experience without interfering previously learned knowledge, i.e. continual learning, is critical for artificial neural networks, but limited by catastrophic forgetting. A neural network adjusts its parameters…

Machine Learning · Computer Science 2022-02-15 Liyuan Wang , Bo Lei , Qian Li , Hang Su , Jun Zhu , Yi Zhong

As autonomous robots move into complex, dynamic real-world environments, they must learn to navigate safely in real time, yet anticipating all possible behaviors is infeasible. We propose a composable, model-free reinforcement learning…

Robotics · Computer Science 2026-02-16 Xinhuan Sang , Abdelrahman Abdelgawad , Roberto Tron

In this work, we present a methodology that enables an agent to make efficient use of its exploratory actions by autonomously identifying possible objectives in its environment and learning them in parallel. The identification of objectives…

Artificial Intelligence · Computer Science 2019-01-11 Thommen George Karimpanal , Erik Wilhelm

Analysis and design of filtered-x adaptive algorithms are conventionally done by assuming that the transfer function in the secondary path is a discrete-time system. However, in real systems such as active noise control, the secondary path…

Information Theory · Computer Science 2013-08-16 Masaaki Nagahara , Ken-ichi Hamaguchi , Yutaka Yamamoto

Autonomous agents need large repertoires of skills to act reasonably on new tasks that they have not seen before. However, acquiring these skills using only a stream of high-dimensional, unstructured, and unlabeled observations is a tricky…

Machine Learning · Computer Science 2021-02-09 Andrii Zadaianchuk , Maximilian Seitzer , Georg Martius

Diverse studies in systems neuroscience begin with extended periods of curriculum training known as `shaping' procedures. These involve progressively studying component parts of more complex tasks, and can make the difference between…

Neurons and Cognition · Quantitative Biology 2024-06-13 Jin Hwa Lee , Stefano Sarao Mannelli , Andrew Saxe

Learning compact and interpretable representations is a very natural task, which has not been solved satisfactorily even for simple binary datasets. In this paper, we review various ways of composing experts for binary data and argue that…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Marc Goessling , Yali Amit

Reward shaping has been applied widely to accelerate Reinforcement Learning (RL) agents' training. However, a principled way of designing effective reward shaping functions, especially for complex continuous control problems, remains…

Machine Learning · Computer Science 2026-02-12 Mateo Juliani , Mingxuan Li , Elias Bareinboim

We identify configurational phases and structural transitions in a polymer nanotube composite by means of machine learning. We employ various unsupervised dimensionality reduction methods, conventional neural networks, as well as the…

Soft Condensed Matter · Physics 2022-04-06 Quinn Parker , Dilina Perera , Ying Wai Li , Thomas Vogel

Sparse reward problems are one of the biggest challenges in Reinforcement Learning. Goal-directed tasks are one such sparse reward problems where a reward signal is received only when the goal is reached. One promising way to train an agent…

Machine Learning · Computer Science 2018-11-06 Ameet Deshpande , Srikanth Sarma , Ashutosh Jha , Balaraman Ravindran