English
Related papers

Related papers: Deluca -- A Differentiable Control Library: Enviro…

200 papers

Queuing network control is essential for managing congestion in job-processing systems such as service systems, communication networks, and manufacturing processes. Despite growing interest in applying reinforcement learning (RL)…

Machine Learning · Computer Science 2024-09-06 Ethan Che , Jing Dong , Hongseok Namkoong

Policy gradient methods in reinforcement learning have become increasingly prevalent for state-of-the-art performance in continuous control tasks. Novel methods typically benchmark against a few key algorithms such as deep deterministic…

Machine Learning · Computer Science 2017-08-15 Riashat Islam , Peter Henderson , Maziar Gomrokchi , Doina Precup

An important field in robotics is the optimization of controllers. Currently, robots are often treated as a black box in this optimization process, which is the reason why derivative-free optimization methods such as evolutionary algorithms…

Neural and Evolutionary Computing · Computer Science 2018-11-27 Jonas Degrave , Michiel Hermans , Joni Dambre , Francis wyffels

The objective of many real-world tasks is complex and difficult to procedurally specify. This makes it necessary to use reward or imitation learning algorithms to infer a reward or policy directly from human data. Existing benchmarks for…

Machine Learning · Computer Science 2020-12-03 Pedro Freire , Adam Gleave , Sam Toyer , Stuart Russell

Optimal control is highly desirable in many current quantum systems, especially to realize tasks in quantum information processing. We introduce a method based on differentiable programming to leverage explicit knowledge of the differential…

Quantum Physics · Physics 2020-09-04 Frank Schäfer , Michal Kloc , Christoph Bruder , Niels Lörch

The dominant way to control a robot manipulator uses hand-crafted differential equations leveraging some form of inverse kinematics / dynamics. We propose a simple, versatile joint-level controller that dispenses with differential equations…

Robotics · Computer Science 2021-08-23 Visak Kumar , David Hoeller , Balakumar Sundaralingam , Jonathan Tremblay , Stan Birchfield

Differentiable simulators represent an environment's dynamics as a differentiable function. Within robotics and autonomous driving, this property is used in Analytic Policy Gradients (APG), which relies on backpropagating through the…

Artificial Intelligence · Computer Science 2025-11-14 Asen Nachkov , Danda Pani Paudel , Jan-Nico Zaech , Davide Scaramuzza , Luc Van Gool

Humans manipulate various kinds of fluids in their everyday life: creating latte art, scooping floating objects from water, rolling an ice cream cone, etc. Using robots to augment or replace human labors in these daily settings remain as a…

Robotics · Computer Science 2023-03-07 Zhou Xian , Bo Zhu , Zhenjia Xu , Hsiao-Yu Tung , Antonio Torralba , Katerina Fragkiadaki , Chuang Gan

Reinforcement learning is a promising approach to learning robotics controllers. It has recently been shown that algorithms based on finite-difference estimates of the policy gradient are competitive with algorithms based on the policy…

Machine Learning · Computer Science 2021-10-12 Osbert Bastani

Intelligent agents need a physical understanding of the world to predict the impact of their actions in the future. While learning-based models of the environment dynamics have contributed to significant improvements in sample efficiency…

Machine Learning · Computer Science 2020-05-20 Eric Heiden , David Millard , Hejia Zhang , Gaurav S. Sukhatme

Many recent machine learning models rely on fine-grained dynamic control flow for training and inference. In particular, models based on recurrent neural networks and on reinforcement learning depend on recurrence relations, data-dependent…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-09 Yuan Yu , Martín Abadi , Paul Barham , Eugene Brevdo , Mike Burrows , Andy Davis , Jeff Dean , Sanjay Ghemawat , Tim Harley , Peter Hawkins , Michael Isard , Manjunath Kudlur , Rajat Monga , Derek Murray , Xiaoqiang Zheng

A key challenge towards reliable robotic control is devising computational models that can both learn policies and guarantee robustness when deployed in the field. Inspired by the free energy principle in computational neuroscience, to…

Robotics · Computer Science 2026-03-10 Hozefa Jesawada , Giovanni Russo , Abdalla Swikir , Fares Abu-Dakka

Reinforcement learning (RL) in discrete action space is ubiquitous in real-world applications, but its complexity grows exponentially with the action-space dimension, making it challenging to apply existing on-policy gradient based deep RL…

Machine Learning · Statistics 2020-02-24 Yuguang Yue , Yunhao Tang , Mingzhang Yin , Mingyuan Zhou

Common approaches to control a data-center cooling system rely on approximated system/environment models that are built upon the knowledge of mechanical cooling and electrical and thermal management. These models are difficult to design and…

Systems and Control · Computer Science 2018-08-31 Takao Moriyama , Giovanni De Magistris , Michiaki Tatsubori , Tu-Hoa Pham , Asim Munawar , Ryuki Tachibana

Heating, Ventilation, and Air Conditioning (HVAC) systems are a major driver of energy consumption in commercial and residential buildings. Recent studies have shown that Deep Reinforcement Learning (DRL) algorithms can outperform…

Autonomously controlling quadrotors in large-scale subterranean environments is applicable to many areas such as environmental surveying, mining operations, and search and rescue. Learning-based controllers represent an appealing approach…

Robotics · Computer Science 2026-03-10 Isaac Ronald Ward , Mark Paral , Kristopher Riordan , Mykel J. Kochenderfer

Solving control tasks in complex environments automatically through learning offers great potential. While contemporary techniques from deep reinforcement learning (DRL) provide effective solutions, their decision-making is not transparent.…

Machine Learning · Computer Science 2023-07-03 Martin Tappler , Edi Muškardin , Bernhard K. Aichernig , Bettina Könighofer

Recent advances in deep reinforcement learning in the paradigm of locomotion using continuous control have raised the interest of game makers for the potential of digital actors using active ragdoll. Currently, the available options to…

Artificial Intelligence · Computer Science 2019-02-26 Joe Booth , Jackson Booth

Robots have to face challenging perceptual settings, including changes in viewpoint, lighting, and background. Current simulated reinforcement learning (RL) benchmarks such as DM Control provide visual input without such complexity, which…

Robotics · Computer Science 2021-01-11 Austin Stone , Oscar Ramirez , Kurt Konolige , Rico Jonschkowski

In this paper, we present our approach to solve a physics-based reinforcement learning challenge "Learning to Run" with objective to train physiologically-based human model to navigate a complex obstacle course as quickly as possible. The…

Artificial Intelligence · Computer Science 2018-01-30 Mikhail Pavlov , Sergey Kolesnikov , Sergey M. Plis