English
Related papers

Related papers: dm_control: Software and Tasks for Continuous Cont…

200 papers

This paper presents Gym-TORAX, a Python package enabling the implementation of Reinforcement Learning (RL) environments for simulating plasma dynamics and control in tokamaks. Users define succinctly a set of control actions and…

Machine Learning · Computer Science 2026-03-23 Antoine Mouchamps , Arthur Malherbe , Adrien Bolland , Damien Ernst

Loco-manipulation is a fundamental challenge for humanoid robots to achieve versatile interactions in human environments. Although recent studies have made significant progress in humanoid whole-body control, loco-manipulation remains…

Robotics · Computer Science 2025-10-14 Yuhui Fu , Feiyang Xie , Chaoyi Xu , Jing Xiong , Haoqi Yuan , Zongqing Lu

Model-free deep reinforcement learning algorithms have been shown to be capable of learning a wide range of robotic skills, but typically require a very large number of samples to achieve good performance. Model-based algorithms, in…

Machine Learning · Computer Science 2017-12-05 Anusha Nagabandi , Gregory Kahn , Ronald S. Fearing , Sergey Levine

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor…

Robotics · Computer Science 2024-05-21 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

This paper presents Deepchecks, a Python library for comprehensively validating machine learning models and data. Our goal is to provide an easy-to-use library comprising of many checks related to various types of issues, such as model…

{\mu}Manager, an open-source microscopy acquisition software, has been an essential tool for many microscopy experiments over the past 15 years, but is not easy to use for experiments in which image acquisition and analysis are closely…

Quantitative Methods · Quantitative Biology 2024-02-12 Henry Pinkard , Nico Stuurman , Laura Waller

We introduce a novel musculoskeletal model of a dog, procedurally generated from accurate 3D muscle meshes. Accompanying this model is a motion capture-based locomotion task compatible with a variety of control algorithms, as well as an…

Robotics · Computer Science 2025-07-01 Vittorio La Barbera , Steven Bohez , Leonard Hasenclever , Yuval Tassa , John R. Hutchinson

Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning. Some notable examples include training agents to play Atari games based on raw…

Machine Learning · Computer Science 2016-05-30 Yan Duan , Xi Chen , Rein Houthooft , John Schulman , Pieter Abbeel

Building differentiable simulations of physical processes has recently received an increasing amount of attention. Specifically, some efforts develop differentiable robotic physics engines motivated by the computational benefits of merging…

Robotics · Computer Science 2022-02-24 Franziska Meier , Austin Wang , Giovanni Sutanto , Yixin Lin , Paarth Shah

There have been growing discussions on estimating and subsequently reducing the operational carbon footprint of enterprise data centers. The design and intelligent control for data centers have an important impact on data center carbon…

Traditional control methods are inadequate in many deployment settings involving control of Cyber-Physical Systems (CPS). In such settings, CPS controllers must operate and respond to unpredictable interactions, conditions, or failure…

Machine Learning · Computer Science 2019-09-17 William Koch

The dominant way to control a robot manipulator uses hand-crafted differential equations leveraging some form of inverse kinematics / dynamics. We propose a simple, versatile joint-level controller that dispenses with differential equations…

Robotics · Computer Science 2021-08-23 Visak Kumar , David Hoeller , Balakumar Sundaralingam , Jonathan Tremblay , Stan Birchfield

Over the last few years, with the growth of time-series collecting and storing, there has been a great demand for tools and software for temporal data engineering and modeling. This paper presents a generic workflow for time series data…

Computational Engineering, Finance, and Science · Computer Science 2023-10-24 Pejman Farhadi Ghalati , Andreas Schuppert

Robust reinforcement learning is the problem of learning control policies that provide optimal worst-case performance against a span of adversarial environments. It is a crucial ingredient for deploying algorithms in real-world scenarios…

Machine Learning · Computer Science 2024-06-13 Adil Zouitine , David Bertoin , Pierre Clavier , Matthieu Geist , Emmanuel Rachelson

Control systems are sets of interconnected hardware and software components which regulate the behaviour of processes. The software of modern control systems rises for some years by requirements regarding the flexibility and functionality.…

Software Engineering · Computer Science 2009-04-24 Rolf Andreas Rasenack , Karsten Wolke , Kostyantyn Yermashov , Karl Hayo Siemsen

Agile control of mobile manipulator is challenging because of the high complexity coupled by the robotic system and the unstructured working environment. Tracking and grasping a dynamic object with a random trajectory is even harder. In…

Robotics · Computer Science 2020-06-09 Cong Wang , Qifeng Zhang , Qiyan Tian , Shuo Li , Xiaohui Wang , David Lane , Yvan Petillot , Ziyang Hong , Sen Wang

Multi-degree-of-freedom (DOF) robotic manipulators exhibit strongly nonlinear, high-dimensional, and coupled dynamics, posing significant challenges for controller design. To address these issues, this work proposes a unified hybrid control…

Systems and Control · Electrical Eng. & Systems 2026-03-06 Xinyu Qiao , Yongyang Xiong , Yu Han , Keyou You

We introduce the Control Toolbox (CT), an open-source C++ library for efficient modeling, control, estimation, trajectory optimization and Model Predictive Control. The CT is applicable to a broad class of dynamic systems but features…

Robotics · Computer Science 2018-07-04 Markus Giftthaler , Michael Neunert , Markus Stäuble , Jonas Buchli

Loco-manipulation demands coordinated whole-body motion to manipulate objects effectively while maintaining locomotion stability, presenting significant challenges for both planning and control. In this work, we propose a whole-body model…

Robotics · Computer Science 2025-11-26 Lukas Molnar , Jin Cheng , Gabriele Fadini , Dongho Kang , Fatemeh Zargarbashi , Stelian Coros