English
Related papers

Related papers: A Differentiable Physics Engine for Deep Learning …

200 papers

The application of deep learning in robotics leads to very specific problems and research questions that are typically not addressed by the computer vision and machine learning communities. In this paper we discuss a number of…

Differentiable simulators provide an avenue for closing the sim-to-real gap by enabling the use of efficient, gradient-based optimization algorithms to find the simulation parameters that best fit the observed sensor readings. Nonetheless,…

Robotics · Computer Science 2021-05-21 Eric Heiden , David Millard , Erwin Coumans , Yizhou Sheng , Gaurav S. Sukhatme

We consider the problem of sequential robotic manipulation of deformable objects using tools. Previous works have shown that differentiable physics simulators provide gradients to the environment state and help trajectory optimization to…

Machine Learning · Computer Science 2022-04-01 Xingyu Lin , Zhiao Huang , Yunzhu Li , Joshua B. Tenenbaum , David Held , Chuang Gan

Over the past few years, robotics simulators have largely improved in efficiency and scalability, enabling them to generate years of simulated data in a few hours. Yet, efficiently and accurately computing the simulation derivatives remains…

Robotics · Computer Science 2025-05-21 Quentin Le Lidec , Louis Montaut , Yann de Mont-Marin , Fabian Schramm , Justin Carpentier

Real-world robots are becoming increasingly complex and commonly act in poorly understood environments where it is extremely challenging to model or learn their true dynamics. Therefore, it might be desirable to take a task-specific…

Systems and Control · Computer Science 2017-09-25 Somil Bansal , Roberto Calandra , Ted Xiao , Sergey Levine , Claire J. Tomlin

We implement a quantum optimal control algorithm based on automatic differentiation and harness the acceleration afforded by graphics processing units (GPUs). Automatic differentiation allows us to specify advanced optimization criteria and…

Quantum Physics · Physics 2017-04-19 Nelson Leung , Mohamed Abdelhafez , Jens Koch , David I. Schuster

The automatic design of robots has existed for 30 years but has been constricted by serial non-differentiable design evaluations, premature convergence to simple bodies or clumsy behaviors, and a lack of sim2real transfer to physical…

Robotics · Computer Science 2024-05-28 Luke Strgar , David Matthews , Tyler Hummer , Sam Kriegman

Differential drive robots are widely used in various scenarios thanks to their straightforward principle, from household service robots to disaster response field robots. There are several types of driving mechanisms for real-world…

Robotics · Computer Science 2025-05-30 Mengke Zhang , Nanhe Chen , Hu Wang , Jianxiong Qiu , Zhichao Han , Qiuyu Ren , Chao Xu , Fei Gao , Yanjun Cao

Optimal control is highly desirable in many current quantum systems, especially to realize tasks in quantum information processing. We introduce a method based on differentiable programming to leverage explicit knowledge of the differential…

Quantum Physics · Physics 2020-09-04 Frank Schäfer , Michal Kloc , Christoph Bruder , Niels Lörch

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

Deep learning, with its exceptional learning capabilities and flexibility, has been widely applied in various applications. However, its black-box nature poses a significant challenge in real-time robotic applications, particularly in robot…

Robotics · Computer Science 2025-09-08 Koji Matsuno , Chien Chern Cheah

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

Soft robots have gained increased popularity in recent years due to their adaptability and compliance. In this paper, we use a digital twin model of cable-driven soft robots to learn control parameters in simulation. In doing so, we take…

Robotics · Computer Science 2024-04-12 Kasra Arnavaz , Kenny Erleben

Learning actions that are relevant to decision-making and can be executed effectively is a key problem in autonomous robotics. Current state-of-the-art action representations in robotics lack proper effect-driven learning of the robot's…

Robotics · Computer Science 2024-04-04 Marko Zaric , Jakob Hollenstein , Justus Piater , Erwan Renaudo

Deep Reinforcement Learning (RL) has shown great success in learning complex control policies for a variety of applications in robotics. However, in most such cases, the hardware of the robot has been considered immutable, modeled as part…

Robotics · Computer Science 2020-11-10 Tianjian Chen , Zhanpeng He , Matei Ciocarlie

Feature engineering, a crucial step of machine learning, aims to extract useful features from raw data to improve data quality. In recent years, great efforts have been devoted to Automated Feature Engineering (AutoFE) to replace expensive…

Machine Learning · Computer Science 2022-10-11 Guanghui Zhu , Zhuoer Xu , Xu Guo , Chunfeng Yuan , Yihua Huang

Reinforcement learning is about learning agent models that make the best sequential decisions in unknown environments. In an unknown environment, the agent needs to explore the environment while exploiting the collected information, which…

Machine Learning · Computer Science 2021-02-12 Hong Qian , Yang Yu

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Incorporating a priori physics knowledge into machine learning leads to more robust and interpretable algorithms. In this work, we combine deep learning techniques and classic numerical methods for differential equations to address two…

Machine Learning · Computer Science 2026-05-04 Caitlin Ho , Andrea Arnold

We propose a novel differentiable physics engine for system identification of complex spring-rod assemblies. Unlike black-box data-driven methods for learning the evolution of a dynamical system and its parameters, we modularize the design…

Robotics · Computer Science 2020-04-30 Kun Wang , Mridul Aanjaneya , Kostas Bekris