English
Related papers

Related papers: Deluca -- A Differentiable Control Library: Enviro…

200 papers

Molecular dynamics simulations use statistical mechanics at the atomistic scale to enable both the elucidation of fundamental mechanisms and the engineering of matter for desired tasks. The behavior of molecular systems at the microscale is…

Computational Physics · Physics 2020-12-25 Wujie Wang , Simon Axelrod , Rafael Gómez-Bombarelli

It is challenging to coordinate multiple distributed energy resources in a single or multiple buildings to ensure efficient and flexible operation. Advanced control algorithms such as model predictive control and reinforcement learning…

Systems and Control · Electrical Eng. & Systems 2024-08-28 Kingsley Nweye , Zoltan Nagy

Deep reinforcement learning can generate complex control policies, but requires large amounts of training data to work effectively. Recent work has attempted to address this issue by leveraging differentiable simulators. However, inherent…

Machine Learning · Computer Science 2022-04-15 Jie Xu , Viktor Makoviychuk , Yashraj Narang , Fabio Ramos , Wojciech Matusik , Animesh Garg , Miles Macklin

In the research area of reinforcement learning (RL), frequently novel and promising methods are developed and introduced to the RL community. However, although many researchers are keen to apply their methods on real-world problems,…

Artificial Intelligence · Computer Science 2022-11-28 Daniel Hein , Stefan Depeweg , Michel Tokic , Steffen Udluft , Alexander Hentschel , Thomas A. Runkler , Volkmar Sterzing

Obtaining dynamics models is essential for robotics to achieve accurate model-based controllers and simulators for planning. The dynamics models are typically obtained using model specification of the manufacturer or simple numerical…

Robotics · Computer Science 2021-10-26 Michael Lutter , Johannes Silberbauer , Joe Watson , Jan Peters

The development of robot control programs is a complex task. Many robots are different in their electrical and mechanical structure which is also reflected in the software. Specific robot software environments support the program…

Robotics · Computer Science 2015-03-17 Michael Reckhaus , Nico Hochgeschwender , Paul G. Ploeger , Gerhard K. Kraetzschmar

Manipulating deformable objects has long been a challenge in robotics due to its high dimensional state representation and complex dynamics. Recent success in deep reinforcement learning provides a promising direction for learning to…

Robotics · Computer Science 2021-03-09 Xingyu Lin , Yufei Wang , Jake Olkin , David Held

In recent years, fully differentiable rigid body physics simulators have been developed, which can be used to simulate a wide range of robotic systems. In the context of reinforcement learning for control, these simulators theoretically…

Machine Learning · Computer Science 2022-03-08 Sean Gillen , Katie Byl

Robust control policy learning for autonomous driving requires training environments to be both physically realistic and computationally scalable, properties that existing simulators provide only in isolation. We introduce Sim2Sim2Sim, a…

Robotics · Computer Science 2026-05-05 Xunjiang Gu , Kashyap Chitta , Mahsa Golchoubian , Vladimir Suplin , Igor Gilitschenski

Recently, the increasing use of deep reinforcement learning for flow control problems has led to a new area of research, focused on the coupling and the adaptation of the existing algorithms to the control of numerical fluid dynamics…

Computational Physics · Physics 2024-04-19 Jonathan Viquerat , Philippe Meliga , Pablo Jeken , Elie Hachem

We design a multi-purpose environment for autonomous UAVs offering different communication services in a variety of application contexts (e.g., wireless mobile connectivity services, edge computing, data gathering). We develop the…

Machine Learning · Computer Science 2021-05-31 Damiano Brunori , Stefania Colonnese , Francesca Cuomo , Luca Iocchi

Differentiable physics provides a new approach for modeling and understanding the physical systems by pairing the new technology of differentiable programming with classical numerical methods for physical simulation. We survey the rapidly…

Machine Learning · Computer Science 2021-09-17 Bharath Ramsundar , Dilip Krishnamurthy , Venkatasubramanian Viswanathan

Differentiable physics enables efficient gradient-based optimizations of neural network (NN) controllers. However, existing work typically only delivers NN controllers with limited capability and generalizability. We present a practical…

Artificial Intelligence · Computer Science 2023-10-31 Yu Fang , Jiancheng Liu , Mingrui Zhang , Jiasheng Zhang , Yidong Ma , Minchen Li , Yuanming Hu , Chenfanfu Jiang , Tiantian Liu

Differentiable simulators continue to push the state of the art across a range of domains including computational physics, robotics, and machine learning. Their main value is the ability to compute gradients of physical processes, which…

Robotics · Computer Science 2024-07-09 Rhys Newbury , Jack Collins , Kerry He , Jiahe Pan , Ingmar Posner , David Howard , Akansel Cosgun

We consider the problem of simultaneous control and parameter estimation when the model is available only as a differentiable physics simulator. We propose a receding-horizon control framework in which a model predictive control (MPC)…

Optimization and Control · Mathematics 2026-04-07 Alan Williams , Alp Sunol

We present a method for differentiable simulation of soft articulated bodies. Our work enables the integration of differentiable physical dynamics into gradient-based pipelines. We develop a top-down matrix assembly algorithm within…

Machine Learning · Computer Science 2022-05-05 Yi-Ling Qiao , Junbang Liang , Vladlen Koltun , Ming C. Lin

Particle robots are novel biologically-inspired robotic systems where locomotion can be achieved collectively and robustly, but not independently. While its control is currently limited to a hand-crafted policy for basic locomotion tasks,…

Robotics · Computer Science 2025-05-12 Jeremy Shen , Erdong Xiao , Yuchen Liu , Chen Feng

We introduce a method for manipulating objects in three-dimensional space using controlled fluid streams. To achieve this, we train a neural network controller in a differentiable simulation and evaluate it in a simulated environment…

Robotics · Computer Science 2024-04-30 Karlis Freivalds , Laura Leja , Oskars Teikmanis

A properly designed controller can help improve the quality of experimental measurements or force a dynamical system to follow a completely new time-evolution path. Recent developments in deep reinforcement learning have made steep advances…

Statistical Mechanics · Physics 2025-02-26 Ruslan Mukhamadiarov

In recent years, an increasing amount of work has focused on differentiable physics simulation and has produced a set of open source projects such as Tiny Differentiable Simulator, Nimble Physics, diffTaichi, Brax, Warp, Dojo and DiffCoSim.…

Machine Learning · Computer Science 2022-07-13 Yaofeng Desmond Zhong , Jiequn Han , Georgia Olympia Brikis