English
Related papers

Related papers: DiffTune: Auto-Tuning through Auto-Differentiation

200 papers

The performance of gradient-based optimization methods, such as standard gradient descent (GD), greatly depends on the choice of learning rate. However, it can require a non-trivial amount of user tuning effort to select an appropriate…

Machine Learning · Computer Science 2025-10-14 Nikola Surjanovic , Alexandre Bouchard-Côté , Trevor Campbell

Trajectory optimization is a fundamental problem in robotics. While optimization of continuous control trajectories is well developed, many applications require both discrete and continuous, i.e., hybrid, controls. Finding an optimal…

Robotics · Computer Science 2017-03-03 Joni Pajarinen , Ville Kyrki , Michael Koval , Siddhartha Srinivasa , Jan Peters , Gerhard Neumann

This paper presents a controller design and optimization framework for nonlinear dynamic systems to track a given reference signal in the presence of disturbances when the task is repeated over a finite-time interval. This novel framework…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Jiapeng Xu , Ying Tan , Xiang Chen

Autonomous optimization refers to the design of feedback controllers that steer a physical system to a steady state that solves a predefined, possibly constrained, optimization problem. As such, no exogenous control inputs such as setpoints…

Optimization and Control · Mathematics 2020-10-08 Adrian Hauswirth , Saverio Bolognani , Gabriela Hug , Florian Dörfler

Transfer learning, which allows a source task to affect the inductive bias of the target task, is widely used in computer vision. The typical way of conducting transfer learning with deep neural networks is to fine-tune a model pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Yunhui Guo , Honghui Shi , Abhishek Kumar , Kristen Grauman , Tajana Rosing , Rogerio Feris

This paper concerns the adaptive control of a class of discrete-time nonlinear systems with all states accessible. Recently, a high-order tuner algorithm was developed for the minimization of convex loss functions with time-varying…

Optimization and Control · Mathematics 2023-03-21 Peter A. Fisher , Anuradha M. Annaswamy

This paper considers the problem of reachability analysis of control systems with optimal controllers, as a first step towards verifying the safety and correctness of such systems. Despite their appeal in guaranteeing task satisfaction…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Dylan Le , Joel McCandless , Carlos Varela , Radoslav Ivanov

Obtaining dynamics models is essential for robotics to achieve accurate model-based controllers and simulators for planning. The dynamics models are typically obtained using model specification of the manufacturer or simple numerical…

Robotics · Computer Science 2021-10-26 Michael Lutter , Johannes Silberbauer , Joe Watson , Jan Peters

In this paper, we propose a method to automatically and efficiently tune high-dimensional vectors of controller parameters. The proposed method first learns a mapping from the high-dimensional controller parameter space to a lower…

Systems and Control · Electrical Eng. & Systems 2023-09-25 Alireza Sarmadi , Prashanth Krishnamurthy , Farshad Khorrami

Big data analytics frameworks (BDAFs) have been widely used for data processing applications. These frameworks provide a large number of configuration parameters to users, which leads to a tuning issue that overwhelms users. To address this…

Software Engineering · Computer Science 2018-08-21 Liang Bao , Xin Liu , Weizhao Chen

In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating…

Robotics · Computer Science 2024-08-23 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

Gradient-based methods can efficiently optimize controllers by leveraging differentiable simulation and physical priors. However, contact-rich manipulation remains challenging because hybrid contact dynamics often produce discontinuous or…

Robotics · Computer Science 2026-05-13 Wei-Chen Li , Glen Chou

Fine-tuning pretrained models has become a standard approach to adapting pretrained knowledge to improve the accuracy on new sparse, imbalance datasets. However, issues arise when optimization falls into a collapsed state, where the model…

Machine Learning · Computer Science 2026-05-01 Nghia Bui , Lijing Wang

A key ingredient to achieving intelligent behavior is physical understanding that equips robots with the ability to reason about the effects of their actions in a dynamic environment. Several methods have been proposed to learn dynamics…

Robotics · Computer Science 2020-01-24 David Millard , Eric Heiden , Shubham Agrawal , Gaurav S. Sukhatme

For certain industrial control applications an explicit function capturing the nontrivial trade-off between competing objectives in closed loop performance is not available. In such scenarios it is common practice to use the human innate…

Systems and Control · Electrical Eng. & Systems 2020-02-11 Alex. S. Ira , Chris Manzie , Iman Shames , Robert Chin , Dragan Nesic , Hayato Nakada , Takeshi Sano

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

Differentiable simulators provide an avenue for closing the sim-to-real gap by enabling the use of efficient, gradient-based optimization algorithms to find the simulation parameters that best fit the observed sensor readings. Nonetheless,…

Robotics · Computer Science 2021-05-21 Eric Heiden , David Millard , Erwin Coumans , Yizhou Sheng , Gaurav S. Sukhatme

It has long been hoped that model-based control will improve tracking performance while maintaining or increasing compliance. This hope hinges on having or being able to estimate an accurate inverse dynamics model. As a result, substantial…

Robotics · Computer Science 2016-08-11 Nathan Ratliff , Franziska Meier , Daniel Kappler , Stefan Schaal

Achieving human-like driving behaviors in complex open-world environments is a critical challenge in autonomous driving. Contemporary learning-based planning approaches such as imitation learning methods often struggle to balance competing…

We present DiffXPBD, a novel and efficient analytical formulation for the differentiable position-based simulation of compliant constrained dynamics (XPBD). Our proposed method allows computation of gradients of numerous parameters with…

Graphics · Computer Science 2023-06-30 Tuur Stuyck , Hsiao-yu Chen