English
Related papers

Related papers: Automated MIMO Motion Feedforward Control: Efficie…

200 papers

The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy…

Machine Learning · Computer Science 2013-01-18 Tingting Zhao , Hirotaka Hachiya , Voot Tangkaratt , Jun Morimoto , Masashi Sugiyama

Scalable algorithms of posterior approximation allow Bayesian nonparametrics such as Dirichlet process mixture to scale up to larger dataset at fractional cost. Recent algorithms, notably the stochastic variational inference performs local…

Machine Learning · Computer Science 2025-02-25 Kart-Leong Lim , Xudong Jiang

We propose a neural network approach to model general interaction dynamics and an adjoint based stochastic gradient descent algorithm to calibrate its parameters. The parameter calibration problem is considered as optimal control problem…

Optimization and Control · Mathematics 2021-02-01 Simone Göttlich , Claudia Totzeck

Before a car-following model can be applied in practice, it must first be validated against real data in a process known as calibration. This paper discusses the formulation of calibration as an optimization problem, and compares different…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Ronan Keane , H. Oliver Gao

In this article we consider an optimization problem where the objective function is evaluated at the fixed-point of a contraction mapping parameterized by a control variable, and optimization takes place over this control variable. Since…

Optimization and Control · Mathematics 2020-05-04 Thomas Flynn

An efficient policy search algorithm should estimate the local gradient of the objective function, with respect to the policy parameters, from as few trials as possible. Whereas most policy search methods estimate this gradient by observing…

Artificial Intelligence · Computer Science 2012-06-18 Gregory Lawrence , Stuart Russell

This paper proposes a gradient descent based optimization method that relies on automatic differentiation for the computation of gradients. The method uses tools and techniques originally developed in the field of artificial neural networks…

Systems and Control · Electrical Eng. & Systems 2023-09-29 Georg Kordowich , Johann Jaeger

In this paper we provide a thorough, rigorous theoretical framework to assess optimality guarantees of sampling-based algorithms for drift control systems: systems that, loosely speaking, can not stop instantaneously due to momentum. We…

Robotics · Computer Science 2015-10-28 Edward Schmerling , Lucas Janson , Marco Pavone

Current engineering design trends, such as light-weight machines and humanmachine-interaction, often lead to underactuated systems. Output trajectory tracking of such systems is a challenging control problem. Here, we use a twodesign-degree…

Optimization and Control · Mathematics 2023-12-08 Svenja Drücker , Lukas Lanza , Thomas Berger , Timo Reis , Robert Seifried

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

To enhance flexibility and facilitate resource cooperation, a novel fully-decoupled radio access network (FD-RAN) architecture is proposed for 6G. However, the decoupling of uplink (UL) and downlink (DL) in FD-RAN makes the existing…

Networking and Internet Architecture · Computer Science 2025-02-26 Jingbo Liu , Jiacheng Chen , Zongxi Liu , Haibo Zhou

The development of current building energy system operation has benefited from: 1. Informational support from the optimal design through simulation or first-principles models; 2. System load and energy prediction through machine learning…

Machine Learning · Computer Science 2023-02-22 Xia Chen , Xiaoye Cai , Alexander Kümpel , Dirk Müller , Philipp Geyer

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

This paper investigates the problem of tracking solutions of stochastic optimization problems with time-varying costs that depend on random variables with decision-dependent distributions. In this context, we propose the use of an online…

Optimization and Control · Mathematics 2021-10-29 Killian Wood , Gianluca Bianchin , Emiliano Dall'Anese

Training deep learning models on embedded devices is typically avoided since this requires more memory, computation and power over inference. In this work, we focus on lowering the amount of memory needed for storing all activations, which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Robby Neven , Marian Verhelst , Tinne Tuytelaars , Toon Goedemé

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…

Optimization and Control · Mathematics 2026-02-09 Nicole Bäuerle , Athanasios Vasileiadis

This paper presents a machine learning approach for tuning the parameters of a family of stabilizing controllers for orbital tracking. An augmented random search algorithm is deployed, which aims at minimizing a cost function combining…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Gianni Bianchini , Andrea Garulli , Antonio Giannitrapani , Mirko Leomanni , Renato Quartullo

Real-world control systems require policies that are not only high-performing but also interpretable and robust. A promising direction toward this goal is model-based control, which learns system dynamics and cost functions from historical…

Systems and Control · Electrical Eng. & Systems 2025-11-20 Yuexin Bian , Jie Feng , Yuanyuan Shi

Minimizing the empirical risk is a popular training strategy, but for learning tasks where the data may be noisy or heavy-tailed, one may require many observations in order to generalize well. To achieve better performance under less…

Machine Learning · Statistics 2018-10-16 Matthew J. Holland , Kazushi Ikeda