English
Related papers

Related papers: Data-driven H2-optimal Model Reduction via Offline…

200 papers

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Transfer learning with a small amount of target data is an effective and common approach to adapting a pre-trained model to distribution shifts. In some situations, target data labels may be expensive to obtain, so we may only have access…

Machine Learning · Computer Science 2023-05-26 Annie S. Chen , Yoonho Lee , Amrith Setlur , Sergey Levine , Chelsea Finn

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

The successful application of general reinforcement learning algorithms to real-world robotics applications is often limited by their high data requirements. We introduce Regularized Hierarchical Policy Optimization (RHPO) to improve…

Transfer learning has become an essential technique to exploit information from the source domain to boost performance of the target task. Despite the prevalence in high-dimensional data, heterogeneity and heavy tails are insufficiently…

Machine Learning · Statistics 2023-11-07 Jiayu Huang , Mingqiu Wang , Yuanshan Wu

Model order reduction aims to determine a low-order approximation of high-order models with least possible approximation errors. For application to physical systems, it is crucial that the reduced order model (ROM) is robust to any…

Systems and Control · Electrical Eng. & Systems 2025-05-05 Shivam Bajaj , Carolyn L. Beck , Vijay Gupta

The Hierarchical Inference (HI) paradigm employs a tiered processing: the inference from simple data samples are accepted at the end device, while complex data samples are offloaded to the central servers. HI has recently emerged as an…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-17 Adarsh Prasad Behera , Roberto Morabito , Joerg Widmer , Jaya Prakash Champati

We present a framework for constructing structured realizations of linear dynamical systems having transfer functions of the form $C(\sum_{k=1}^K h_k(s)A_k)^{-1}B$ where $h_1,h_2,\ldots,h_K$ are prescribed functions that specify the…

Systems and Control · Computer Science 2018-01-30 Philipp Schulze , Benjamin Unger , Christopher Beattie , Serkan Gugercin

We investigate various data-driven methods to enhance projection-based model reduction techniques with the aim of capturing bifurcating solutions. To show the effectiveness of the data-driven enhancements, we focus on the incompressible…

Numerical Analysis · Mathematics 2022-07-19 Martin W. Hess , Annalisa Quaini , Gianluigi Rozza

In this paper, a sampling-based Stochastic Model Predictive Control algorithm is proposed for discrete-time linear systems subject to both parametric uncertainties and additive disturbances. One of the main drivers for the development of…

In this paper, an $\mathscr{H}_2$ norm-based model reduction method for linear quantum systems is presented, which can obtain a physically realizable model with a reduced order for closely approximating the original system. The model…

Quantum Physics · Physics 2024-11-21 G. P. Wu , S. Xue , G. F. Zhang , I. R. Petersen

This paper proposes a non-intrusive, data-driven reduced-order modeling framework for stochastic optimal control problems governed by partial differential equations. The control problem is formulated with a quadratic cost functional and…

Optimization and Control · Mathematics 2026-05-20 Lingling Ma , Jingyi Zhang , Qiuqi Li

The training of autonomous agents often requires expensive and unsafe trial-and-error interactions with the environment. Nowadays several data sets containing recorded experiences of intelligent agents performing various tasks, spanning…

Machine Learning · Computer Science 2020-10-06 Giorgio Angelotti , Nicolas Drougard , Caroline Ponzoni Carvalho Chanel

Online reinforcement learning (RL) excels in complex, safety-critical domains but suffers from sample inefficiency, training instability, and limited interpretability. Data attribution provides a principled way to trace model behavior back…

Machine Learning · Computer Science 2025-10-07 Yuzheng Hu , Fan Wu , Haotian Ye , David Forsyth , James Zou , Nan Jiang , Jiaqi W. Ma , Han Zhao

Frequency domain sweeps of array antennas are well-known to be time-intensive, and different surrogate models have been used to improve the performance. Data-driven model order reduction algorithms, such as the Loewner framework and vector…

Systems and Control · Electrical Eng. & Systems 2025-08-15 Lucas Åkerstedt , Darwin Blanco , B. L. G. Jonsson

This paper proposes a data-driven control framework to regulate an unknown, stochastic linear dynamical system to the solution of a (stochastic) convex optimization problem. Despite the centrality of this problem, most of the available…

Optimization and Control · Mathematics 2021-08-31 Gianluca Bianchin , Miguel Vaquero , Jorge Cortes , Emiliano Dall'Anese

Indirect experiments provide a valuable framework for estimating treatment effects in situations where conducting randomized control trials (RCTs) is impractical or unethical. Unlike RCTs, indirect experiments estimate treatment effects by…

Machine Learning · Computer Science 2023-12-06 Yash Chandak , Shiv Shankar , Vasilis Syrgkanis , Emma Brunskill

In modern industrial systems, machinery frequently operates under dynamic environments with continuously varying loads and speeds. Consequently, deep learning-based fault diagnosis models often suffer from severe performance degradation…

Signal Processing · Electrical Eng. & Systems 2026-05-22 Yakun Wang , Pengyu Han , Zeyi Liu , Xiao He , Dongming Cai , Hongshuo Zhao

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

Machine Learning · Computer Science 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang