English
Related papers

Related papers: Physics-informed regularization and structure pres…

200 papers

Linear dynamical systems are canonical models for learning-based control of plants with uncertain dynamics. The setting consists of a stochastic differential equation that captures the state evolution of the plant understudy, while the true…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

While machine learning can accurately model process systems, models for decision making should also be structurally simple and physically interpretable. In process control, for example, (nearly) linear models are favored than nonlinear…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Wentao Tang

In various scientific and engineering applications, there is typically an approximate model of the underlying complex system, even though it contains both aleatoric and epistemic uncertainties. In this paper, we present a principled method…

Machine Learning · Computer Science 2023-12-15 Frank Liu , Agniva Chowdhury

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

In this chapter we provide a theoretically founded investigation of state-of-the-art learning approaches for inverse problems from the point of view of spectral reconstruction operators. We give an extended definition of regularization…

Numerical Analysis · Mathematics 2024-06-05 Martin Burger , Samira Kabri

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Quantum fields are generally taken to be operator-valued distributions, linear functionals of test functions into an algebra of operators; here the effective dynamics of an interacting quantum field is taken to be nonlinearly modified by…

Quantum Physics · Physics 2014-06-24 Peter Morgan

Hamiltonian Operator Inference has been introduced in [Sharma, H., Wang, Z., Kramer, B., Physica D: Nonlinear Phenomena, 431, p.133122, 2022] to learn structure-preserving reduced-order models (ROMs) for Hamiltonian systems. This approach…

Numerical Analysis · Mathematics 2024-05-10 Yuwei Geng , Jasdeep Singh , Lili Ju , Boris Kramer , Zhu Wang

In order to tackle the difficulty associated with the ill-posed nature of the image registration problem, regularization is often used to constrain the solution space. For most learning-based registration approaches, the regularization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Zhe Xu , Jie Luo , Donghuan Lu , Jiangpeng Yan , Sarah Frisken , Jayender Jagadeesan , William Wells , Xiu Li , Yefeng Zheng , Raymond Tong

The present paper deals with the data-driven design of regularizers in the form of artificial neural networks, for solving certain inverse problems formulated as optimal control problems. These regularizers aim at improving accuracy,…

Optimization and Control · Mathematics 2023-03-06 Sebastien Court

The combination of deep neural nets and theory-driven models, which we call deep grey-box modeling, can be inherently interpretable to some extent thanks to the theory backbone. Deep grey-box models are usually learned with a regularized…

Machine Learning · Computer Science 2022-10-25 Naoya Takeishi , Alexandros Kalousis

Physics-Informed Neural Networks (PINNs) have recently shown great promise as a way of incorporating physics-based domain knowledge, including fundamental governing equations, into neural network models for many complex engineering systems.…

Machine Learning · Computer Science 2021-05-06 Jian Cheng Wong , Chinchun Ooi , Pao-Hsiung Chiu , My Ha Dao

Learning kinetic systems from data is one of the core challenges in many fields. Identifying stable models is essential for the generalization capabilities of data-driven inference. We introduce a computationally efficient framework, called…

Machine Learning · Statistics 2019-12-02 Niklas Pfister , Stefan Bauer , Jonas Peters

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

Learning effective regularization is crucial for solving ill-posed inverse problems, which arise in a wide range of scientific and engineering applications. While data-driven methods that parameterize regularizers using deep neural networks…

Machine Learning · Statistics 2025-02-04 Yasi Zhang , Oscar Leong

Given (small amounts of) time-series' data from a high-dimensional, fine-grained, multiscale dynamical system, we propose a generative framework for learning an effective, lower-dimensional, coarse-grained dynamical model that is predictive…

Machine Learning · Statistics 2021-01-18 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis

Dealing with high variance is a significant challenge in model-free reinforcement learning (RL). Existing methods are unreliable, exhibiting high variance in performance from run to run using different initializations/seeds. Focusing on…

Machine Learning · Computer Science 2019-05-15 Richard Cheng , Abhinav Verma , Gabor Orosz , Swarat Chaudhuri , Yisong Yue , Joel W. Burdick

Here we present an expository, general analysis of valid post-selection or post-regularization inference about a low-dimensional target parameter, $\alpha$, in the presence of a very high-dimensional nuisance parameter, $\eta$, which is…

Statistics Theory · Mathematics 2017-10-03 Victor Chernozhukov , Christian Hansen , Martin Spindler

Selecting the best regularization parameter in inverse problems is a classical and yet challenging problem. Recently, data-driven approaches have become popular to tackle this challenge. These approaches are appealing since they do require…

Statistics Theory · Mathematics 2025-10-22 Jonathan Chirinos Rodriguez , Ernesto De Vito , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

Solving inverse problems involving measurement noise and modeling errors requires regularization in order to avoid data overfit. Geophysical inverse problems, in which the Earth's highly heterogeneous structure is unknown, present a…

Geophysics · Physics 2022-03-31 Ali Siahkoohi , Rafael Orozco , Gabrio Rizzuti , Felix J. Herrmann