English
Related papers

Related papers: Generalized system identification with stable spli…

200 papers

Identifying the parameters of robotic systems, such as motor inertia or joint friction, is critical to satisfactory controller synthesis, model analysis, and observer design. Conventional identification techniques are designed primarily for…

Robotics · Computer Science 2024-08-19 Bohao Zhang , Daniel Haugk , Ram Vasudevan

When an iterative method is applied to solve the linear equation system in interior point methods (IPMs), the attention is usually placed on accelerating their convergence by designing appropriate preconditioners, but the linear solver is…

Optimization and Control · Mathematics 2023-04-28 Filippo Zanetti , Jacek Gondzio

In statistical machine learning, kernel methods allow to consider infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done by solving an optimization problem…

Optimization and Control · Mathematics 2019-01-17 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

Recent developments in linear system identification have proposed the use of non-parameteric methods, relying on regularization strategies, to handle the so-called bias/variance trade-off. This paper introduces an impulse response estimator…

Systems and Control · Computer Science 2014-10-01 Giulia Prando , Alessandro Chiuso , Gianluigi Pillonetto

This paper studies a regularized support function estimator for bounds on components of the parameter vector in the case in which the identified set is a polygon. The proposed regularized estimator has three important properties: (i) it has…

Econometrics · Economics 2024-07-26 Bulat Gafarov

This paper tackles the problem of selecting among several linear estimators in non-parametric regression; this includes model selection for linear regression, the choice of a regularization parameter in kernel ridge regression, spline…

Statistics Theory · Mathematics 2011-09-15 Sylvain Arlot , Francis Bach

This paper presents a regularized recursive identification algorithm with simultaneous on-line estimation of both the model parameters and the algorithms hyperparameters. A new kernel is proposed to facilitate the algorithm development. The…

Methodology · Statistics 2024-05-14 Bernard Vau , Tudor-Bogdan Airimitoaie

In continuous-time system identification, the intersample behavior of the input signal is known to play a crucial role in the performance of estimation methods. One common input behavior assumption is that the spectrum of the input is…

Systems and Control · Electrical Eng. & Systems 2021-03-22 Rodrigo A. González , Cristian R. Rojas , Håkan Hjalmarsson

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

We introduce a simple, rigorous, and unified framework for solving nonlinear partial differential equations (PDEs), and for solving inverse problems (IPs) involving the identification of parameters in PDEs, using the framework of Gaussian…

Numerical Analysis · Mathematics 2021-08-12 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

Adversarial actions and a rapid climate change are disrupting operations of infrastructure networks (e.g., energy, water, and transportation systems). Unaddressed disruptions lead to system-wide shutdowns, emphasizing the need for quick and…

Social and Information Networks · Computer Science 2024-09-16 Rajasekhar Anguluri

In this paper, we give a new penalized semidefinite programming approach for non-convex quadratically-constrained quadratic programs (QCQPs). We incorporate penalty terms into the objective of convex relaxations in order to retrieve…

Optimization and Control · Mathematics 2020-04-30 Ramtin Madani , Mohsen Kheirandishfard , Javad Lavaei , Alper Atamturk

Inspired by the complexity of certain real-world datasets, this article introduces a novel flexible linear spline index regression model. The model posits piecewise linear effects of an index on the response, with continuous changes…

Methodology · Statistics 2024-09-04 Lianqiang Qu , Long Lv , Meiling Hao , Liuquan Sun

It was recently shown that the loss function used for training physics-informed neural networks (PINNs) exhibits local minima at solutions corresponding to fixed points of dynamical systems. In the forward setting, where the PINN is trained…

Machine Learning · Computer Science 2025-09-16 Milos Babic , Franz M. Rohrhofer , Bernhard C. Geiger

Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. Atomic norm…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mingzhou Yin , Mehmet Tolga Akan , Andrea Iannelli , Roy S. Smith

This paper introduces a novel approach to system identification for nonlinear input-output models that minimizes the simulation error and frames the problem as a constrained optimization task. The proposed method addresses vanishing…

Optimization and Control · Mathematics 2025-12-17 Vito Cerone , Sophie M. Fosson , Simone Pirrera , Diego Regruto

We propose a novel method to model nonlinear regression problems by adapting the principle of penalization to Partial Least Squares (PLS). Starting with a generalized additive model, we expand the additive component of each variable in…

Statistics Theory · Mathematics 2010-08-13 Nicole Kraemer , Anne-Laure Boulesteix , Gerhard Tutz

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

Methodology · Statistics 2010-08-13 Gilles Blanchard , Nicole Kraemer

This paper gives a comprehensive treatment of the convergence rates of penalized spline estimators for simultaneously estimating several leading principal component functions, when the functional data is sparsely observed. The penalized…

Statistics Theory · Mathematics 2024-02-09 Shiyuan He , Jianhua Z. Huang , Kejun He

Probabilistic solvers provide a flexible and efficient framework for simulation, uncertainty quantification, and inference in dynamical systems. However, like standard solvers, they suffer performance penalties for certain stiff systems,…

Numerical Analysis · Mathematics 2023-12-20 Nathanael Bosch , Philipp Hennig , Filip Tronarp