English
Related papers

Related papers: Generalized system identification with stable spli…

200 papers

We derive finite time error bounds for estimating general linear time-invariant (LTI) systems from a single observed trajectory using the method of least squares. We provide the first analysis of the general case when eigenvalues of the LTI…

Systems and Control · Computer Science 2019-02-14 Tuhin Sarkar , Alexander Rakhlin

Translating machine learning algorithms into clinical applications requires addressing challenges related to interpretability, such as accounting for the effect of confounding variables (or metadata). Confounding variables affect the…

Machine Learning · Computer Science 2022-07-12 Anthony Vento , Qingyu Zhao , Robert Paul , Kilian M. Pohl , Ehsan Adeli

Classical interior penalty discontinuous Galerkin (IPDG) methods for diffusion problems require a number of assumptions on the local variation of mesh-size, polynomial degree, and of the diffusion coefficient to determine the values of the,…

Numerical Analysis · Mathematics 2022-05-24 Zhaonan Dong , Emmanuil H. Georgoulis

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

We study $\ell^1$ regularized least squares optimization problem in a separable Hilbert space. We show that the iterative soft-thresholding algorithm (ISTA) converges linearly, without making any assumption on the linear operator into play…

Optimization and Control · Mathematics 2017-12-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

In this paper, we propose a novel algorithm for the identification of Hammerstein systems. Adopting a Bayesian approach, we model the impulse response of the unknown linear dynamic system as a realization of a zero-mean Gaussian process.…

Systems and Control · Computer Science 2016-05-20 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

Iterative solvers for large-scale linear systems such as Krylov subspace methods can diverge when the linear system is ill-conditioned, thus significantly reducing the applicability of these iterative methods in practice for…

Numerical Analysis · Mathematics 2025-07-24 Vasileios Kalantzis , Mark S. Squillante , Chai Wah Wu

This paper establishes problem-specific sample complexity lower bounds for linear system identification problems. The sample complexity is defined in the PAC framework: it corresponds to the time it takes to identify the system parameters…

Systems and Control · Computer Science 2019-03-26 Yassir Jedra , Alexandre Proutiere

Problems of linear system identification have closed-form solutions, e.g., using least-squares or maximum-likelihood methods on input-output data. However, already the seemingly simplest problems of nonlinear system identification present…

Signal Processing · Electrical Eng. & Systems 2024-12-11 Svantje Voit , Gerald Enzner

Sparse adaptive filtering has gained much attention due to its wide applicability in the field of signal processing. Among the main algorithm families, sparse norm constraint adaptive filters develop rapidly in recent years. However, when…

Systems and Control · Computer Science 2015-09-29 Yong Feng , Fei Chen , Rui Zeng , Jiasong Wu , Huazhong Shu

Subspace identification is a classical and very well studied problem in system identification. The problem was recently posed as a convex optimization problem via the nuclear norm relaxation. Inspired by robust PCA, we extend this framework…

Systems and Control · Computer Science 2013-12-10 Dorsa Sadigh , Henrik Ohlsson , S. Shankar Sastry , Sanjit A. Seshia

This paper proposes a new approach to obtain uniformly valid inference for linear functionals or scalar subvectors of a partially identified parameter defined by linear moment inequalities. The procedure amounts to bootstrapping the value…

Econometrics · Economics 2023-05-09 JoonHwan Cho , Thomas M. Russell

The efficient computation of parametric solution sensitivities is a key challenge in the integration of learning-enhanced methods with nonlinear model predictive control (MPC), as their availability is crucial for many learning algorithms.…

Treatment effects in regression discontinuity designs (RDDs) are often estimated using local regression methods. \cite{Hahn:01} demonstrated that the identification of the average treatment effect at the cutoff in RDDs relies on the…

Econometrics · Economics 2024-12-30 Weiwei Jiang , Rong J. B. Zhu

We propose a method for estimation in high-dimensional linear models with nominal categorical data. Our estimator, called SCOPE, fuses levels together by making their corresponding coefficients exactly equal. This is achieved using the…

Methodology · Statistics 2021-12-21 Benjamin G. Stokell , Rajen D. Shah , Ryan J. Tibshirani

In recent studies \cite{ZZ24, FY24}, the Interior Penalty Virtual Element Method (IPVEM) has been developed for solving a fourth-order singular perturbation problem, with uniform convergence established in the lowest-order case concerning…

Numerical Analysis · Mathematics 2026-04-06 Fang Feng , Yuanyi Sun , Yue Yu

Generalized linear models are flexible tools for the analysis of diverse datasets, but the classical formulation requires that the parametric component is correctly specified and the data contain no atypical observations. To address these…

Methodology · Statistics 2023-04-21 Ioannis Kalogridis , Gerda Claeskens , Stefan Van Aelst

In partially linear single-index models, we obtain the semiparametrically efficient profile least-squares estimators of regression coefficients. We also employ the smoothly clipped absolute deviation penalty (SCAD) approach to…

Statistics Theory · Mathematics 2012-11-16 Hua Liang , Xiang Liu , Runze Li , Chih-Ling Tsai

Machine learning is becoming increasingly important for nonlinear system identification, including dynamical systems with spatially distributed outputs. However, classical identification and forecasting approaches become markedly less…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Achraf El Messaoudi , Noureddine Khaous , Karim Cherifi

This paper details how to parameterize the posterior distribution of state-space systems to generate improved optimization problems for system identification using variational inference. Three different parameterizations of the assumed…

Applications · Statistics 2025-01-15 Dimas Abreu Archanjo Dutra