English
Related papers

Related papers: Sample Complexity of Sparse System Identification …

200 papers

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

In this paper we aim to apply an adaptation of the recently developed technique of sparse identification of nonlinear dynamical systems on a Duffing experimental setup with cubic feedback of the output. The Duffing oscillator described by…

Classical Physics · Physics 2018-05-10 Saeideh Khatiry Goharoodi , Kevin Dekemele , Luc Dupre , Mia Loccufier , Guillaume Crevecoeur

Dynamical systems modeling is a core pillar of scientific inquiry across natural and life sciences. Increasingly, dynamical system models are learned from data, rendering identifiability a paramount concept. For systems that are not…

Machine Learning · Computer Science 2026-05-11 Cecilia Casolo , Sören Becker , Niki Kilbertus

In many problems of data-driven modeling for dynamical systems, the governing equations are not known a priori and must be selected phenomenologically from a large set of candidate interactions and basis functions. In such situations, point…

Applications · Statistics 2026-04-14 Shuhei Kashiwamura , Yusuke Kato , Hiroshi Kori , Masato Okada

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

A wide range of problems in computational science and engineering require estimation of sparse eigenvectors for high dimensional systems. Here, we propose two variants of the Truncated Orthogonal Iteration to compute multiple leading…

Numerical Analysis · Mathematics 2021-03-26 Hexuan Liu , Aleksandr Aravkin

Sparse learning is a very important tool for mining useful information and patterns from high dimensional data. Non-convex non-smooth regularized learning problems play essential roles in sparse learning, and have drawn extensive attentions…

Machine Learning · Computer Science 2020-10-22 Guannan Liang , Qianqian Tong , Jiahao Ding , Miao Pan , Jinbo Bi

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

One way to understand time-series data is to identify the underlying dynamical system which generates it. This task can be done by selecting an appropriate model and a set of parameters which best fits the dynamics while providing the…

Optimization and Control · Mathematics 2018-05-17 Linan Zhang , Hayden Schaeffer

In networked control systems, communication resource constraints often necessitate the use of \emph{sparse} control input vectors. A prototypical problem is how to ensure controllability of a linear dynamical system when only a limited…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Krishna Praveen V. S. Kondapi , Chandrasekhar Sriram , Geethu Joseph , Chandra R. Murthy

This paper is concerned with the following problem: given an upper bound of the state-space dimension and lag of a linear time-invariant system, design a sequence of inputs so that the system dynamics can be recovered from the resulting…

Optimization and Control · Mathematics 2024-07-18 M. Kanat Camlibel , Henk J. van Waarde , Paolo Rapisarda

We present a pragmatic approach to the sparse identification of nonlinear dynamics for systems with discrete delays. It relies on approximating the underlying delay model with a system of ordinary differential equations via pseudospectral…

Dynamical Systems · Mathematics 2024-08-06 Enrico Bozzo , Dimitri Breda , Muhammad Tanveer

In the first part of the series papers, we set out to answer the following question: given specific restrictions on a set of samplers, what kind of signal can be uniquely represented by the corresponding samples attained, as the foundation…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Yaowen Zhang , Guoqiang Xiao

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

Identifying co-varying causal elements in very high dimensional feature space with internal structures, e.g., a space with as many as millions of linearly ordered features, as one typically encounters in problems such as whole genome…

Methodology · Statistics 2012-06-18 Seyoung Kim , Eric P. Xing

This paper establishes problem-specific sample complexity lower bounds for linear system identification problems. The sample complexity is defined in the PAC framework: it corresponds to the time it takes to identify the system parameters…

Systems and Control · Computer Science 2019-03-26 Yassir Jedra , Alexandre Proutiere

We investigate the application of a framework for sparse model identification of differential equations from timeseries data in the context of compartmental models in epidemiology. Such frameworks often seek a sparse representation from a…

Optimization and Control · Mathematics 2025-10-23 Manuchehr Aminian , Kristin M. Kurianski

The methodology discussed in this paper aims to enhance choice models' comprehensiveness and explanatory power for forecasting choice outcomes. To achieve these, we have developed a data-driven method that leverages machine learning…

Methodology · Statistics 2023-05-02 Amir Ghorbani , Neema Nassir , Patricia Sauri Lavieri , Prithvi Bhat Beeramoole

This work is concerned with uncertainty quantification in reduced-order dynamical system identification. Reduced-order models for system dynamics are ubiquitous in design and control applications and recent efforts focus on their…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Prem Ratan Mohan Ram , Ulrich Römer , Richard Semaan