English
Related papers

Related papers: A Levenberg-Marquardt algorithm for sparse identif…

200 papers

In order to improve the performance of Least Mean Square (LMS) based system identification of sparse systems, a new adaptive algorithm is proposed which utilizes the sparsity property of such systems. A general approximating approach on…

Information Theory · Computer Science 2015-06-15 Yuantao Gu , Jian Jin , Shunliang Mei

Elimination of unknowns in a system of differential equations is often required when analysing (possibly nonlinear) dynamical systems models, where only a subset of variables are observable. One such analysis, identifiability, often relies…

Algebraic Geometry · Mathematics 2022-11-28 Ruiwen Dong , Christian Goodbrake , Heather A Harrington , Gleb Pogudin

This paper studies the convergence rate of a continuous-time dynamical system for L1-minimization, known as the Locally Competitive Algorithm (LCA). Solving L1-minimization} problems efficiently and rapidly is of great interest to the…

Dynamical Systems · Mathematics 2017-04-26 Aurèle Balavoine , Christopher J. Rozell , Justin Romberg

Sparsity-based methods are widely used in machine learning, statistics, and signal processing. There is now a rich class of structured sparsity approaches that expand the modeling power of the sparsity paradigm and incorporate constraints…

Data Structures and Algorithms · Computer Science 2017-12-22 Aleksander Mądry , Slobodan Mitrović , Ludwig Schmidt

The methodology discussed in this paper aims to enhance choice models' comprehensiveness and explanatory power for forecasting choice outcomes. To achieve these, we have developed a data-driven method that leverages machine learning…

Methodology · Statistics 2023-05-02 Amir Ghorbani , Neema Nassir , Patricia Sauri Lavieri , Prithvi Bhat Beeramoole

Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit function space, typically through a predefined library of…

Machine Learning · Computer Science 2026-03-17 Markus W. Baumgartner , Anson Lei , Joe Watson , Ingmar Posner

Disentangled representation learning aims to uncover latent variables underlying the observed data, and generally speaking, rather strong assumptions are needed to ensure identifiability. Some approaches rely on sufficient changes on the…

Machine Learning · Computer Science 2025-03-04 Zijian Li , Shunxing Fan , Yujia Zheng , Ignavier Ng , Shaoan Xie , Guangyi Chen , Xinshuai Dong , Ruichu Cai , Kun Zhang

Physically interpretable models are essential for next-generation industrial systems, as these representations enable effective control, support design validation, and provide a foundation for monitoring strategies. The aim of this paper is…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Maarten van der Hulst , Rodrigo A. González , Koen Classens , Paul Tacx , Nick Dirkx , Jeroen van de Wijdeven , Tom Oomen

Digital human animation relies on high-quality 3D models of the human face: rigs. A face rig must be accurate and, at the same time, fast to compute. One of the most common rigging models is the blendshape model. We propose a novel…

Machine Learning · Computer Science 2021-10-06 Stevo Rackovic , Claudia Soares , Dusan Jakovetic , Zoranka Desnica

This paper proposes a dynamical Variable-separation method for solving parameter-dependent dynamical systems. To achieve this, we establish a dynamical low-rank approximation for the solutions of these dynamical systems by successively…

Numerical Analysis · Mathematics 2025-02-13 Liang Chen , Yaru Chen , Qiuqi Li , Tao Zhou

Discrete-time linear time-varying (LTV) systems form a powerful class of models to approximate complex dynamical systems with nonlinear dynamics for the purpose of analysis, design and control. Motivated by inference of spatio-temporal…

Systems and Control · Computer Science 2018-05-23 Roel Dobbe , Stephan Liu , Ye Yuan , Claire Tomlin

This paper begins with considering the identification of sparse linear time-invariant networks described by multivariable ARX models. Such models possess relatively simple structure thus used as a benchmark to promote further research. With…

Systems and Control · Computer Science 2016-10-03 J. Jin , Y. Yuan , W. Pan , D. L. T. Pham , C. J. Tomlin , A. Webb , J. Goncalves

This paper addresses the problem of identifying sparse linear time-invariant (LTI) systems from a single sample trajectory generated by the system dynamics. We introduce a Lasso-like estimator for the parameters of the system, taking into…

Systems and Control · Computer Science 2019-04-23 Salar Fattahi , Nikolai Matni , Somayeh Sojoudi

Fast-sampled models are essential for control design, e.g., to address intersample behavior. The aim of this paper is to develop a non-parametric identification technique for fast-sampled models of systems that have relevant dynamics and…

Systems and Control · Electrical Eng. & Systems 2023-06-08 Max van Haren , Leonid Mirkin , Lennart Blanken , Tom Oomen

In this paper we propose a computationally efficient algorithm for on-line variable selection in multivariate regression problems involving high dimensional data streams. The algorithm recursively extracts all the latent factors of a…

Machine Learning · Statistics 2009-02-10 Brian McWilliams , Giovanni Montana

Gradient matching is a promising tool for learning parameters and state dynamics of ordinary differential equations. It is a grid free inference approach, which, for fully observable systems is at times competitive with numerical…

Machine Learning · Statistics 2018-04-11 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

For compressive sensing of dynamic sparse signals, we develop an iterative pursuit algorithm. A dynamic sparse signal process is characterized by varying sparsity patterns over time/space. For such signals, the developed algorithm is able…

Statistics Theory · Mathematics 2012-10-15 Dave Zachariah , Saikat Chatterjee , Magnus Jansson

In this article we propose a novel strategy for choosing the Lagrange multipliers in the Levenberg-Marquardt method for solving ill-posed problems modeled by nonlinear operators acting between Hilbert spaces. Convergence analysis results…

Numerical Analysis · Mathematics 2020-11-12 A. Leitao , F. Margotti , B. F. Svaiter

Models that contain intersample behavior are important for control design of systems with slow-rate outputs. The aim of this paper is to develop a system identification technique for fast-rate models of systems where only slow-rate output…

Systems and Control · Electrical Eng. & Systems 2025-06-18 Max van Haren , Roy S. Smith , Tom Oomen

This study presents a new strategy for the identification of material parameters in the case of restricted or redundant data, based on a hybrid approach combining a genetic algorithm and the Levenberg-Marquardt method. The proposed…

Neural and Evolutionary Computing · Computer Science 2017-07-05 S. Carbillet , V. Guicheret-Retel , F. Trivaudey , F. Richard , M. L. Boubakar