English
Related papers

Related papers: A Levenberg-Marquardt algorithm for sparse identif…

200 papers

In this paper, we consider a recursive estimation problem for linear regression where the signal to be estimated admits a sparse representation and measurement samples are only sequentially available. We propose a convergent parallel…

Optimization and Control · Mathematics 2017-12-12 Yang Yang , Mengyi Zhang , Marius Pesavento , Daniel P. Palomar

Its conceptual appeal and effectiveness has made latent factor modeling an indispensable tool for multivariate analysis. Despite its popularity across many fields, there are outstanding methodological challenges that have hampered practical…

Methodology · Statistics 2018-12-12 Kenichiro McAlinn , Veronika Rockova , Enakshi Saha

In this paper, we propose a novel leaky least mean square (leaky LMS, LLMS) algorithm which employs a p-norm-like constraint to force the solution to be sparse in the application of system identification. As an extension of the LMS…

Systems and Control · Computer Science 2015-03-06 Yong Feng , Rui Zeng , Jiasong Wu

First principles modeling of physical systems has led to significant technological advances across all branches of science. For nonlinear systems, however, small modeling errors can lead to significant deviations from the true, measured…

Machine Learning · Computer Science 2019-09-19 Kadierdan Kaheman , Eurika Kaiser , Benjamin Strom , J. Nathan Kutz , Steven L. Brunton

Modeling and identification of high-dimensional stochastic processes is ubiquitous in many fields. In particular, there is a growing interest in modeling stochastic processes with simple and interpretable structures. In many applications,…

Optimization and Control · Mathematics 2016-10-11 Mattia Zorzi , Alessandro Chiuso

Estimating and detecting faults is crucial in ensuring safe and efficient automated systems. In the presence of disturbances, noise or varying system dynamics, such estimation is even more challenging. To address this challenge, this…

Optimization and Control · Mathematics 2021-12-13 Chris van der Ploeg , Emilia Silvas , Nathan van de Wouw , Peyman Mohajerin Esfahani

In this paper we consider sparse and identifiable linear latent variable (factor) and linear Bayesian network models for parsimonious analysis of multivariate data. We propose a computationally efficient method for joint parameter and model…

Machine Learning · Statistics 2011-06-24 Ricardo Henao , Ole Winther

We propose a novel approach for performing dynamical system identification, based upon the comparison of simulated and observed physical invariant measures. While standard methods adopt a Lagrangian perspective by directly treating…

Dynamical Systems · Mathematics 2025-02-11 Jonah Botvinick-Greenhouse

The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at…

Machine Learning · Computer Science 2024-06-28 Peter Halmos , Jonathan Pillow , David A. Knowles

Multivariable parametric models are critical for designing, controlling, and optimizing the performance of engineered systems. The main aim of this paper is to develop a parametric identification strategy that delivers accurate and…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Maarten van der Hulst , Rodrigo González , Koen Classens , Nic Dirkx , Jeroen van de Wijdeven , Tom Oomen

Learning governing equations from a family of data sets which share the same physical laws but differ in bifurcation parameters is challenging. This is due, in part, to the wide range of phenomena that could be represented in the data sets…

Numerical Analysis · Mathematics 2017-09-07 Hayden Schaeffer , Giang Tran , Rachel Ward

This paper presents three main contributions to the field of multi-step system identification. First, drawing inspiration from Neural Network (NN) training, it introduces a tool for solving identification problems by leveraging first-order…

Systems and Control · Electrical Eng. & Systems 2025-02-17 Cesare Donati , Martina Mammarella , Fabrizio Dabbene , Carlo Novara , Constantino Lagoa

A wide range of problems in computational science and engineering require estimation of sparse eigenvectors for high dimensional systems. Here, we propose two variants of the Truncated Orthogonal Iteration to compute multiple leading…

Numerical Analysis · Mathematics 2021-03-26 Hexuan Liu , Aleksandr Aravkin

Matrix recovery from sparse observations is an extensively studied topic emerging in various applications, such as recommendation system and signal processing, which includes the matrix completion and compressed sensing models as special…

Methodology · Statistics 2026-04-13 Ziyuan Chen , Ying Yang , Fang Yao

Sparse support vector machine (SVM) is a popular classification technique that can simultaneously learn a small set of the most interpretable features and identify the support vectors. It has achieved great successes in many real-world…

Machine Learning · Statistics 2019-07-19 Weizhong Zhang , Bin Hong , Wei Liu , Jieping Ye , Deng Cai , Xiaofei He , Jie Wang

One of the fundamental problems of interest for discrete-time linear systems is whether its input sequence may be recovered given its output sequence, a.k.a. the left inversion problem. Many conditions on the state space geometry, dynamics,…

Optimization and Control · Mathematics 2024-04-01 Kyle Poe , Enrique Mallada , Rene Vidal

Automated model selection is an important application in science and engineering. In this work, we develop a learning approach for identifying structured dynamical systems from undersampled and noisy spatiotemporal data. The learning is…

Machine Learning · Statistics 2023-05-31 Xiaofan Lu , Linan Zhang , Hongjin He

This study aims to show the efficiency of a proposed spectral matching technique for the reduction of required ground motions in the dynamic time history analysis. In this non-stationary spectral matching approach, unconstrained…

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg

We introduce a new strategy for coupling the parallel in time (parareal) iterative methodology with multiscale integrators. Following the parareal framework, the algorithm computes a low-cost approximation of all slow variables in the…

Numerical Analysis · Mathematics 2015-11-19 Gil Ariel , Seong Jun Kim , Richard Tsai
‹ Prev 1 4 5 6 7 8 10 Next ›