English
Related papers

Related papers: A Levenberg-Marquardt algorithm for sparse identif…

200 papers

This note presents a unified analysis of the identification of dynamical systems with low-rank constraints under high-dimensional scaling. This identification problem for dynamic systems are challenging due to the intrinsic dependency of…

Statistics Theory · Mathematics 2019-12-23 Junlin Li

This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable…

Machine Learning · Computer Science 2020-04-21 Yibo Yang , Mohamed Aziz Bhouri , Paris Perdikaris

The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing…

Machine Learning · Computer Science 2025-10-28 Fadi Dornaika , Ahmad Khoder , Abdelmalik Moujahid , Wassim Khoder

Sparse model selection is ubiquitous from linear regression to graphical models where regularization paths, as a family of estimators upon the regularization parameter varying, are computed when the regularization parameter is unknown or…

Machine Learning · Statistics 2018-10-10 Chendi Huang , Yuan Yao

Robust statistical estimators offer resilience against outliers but are often computationally challenging, particularly in high-dimensional sparse settings. Modern optimization techniques are utilized for robust sparse association…

Computation · Statistics 2025-02-03 Pia Pfeiffer , Andreas Alfons , Peter Filzmoser

In recent years there has been a push to discover the governing equations dynamical systems directly from measurements of the state, often motivated by systems that are too complex to directly model. Although there has been substantial work…

Optimization and Control · Mathematics 2023-01-10 Jeffrey M. Hokanson , Gianluca Iaccarino , Alireza Doostan

Estimation of nonlinear dynamic models from data poses many challenges, including model instability and non-convexity of long-term simulation fidelity. Recently Lagrangian relaxation has been proposed as a method to approximate simulation…

Systems and Control · Computer Science 2018-10-12 Jack Umenberger , Ian R. Manchester

Linear system identification and sparse dictionary learning can both be seen as structured matrix factorization problems. However, these two problems have historically been studied in isolation by the systems theory and machine learning…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Kyle Poe , Uday Kiran Reddy Tadipatri , Benjamin D. Haeffele , Rene Vidal

Many signal processing applications require estimation of time-varying sparse signals, potentially with the knowledge of an imperfect dynamics model. In this paper, we propose an algorithm for dynamic filtering of time-varying sparse…

Signal Processing · Electrical Eng. & Systems 2020-01-01 Matthew R. O'Shaughnessy , Mark A. Davenport , Christopher J. Rozell

This work proposes a research problem of finding sparse solution of undetermined Linear system with some applications. Two approaches how to solve the compressive sensing problem: using l_1 approach , the l_q approach with 0 < q < 1.…

Optimization and Control · Mathematics 2017-02-24 Maddullah Almerdasy

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is,…

Computer Vision and Pattern Recognition · Computer Science 2014-12-09 Julien Mairal , Francis Bach , Jean Ponce

A variety of complex biological, natural and man-made systems exhibit non-Markovian dynamics that can be modeled through fractional order differential equations, yet, we lack sample comlexity aware system identification strategies. Towards…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Xiaole Zhang , Vijay Gupta , Paul Bogdan

This work introduces a novel principle for disentanglement we call mechanism sparsity regularization, which applies when the latent factors of interest depend sparsely on observed auxiliary variables and/or past latent factors. We propose a…

Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to…

Numerical Analysis · Mathematics 2018-08-20 Alexander Grimm , Christopher Beattie , Zlatko Drmač , Serkan Gugercin

Domain decomposition methods are widely used to solve sparse linear systems from scientific problems, but they are not suited to solve sparse linear systems extracted from integrated circuits. The reason is that the sparse linear system of…

Computational Engineering, Finance, and Science · Computer Science 2011-03-15 Fei Wei , Huazhong Yang

Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model…

Machine Learning · Statistics 2021-10-06 Georges Tod , Gert-Jan Both , Remy Kusters

Discovering dynamical models to describe underlying dynamical behavior is essential to draw decisive conclusions and engineering studies, e.g., optimizing a process. Experimental data availability notwithstanding has increased…

Machine Learning · Computer Science 2022-10-12 Pawan Goyal , Peter Benner

Many computer vision applications require robust and efficient estimation of camera geometry. The robust estimation is usually based on solving camera geometry problems from a minimal number of input data measurements, i.e., solving minimal…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Snehal Bhayani , Zuzana Kukelova , Janne Heikkilä

This paper presents a system identification framework -- inspired by multi-task learning -- to estimate the dynamics of a given number of linear time-invariant (LTI) systems jointly by leveraging structural similarities across the systems.…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Yiting Chen , Ana M. Ospina , Fabio Pasqualetti , Emiliano Dall'Anese

The research in parallel machine scheduling in combinatorial optimization suggests that the desirable parallel efficiency could be achieved when the jobs are sorted in the non-increasing order of processing times. In this paper, we find…

Numerical Analysis · Mathematics 2012-02-15 Lei Wang , Heng Liang , Fengshan Bai , Yan Huo