English
Related papers

Related papers: Generalized system identification with stable spli…

200 papers

Model selection and sparse recovery are two important problems for which many regularization methods have been proposed. We study the properties of regularization methods in both problems under the unified framework of regularized least…

Statistics Theory · Mathematics 2009-09-03 Jinchi Lv , Yingying Fan

In order to improve the performance of Least Mean Square (LMS) based system identification of sparse systems, a new adaptive algorithm is proposed which utilizes the sparsity property of such systems. A general approximating approach on…

Information Theory · Computer Science 2015-06-15 Yuantao Gu , Jian Jin , Shunliang Mei

We consider adaptive system identification problems with convex constraints and propose a family of regularized Least-Mean-Square (LMS) algorithms. We show that with a properly selected regularization parameter the regularized LMS provably…

Methodology · Statistics 2010-12-24 Yilun Chen , Yuantao Gu , Alfred O. Hero

Regression splines are largely used to investigate and predict data behavior, attracting the interest of mathematicians for their beautiful numerical properties, and of statisticians for their versatility with respect to the applications.…

Methodology · Statistics 2025-01-09 Rosanna Campagna , Serena Crisci , Gabriele Santin , Gerardo Toraldo , Marco Viola

In binary classification, kernel-free linear or quadratic support vector machines are proposed to avoid dealing with difficulties such as finding appropriate kernel functions or tuning their hyper-parameters. Furthermore, Universum data…

Machine Learning · Computer Science 2021-04-06 Hossein Moosaei , Ahmad Mousavi , Milan Hladík , Zheming Gao

This paper proposes a new leaky least mean square (leaky LMS, LLMS) algorithm in which a norm penalty is introduced to force the solution to be sparse in the application of system identification. The leaky LMS algorithm is derived because…

Systems and Control · Computer Science 2015-03-05 Yong Feng , Rui Zeng , Jiasong Wu

This paper deals with the problem of finding a low-complexity estimate of the impulse response of a linear time-invariant discrete-time dynamic system from noise-corrupted input-output data. To this purpose, we introduce an identification…

Systems and Control · Computer Science 2016-09-23 Giuseppe C. Calafiore , Carlo Novara , Michele Taragna

For regularized optimization that minimizes the sum of a smooth term and a regularizer that promotes structured solutions, inexact proximal-Newton-type methods, or successive quadratic approximation (SQA) methods, are widely used for their…

Optimization and Control · Mathematics 2023-05-02 Ching-pei Lee

System identification is a common tool for estimating (linear) plant models as a basis for model-based predictive control and optimization. The current challenges in process industry, however, ask for data-driven modelling techniques that…

Systems and Control · Computer Science 2018-02-06 Paul M. J. Van den Hof , Arne G. Dankers , Harm H. M. Weerts

A wide variety of integral inequalities (IIs) have been developed and studied for the stability analysis of distributed parameter systems using the Lyapunov functional approach. However, no unified mathematical framework has been proposed…

Optimization and Control · Mathematics 2024-04-09 Qian Feng , Alexandre Seuret , Sing Kiong Nguang , Feng Xiao

A framework of M-estimation based fuzzy C-means clustering (MFCM) algorithm is proposed with iterative reweighted least squares (IRLS) algorithm, and penalty constraint and kernelization extensions of MFCM algorithms are also developed.…

Computer Vision and Pattern Recognition · Computer Science 2013-01-22 Jingwei Liu , Meizhi Xu

In this paper we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints, are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2024-12-02 Lahcen El Bourkhissi , Ion Necoara

In this paper we propose and analyze an interior penalty discontinuous Galerkin (IP-DG) method using piecewise linear polynomials for the elastic Helmholtz equations with the first order absorbing boundary condition. It is proved that the…

Numerical Analysis · Mathematics 2015-01-23 Xiaobing Feng , Cody Lorton

Invariant-based models for incompressible isotropic hyperelasticity are typically formulated as functions of the first and second invariants, $W = W(\bar{I}_1, \bar{I}_2)$. A widely used class of models employs separable representations of…

Computational Engineering, Finance, and Science · Computer Science 2026-04-14 Simon Wiesheier , Miguel Angel Moreno-Mateos , Paul Steinmann

Model-based clustering integrated with variable selection is a powerful tool for uncovering latent structures within complex data. However, its effectiveness is often hindered by challenges such as identifying relevant variables that define…

We consider the use of Gaussian Processes (GPs) or Neural Networks (NNs) to numerically approximate the solutions to nonlinear partial differential equations (PDEs) with rough forcing or source terms, which commonly arise as pathwise…

Numerical Analysis · Mathematics 2025-01-31 Ricardo Baptista , Edoardo Calvello , Matthieu Darcy , Houman Owhadi , Andrew M. Stuart , Xianjin Yang

This study develops identification methods for linear continuous-time symmetric systems, such as electrical network systems, multi-agent network systems, and temperature dynamics in buildings. To this end, we formulate three system…

Optimization and Control · Mathematics 2019-08-02 Kazuhiro Sato , Hiroyuki Sato , Tobias Damm

In this paper I uncover and explain---using contour integrals and residues---a connection between cubic splines and a popular compact finite difference formula. The connection is that on a uniform mesh the simplest Pad\'e scheme for…

Numerical Analysis · Mathematics 2019-11-25 Robert M. Corless

Molecular profiling data (e.g., gene expression) has been used for clinical risk prediction and biomarker discovery. However, it is necessary to integrate other prior knowledge like biological pathways or gene interaction networks to…

Genomics · Quantitative Biology 2016-09-22 Wenwen Min , Juan Liu , Shihua Zhang

Partially linear additive models generalize linear ones since they model the relation between a response variable and covariates by assuming that some covariates have a linear relation with the response but each of the others enter through…

Methodology · Statistics 2023-08-08 Graciela Boente , Alejandra Mercedes Martinez