English
Related papers

Related papers: An automatic L1-based regularization method for th…

200 papers

Deep Neural Networks are known to be very demanding in terms of computing and memory requirements. Due to the ever increasing use of embedded systems and mobile devices with a limited resource budget, designing low-complexity models without…

Machine Learning · Computer Science 2020-11-06 Khaled Koutini , Florian Henkel , Hamid Eghbal-zadeh , Gerhard Widmer

We present a fundamentally new regularization method for the solution of the Fredholm integral equation of the first kind, in which we incorporate solutions corresponding to a range of Tikhonov regularizers into the end result. This method…

Methodology · Statistics 2022-01-24 Chuan Bi , Miao-jung Yvonne Ou , Mustapha Bouhrara , Richard G. Spencer

Real-time identification of electrical equivalent circuit models is a critical requirement in many practical systems, such as batteries and electric motors. Significant work has been done in the past developing different types of algorithms…

Systems and Control · Electrical Eng. & Systems 2021-01-15 Balakumar Balasingam , Krishna Pattipati

Phase retrieval refers to a classical nonconvex problem of recovering a signal from its Fourier magnitude measurements. Inspired by the compressed sensing technique, signal sparsity is exploited in recent studies of phase retrieval to…

Computational Physics · Physics 2013-02-04 Zai Yang , Cishen Zhang , Lihua Xie

In recent investigations, the problem of detecting edges given non-uniform Fourier data was reformulated as a sparse signal recovery problem with an l1-regularized least squares cost function. This result can also be derived by employing a…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Victor Churchill , Anne Gelb

Nonlinear dynamic models are widely used for characterizing functional forms of processes that govern complex biological pathway systems. Over the past decade, validation and further development of these models became possible due to data…

Methodology · Statistics 2019-08-13 Itai Dattner , Shota Gugushvili , Harold Ship , Eberhard O. Voit

This paper presents three main contributions to the field of multi-step system identification. First, drawing inspiration from Neural Network (NN) training, it introduces a tool for solving identification problems by leveraging first-order…

Systems and Control · Electrical Eng. & Systems 2025-02-17 Cesare Donati , Martina Mammarella , Fabrizio Dabbene , Carlo Novara , Constantino Lagoa

Nonlinear frequency response analysis is a widely used method for determining system dynamics in the presence of nonlinearities. In dusty plasmas, the plasma-grain interaction (e.g., grain charging fluctuations) can be characterized by a…

Plasma Physics · Physics 2020-10-26 Zhiyue Ding , Lorin S. Matthews , Truell W. Hyde

Presented is a new algorithm for estimating the frequency of a single-tone noisy signal using linear least squares (LLS). Frequency estimation is a nonlinear problem, and typically, methods such as Nonlinear Least Squares (NLS) (batch) or a…

Signal Processing · Electrical Eng. & Systems 2019-04-17 Solomon Davis , Izhak Bucher

Inverse parallel schemes remain indispensable tools for computing the roots of nonlinear systems, yet their dynamical behavior can be unexpectedly rich, ranging from strong contraction to oscillatory or chaotic transients depending on the…

Numerical Analysis · Mathematics 2026-01-21 Mudassir Shams , Andrei Velichko , Bruno Carpentieri

We propose a linear algorithm for determining two function parameters by their linear combination. These functions must satisfy the first order differential equations with polynomial coefficients and our parameters are the coefficients of…

Numerical Analysis · Mathematics 2009-01-09 Oleg I. Berngardt , Alexander L. Voronov

In this paper, we study a class of approximation problems, appearing in data approximation and signal processing. The approximations are constructed as combinations of polynomial splines (piecewise polynomials), whose parameters are subject…

Optimization and Control · Mathematics 2015-03-05 Zahra Roshan Zamir , Nadezda Sukhorukova

The overfitting is one of the cursing subjects in the deep learning field. To solve this challenge, many approaches were proposed to regularize the learning models. They add some hyper-parameters to the model to extend the generalization;…

Machine Learning · Computer Science 2020-05-06 Mohammad Mahdi Bejani , Mehdi Ghatee

The idea of exploiting sparseness in under-determined damage characterization problems is not new, and regularizations techniques that tend to promote sparseness, such as L1-norm minimization, have been investigated in the last ten years or…

Dynamical Systems · Mathematics 2022-07-01 Esmaeil Memarzadeh , Dionisio Bernal , Martin D. Ulriksen

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

This technical note considers the identification of nonlinear discrete-time systems with additive process noise but without measurement noise. In particular, we propose a method and its associated algorithm to identify the system nonlinear…

Optimization and Control · Mathematics 2015-04-27 Wei Pan , Ye Yuan , Jorge Gonçalves , Guy-Bart Stan

We propose a new algorithm for estimating NARMAX models with $L_1$ regularization for models represented as a linear combination of basis functions. Due to the $L_1$-norm penalty the Lasso estimation tends to produce some coefficients that…

Systems and Control · Computer Science 2018-02-27 Antônio H. Ribeiro , Luis A. Aguirre

This article focuses on solving parametric transmission problems in one and two spatial dimensions. These problems belong to a class of partial differential equations that arise in the modeling of physical systems with heterogeneous…

Numerical Analysis · Mathematics 2026-03-11 Shima Baharlouei , Jamie Taylor , David Pardo

Magnetic Resonance Fingerprinting (MRF) enables the simultaneous quantification of multiple properties of biological tissues. It relies on a pseudo-random acquisition and the matching of acquired signal evolutions to a precomputed…

We propose and test improvements to state-of-the-art techniques of Bayeasian statistical inference based on pseudolikelihood maximization with $\ell_1$ regularization and with decimation. In particular, we present a method to determine the…

Data Analysis, Statistics and Probability · Physics 2018-07-18 Alessia Marruzzo , Payal Tyagi , Fabrizio Antenucci , Andrea Pagnani , Luca Leuzzi