English
Related papers

Related papers: Multiple penalized least squares and sign constrai…

200 papers

An asymptotically optimal blind calibration scheme of uniform linear arrays for narrowband Gaussian signals is proposed. Rather than taking the direct Maximum Likelihood (ML) approach for joint estimation of all the unknown model…

Signal Processing · Electrical Eng. & Systems 2020-09-01 Amir Weiss , Arie Yeredor

A Multi-Layer Perceptron (MLP) defines a family of artificial neural networks often used in TS modeling and forecasting. Because of its "black box" aspect, many researchers refuse to use it. Moreover, the optimization (often based on the…

Neural and Evolutionary Computing · Computer Science 2015-06-16 Cyril Voyant , Wani W. Tamas , Christophe Paoli , Aurélia Balu , Marc Muselli , Marie Laure Nivet , Gilles Notton

Least squares kernel based methods have been widely used in regression problems due to the simple implementation and good generalization performance. Among them, least squares support vector regression (LS-SVR) and extreme learning machine…

Machine Learning · Computer Science 2020-06-03 Hongwei Dong , Liming Yang

Iterative least-squares MR reconstructions typically use the Conjugate Gradient algorithm, despite known numerical issues. This paper demonstrates that the more recent LSMR algorithm has favourable numerical properties, and is to be…

Medical Physics · Physics 2022-12-14 Tobias C Wood

Least angle regression (LARS) by Efron et al. (2004) is a novel method for constructing the piece-wise linear path of Lasso solutions. For several years, it remained also as the de facto method for computing the Lasso solution before more…

Methodology · Statistics 2017-06-26 Muhammad Naveed Tabassum , Esa Ollila

Performance analysis of $l_0$ norm constrained Recursive least Squares (RLS) algorithm is attempted in this paper. Though the performance pretty attractive compared to its various alternatives, no thorough study of theoretical analysis has…

Information Theory · Computer Science 2016-02-11 Samrat Mukhopadhyay , Bijit Kumar Das , Mrityunjoy Chakraborty

Penalised estimation methods for point processes usually rely on a large amount of independent repetitions for cross-validation purposes. However, in the case of a single realisation of the process, existing cross-validation methods may be…

Methodology · Statistics 2026-01-13 Miguel Martinez Herrera , Felix Cheysson

This paper proposes Inverse Gram Matrix (IGM) methods to prioritize the Pairwise Reciprocal Matrix (PRM) in the Analytic Hierarchy Process. The IGM methods include Pseudo-IGM, Normalized-IGM, and Lagrange-IGM. Interestingly, the proposed…

Optimization and Control · Mathematics 2024-01-03 Kevin Kam Fung Yuen

The Expectation--Maximization Maximum Likelihood (EMML) algorithm belongs to the Expectation--Maximization family and is widely used for image reconstruction problems under Poisson noise.In this paper, we reinterpret EMML as a mirror…

Optimization and Control · Mathematics 2026-04-20 Antonin Clerc , Ségolène Martin , Nicolas Papadakis , Gabriele Steidl

We investigate the weighted Group Lasso formulation for the static inverse electroencephalography (EEG) problem, aiming at reconstructing the unknown underlying neuronal sources from voltage measurements on the scalp. By modelling the three…

Numerical Analysis · Mathematics 2025-12-17 Ole Løseth Elvetun , Bjørn Fredrik Nielsen , Niranjana Sudheer

Supervised learning by extreme learning machines resp. neural networks with random weights is studied under a non-stationary spatial-temporal sampling design which especially addresses settings where an autonomous object moving in a…

Machine Learning · Statistics 2021-09-02 Ansgar Steland

In real-time applications the characteristics and properties of a signal vary inconsistently. So, to maintain the integrity of such signals there is a need for effective adaptive filters. The conventional Least Mean Squared(LMS) algorithm…

Signal Processing · Electrical Eng. & Systems 2021-12-01 R Sankara Prasad

Tensor data represents a multidimensional array. Regression methods based on low-rank tensor decomposition leverage structural information to reduce the parameter count. Multilinear logistic regression serves as a powerful tool for the…

Machine Learning · Computer Science 2023-09-19 Weifeng Yang , Wenwen Min

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

In this paper we present a fast and efficient method for the reconstruction of Magnetic Resonance Images (MRI) from severely under-sampled data. From the Compressed Sensing theory we have mathematically modeled the problem as a constrained…

Numerical Analysis · Computer Science 2017-12-01 Damiana Lazzaro , Elena Loli Piccolomini , Fabiana Zama

This paper develops the asymptotic theory of a Fully Modified Generalized Least Squares estimator for multivariate cointegrating polynomial regressions. Such regressions allow for deterministic trends, stochastic trends and integer powers…

Econometrics · Economics 2020-08-10 Yicong Lin , Hanno Reuvers

In this paper, we propose two novel p-norm penalty least mean square (Lp-LMS) algorithms as supplements of the conventional Lp-LMS algorithm established for sparse adaptive filtering recently. A gradient comparator is employed to…

Systems and Control · Computer Science 2015-03-11 Yong Feng , Jiasong Wu , Rui Zeng , Limin Luo , Huazhong Shu

Physics-Informed Neural Networks (PINNs) have shown promise in solving partial differential equations (PDEs), including the frequency-domain Helmholtz equation. However, standard training of PINNs using gradient descent (GD) suffers from…

Machine Learning · Computer Science 2025-04-24 Mohammad Mahdi Abedi , David Pardo , Tariq Alkhalifah

The Material Point Method (MPM) is a hybrid Eulerian Lagrangian simulation technique for solid mechanics with significant deformation. Structured background grids are commonly employed in the standard MPM, but they may give rise to several…

Computational Engineering, Finance, and Science · Computer Science 2024-08-02 Yadi Cao , Yidong Zhao , Minchen Li , Yin Yang , Jinhyun Choo , Demetri Terzopoulos , Chenfanfu Jiang

Machine learning (ML) has the potential to become an essential tool in supporting clinical decision-making processes, offering enhanced diagnostic capabilities and personalized treatment plans. However, outsourcing medical records to train…