English
Related papers

Related papers: L1Packv2: A Mathematica package for minimizing an …

200 papers

We construct an objective function that consists of a quadratic approximation term and a penalty term. Thanks to the quadratic approximation, we can deal with various kinds of loss functions into a unified way, and by taking advantage of…

Statistics Theory · Mathematics 2018-11-26 Takumi Suzuki , Nakahiro Yoshida

We analyze an Iteratively Re-weighted Least Squares (IRLS) algorithm for promoting l1-minimization in sparse and compressible vector recovery. We prove its convergence and we estimate its local rate. We show how the algorithm can be…

Numerical Analysis · Mathematics 2008-07-04 Ingrid Daubechies , Ronald DeVore , Massimo Fornasier , C. Sinan Gunturk

The tuning parameter selection strategy for penalized estimation is crucial to identify a model that is both interpretable and predictive. However, popular strategies (e.g., minimizing average squared prediction error via cross-validation)…

Methodology · Statistics 2022-11-10 Julia Holter , Jonathan Stallrich

The l1/l2 ratio regularization function has shown good performance for retrieving sparse signals in a number of recent works, in the context of blind deconvolution. Indeed, it benefits from a scale invariance property much desirable in the…

Optimization and Control · Mathematics 2014-11-11 Audrey Repetti , Mai Quyen Pham , Laurent Duval , Emilie Chouzenoux , Jean-Christophe Pesquet

In this work, we consider a class of differentiable criteria for sparse image computing problems, where a nonconvex regularization is applied to an arbitrary linear transform of the target image. As special cases, it includes…

Optimization and Control · Mathematics 2013-08-27 Emilie Chouzenoux , Anna Jezierska , Jean-Christophe Pesquet , Hugues Talbot

We propose a linear algorithm for determining two function parameters by their linear combination. These functions must satisfy the first order differential equations with polynomial coefficients and our parameters are the coefficients of…

Numerical Analysis · Mathematics 2009-01-09 Oleg I. Berngardt , Alexander L. Voronov

We study the L1 minimization problem with additional box constraints. We motivate the problem with two different views of optimality considerations. We look into imposing such constraints in projected gradient techniques and propose a worst…

Data Structures and Algorithms · Computer Science 2010-10-04 Mithun Das Gupta , Sanjeev Kumar , Jing Xiao

We present Elvet, a Python package for solving differential equations and variational problems using machine learning methods. Elvet can deal with any system of coupled ordinary or partial differential equations with arbitrary initial and…

Machine Learning · Computer Science 2021-03-31 Jack Y. Araz , Juan Carlos Criado , Michael Spannowsky

Weighted $\ell_1$-minimization has been studied as a technique for the reconstruction of a sparse signal from compressively sampled measurements when prior information about the signal, in the form of a support estimate, is available. In…

Information Theory · Computer Science 2016-12-09 Deanna Needell , Rayan Saab , Tina Woolf

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

A new package for nonlinear least squares fitting is introduced in this paper. This package implements a recently developed algorithm that, for certain types of nonlinear curve fitting, reduces the number of nonlinear parameters to be…

Statistics Theory · Mathematics 2024-02-07 J. A. F. Torvisco , R. Benítez , M. R. Arias , J. Cabello Sánchez

We study the properties of sparse reconstruction of transformed $\ell_1$ (TL1) minimization and present improved theoretical results about the recoverability and the accuracy of this reconstruction from undersampled measurements. We then…

Numerical Analysis · Mathematics 2018-05-31 Ling Guo , Jing Li , Yongle Liu

We present a package to perform partial fraction decompositions of multivariate rational functions. The algorithm allows to systematically avoid spurious denominator factors and is capable of producing unique results also when being applied…

Symbolic Computation · Computer Science 2022-01-05 Matthias Heller , Andreas von Manteuffel

We consider nonlinear mixed effects models including high-dimensional covariates to model individual parameters variability. The objective is to identify relevant covariates among a large set under sparsity assumption and to estimate model…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

We study high-dimensional estimators with the trimmed $\ell_1$ penalty, which leaves the $h$ largest parameter entries penalty-free. While optimization techniques for this nonconvex penalty have been studied, the statistical properties have…

Statistics Theory · Mathematics 2019-05-14 Jihun Yun , Peng Zheng , Eunho Yang , Aurelie Lozano , Aleksandr Aravkin

Weighted least squares polynomial approximation uses random samples to determine projections of functions onto spaces of polynomials. It has been shown that, using an optimal distribution of sample locations, the number of samples required…

Numerical Analysis · Mathematics 2017-10-10 Abdul-Lateef Haji-Ali , Fabio Nobile , Raúl Tempone , Sören Wolfers

We consider the unconstrained $L_2$-$L_p$ minimization: find a minimizer of $\|Ax-b\|^2_2+\lambda \|x\|^p_p$ for given $A \in R^{m\times n}$, $b\in R^m$ and parameters $\lambda>0$, $p\in [0,1)$. This problem has been studied extensively in…

Computational Complexity · Computer Science 2011-05-04 Xiaojun Chen , Dongdong Ge , Zizhuo Wang , Yinyu Ye

The Levenberg-Marquardt algorithm is a flexible iterative procedure used to solve non-linear least squares problems. In this work we study how a class of possible adaptations of this procedure can be used to solve maximum likelihood…

Computation · Statistics 2014-10-06 Marco Giordan , Federico Vaggi , Ron Wehrens

The goal of the linear law-based feature space transformation (LLT) algorithm is to assist with the classification of univariate and multivariate time series. The presented R package, called LLT, implements this algorithm in a flexible yet…

Machine Learning · Computer Science 2026-02-06 Marcell T. Kurbucz , Péter Pósfay , Antal Jakovác

We present the first general purpose framework for marginal maximum a posteriori estimation of probabilistic program variables. By using a series of code transformations, the evidence of any probabilistic program, and therefore of any…

Machine Learning · Statistics 2017-07-17 Tom Rainforth , Tuan Anh Le , Jan-Willem van de Meent , Michael A. Osborne , Frank Wood