English
Related papers

Related papers: Sparsest Piecewise-Linear Regression of One-Dimens…

200 papers

Deep Neural Networks have achieved remarkable success relying on the developing availability of GPUs and large-scale datasets with increasing network depth and width. However, due to the expensive computation and intensive memory,…

Machine Learning · Computer Science 2020-09-07 E Zhenqian , Gao Weiguo

We develop both first and second order numerical optimization methods to solve non-smooth optimization problems featuring a shared sparsity penalty, constrained by differential equations with uncertainty. To alleviate the curse of…

Optimization and Control · Mathematics 2025-09-18 Harbir Antil , Sergey Dolgov , Akwum Onwunta

We study the problem of approximation of 2D set of points. Such type of problems always occur in physical experiments, econometrics, data analysis and other areas. The often problems of outliers or spikes usually make researchers to apply…

Optimization and Control · Mathematics 2025-02-13 Majid E. Abbasov , Anna I. Belenok

Block-sparse signal recovery without knowledge of block sizes and boundaries, such as those encountered in multi-antenna mmWave channel models, is a hard problem for compressed sensing (CS) algorithms. We propose a novel Sparse Bayesian…

Signal Processing · Electrical Eng. & Systems 2021-02-17 Aditya Sant , Markus Leinonen , Bhaskar D. Rao

Channel estimation poses significant challenges in millimeter-wave massive multiple-input multiple-output systems, especially when the base station has fewer radio-frequency chains than antennas. To address this challenge, one promising…

Information Theory · Computer Science 2024-08-07 Pengxia Wu , Julian Cheng , Yonina C. Eldar , John M. Cioffi

Flexible sparsity regularization means stably approximating sparse solutions of operator equations by using coefficient-dependent penalizations. We propose and analyse a general nonconvex approach in this respect, from both theoretical and…

Optimization and Control · Mathematics 2021-11-12 Daria Ghilli , Dirk A. Lorenz , Elena Resmerita

In this paper we introduce a new method for automatically selecting knots in spline regression. The approach consists in setting a large number of initial knots and fitting the spline regression through a penalized likelihood procedure…

Applications · Statistics 2025-05-20 Vivien Goepp , Olivier Bouaziz , Grégory Nuel

Over the last decade or so, reconstruction methods using $\ell_1$ regularization, often categorized as compressed sensing (CS) algorithms, have significantly improved the capabilities of high fidelity imaging in electron tomography. The…

Numerical Analysis · Mathematics 2017-03-07 Toby Sanders , Anne Gelb , Rodrigo Platte , Ilke Arslan , Kai Landskron

In this paper, we consider the sparse least squares regression problem with probabilistic simplex constraint. Due to the probabilistic simplex constraint, one could not apply the L1 regularization to the considered regression model. To find…

Optimization and Control · Mathematics 2021-12-28 Guiyun Xiao , Zheng-Jian Bai

Parameter estimation from multiple measurement vectors (MMVs) is a fundamental problem in many signal processing applications, e.g., spectral analysis and direction-of- arrival estimation. Recently, this problem has been address using prior…

Information Theory · Computer Science 2016-06-24 Christian Steffens , Marius Pesavento , Marc E. Pfetsch

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

In this effort, we propose a convex optimization approach based on weighted $\ell_1$-regularization for reconstructing objects of interest, such as signals or images, that are sparse or compressible in a wavelet basis. We recover the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Joseph Daws , Armenak Petrosyan , Hoang Tran , Clayton G. Webster

The $\ell^1$ and total variation (TV) penalties have been used successfully in many areas, and the combination of the $\ell^1$ and TV penalties can lead to further improved performance. In this work, we investigate the mathematical theory…

Numerical Analysis · Mathematics 2024-12-05 Xinling Liu , Jianjun Wang , Bangti Jin

We study network loss tomography based on observing average loss rates over a set of paths forming a tree -- a severely underdetermined linear problem for the unknown link loss probabilities. We examine in detail the role of sparsity as a…

Networking and Internet Architecture · Computer Science 2015-03-19 Vijay Arya , Darryl Veitch

We present a general variational framework for the training of freeform nonlinearities in layered computational architectures subject to some slope constraints. The regularization that we add to the traditional training loss penalizes the…

Machine Learning · Statistics 2025-03-31 Michael Unser , Alexis Goujon , Stanislas Ducotterd

This paper focuses on the development of a space-variant regularization model for solving an under-determined linear inverse problem. The case study is a medical image reconstruction from few-view tomographic noisy data. The primary…

Image and Video Processing · Electrical Eng. & Systems 2024-04-29 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

Optimization-based problems have become of great interest for signal approximation purposes, as they achieved good accuracy results while being extremely flexible and versatile. In this work, we put our focus on the context of periodic…

Optimization and Control · Mathematics 2021-11-30 Adrian Jarret

We consider the problem of mixed sparse linear regression with two components, where two real $k$-sparse signals $\beta_1, \beta_2$ are to be recovered from $n$ unlabelled noisy linear measurements. The sparsity is allowed to be sublinear…

Machine Learning · Statistics 2023-07-07 Gabriel Arpino , Ramji Venkataramanan

Many regularization schemes for high-dimensional regression have been put forward. Most require the choice of a tuning parameter, using model selection criteria or cross-validation schemes. We show that a simple non-negative or…

Methodology · Statistics 2012-02-07 Nicolai Meinshausen

Analysis sparsity is a common prior in inverse problem or machine learning including special cases such as Total Variation regularization, Edge Lasso and Fused Lasso. We study the geometry of the solution set (a polyhedron) of the analysis…

Optimization and Control · Mathematics 2022-04-14 Xavier Dupuis , Samuel Vaiter