English
Related papers

Related papers: A Decoupled Approach for Composite Sparse-plus-Smo…

200 papers

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmic design. We…

Optimization and Control · Mathematics 2023-02-17 Jelena Diakonikolas , Cristóbal Guzmán

We develop both first and second order numerical optimization methods to solve non-smooth optimization problems featuring a shared sparsity penalty, constrained by differential equations with uncertainty. To alleviate the curse of…

Optimization and Control · Mathematics 2025-09-18 Harbir Antil , Sergey Dolgov , Akwum Onwunta

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

We consider the problem of multivariate regression in a setting where the relevant predictors could be shared among different responses. We propose an algorithm which decomposes the coefficient matrix into the product of a long matrix and a…

Machine Learning · Statistics 2016-03-02 Milad Kharratzadeh , Mark Coates

Spreading the information over all coefficients of a representation is a desirable property in many applications such as digital communication or machine learning. This so-called antisparse representation can be obtained by solving a convex…

Machine Learning · Computer Science 2020-07-15 Clément Elvira , Cédric Herzet

We consider the unconstrained optimization problem whose objective function is composed of a smooth and a non-smooth conponents where the smooth component is the expectation a random function. This type of problem arises in some interesting…

Optimization and Control · Mathematics 2011-07-01 Qihang Lin , Xi Chen , Javier Pena

This paper considers the problem of recovery of a low-rank matrix in the situation when most of its entries are not observed and a fraction of observed entries are corrupted. The observations are noisy realizations of the sum of a low rank…

Statistics Theory · Mathematics 2016-07-05 Olga Klopp , Karim Lounici , Alexandre B. Tsybakov

Sparse regression models are increasingly prevalent due to their ease of interpretability and superior out-of-sample performance. However, the exact model of sparse regression with an $\ell_0$ constraint restricting the support of the…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez

Information processing techniques based on sparseness have been actively studied in several disciplines. Among them, a mathematical framework to approximately express a given dataset by a combination of a small number of basis vectors of an…

Information Theory · Computer Science 2016-05-04 Tomoyuki Obuchi , Yoshiyuki Kabashima

We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized…

Data Structures and Algorithms · Computer Science 2016-11-24 Kimon Fountoulakis , Abhisek Kundu , Eugenia-Maria Kontopoulou , Petros Drineas

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by Poisson noise. A proper data fidelity term (log-likelihood) is introduced to reflect the Poisson statistics of the noise. On…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

Optimization and Control · Mathematics 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

Machine Learning · Statistics 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

We introduce a new convexified matching method for missing value imputation and individualized inference inspired by computational optimal transport. Our method integrates favorable features from mainstream imputation approaches: optimal…

Econometrics · Economics 2024-07-09 YoonHaeng Hur , Tengyuan Liang

Hypergraph matching is a fundamental problem in computer vision. Mathematically speaking, it maximizes a polynomial objective function, subject to assignment constraints. In this paper, we reformulate the hypergraph matching problem as a…

Optimization and Control · Mathematics 2017-11-15 Chunfeng Cui , Qingna Li , Liqun Qi , Hong Yan

In this paper, we study the problem of fair sparse regression on a biased dataset where bias depends upon a hidden binary attribute. The presence of a hidden attribute adds an extra layer of complexity to the problem by combining sparse…

Machine Learning · Computer Science 2022-09-12 Adarsh Barik , Jean Honorio

We extend the work of Hahn and Carvalho (2015) and develop a doubly-regularized sparse regression estimator by synthesizing Bayesian regularization with penalized least squares within a decision-theoretic framework. In contrast to existing…

Methodology · Statistics 2025-02-04 Aihua Li , Surya T. Tokdar , Jason Xu

Demixing refers to the challenge of identifying two structured signals given only the sum of the two signals and prior information about their structures. Examples include the problem of separating a signal that is sparse with respect to…

Information Theory · Computer Science 2015-03-20 Michael B. McCoy , Joel A. Tropp

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman