English
Related papers

Related papers: Regularity and sparse approximation of the recursi…

200 papers

Solving l1 regularized optimization problems is common in the fields of computational biology, signal processing and machine learning. Such l1 regularization is utilized to find sparse minimizers of convex functions. A well-known example is…

Numerical Analysis · Computer Science 2016-07-04 Eran Treister , Javier S. Turek , Irad Yavneh

In this paper, based on a successively accuracy-increasing approximation of the $\ell_0$ norm, we propose a new algorithm for recovery of sparse vectors from underdetermined measurements. The approximations are realized with a certain class…

Information Theory · Computer Science 2016-11-03 Mohammadreza Malek-Mohammadi , Ali Koochakzadeh , Massoud Babaie-Zadeh , Magnus Jansson , Cristian R. Rojas

For the general problem of minimizing a convex function over a compact convex domain, we will investigate a simple iterative approximation algorithm based on the method by Frank & Wolfe 1956, that does not need projection steps in order to…

Optimization and Control · Mathematics 2011-12-30 Martin Jaggi

A lack of regularity in the solution of the porous medium equation poses a serious challenge in its theoretical and numerical studies. A common strategy in theoretical studies is to utilize the pressure formulation of the equation where a…

Numerical Analysis · Mathematics 2020-04-20 Cuong Ngo , Weizhang Huang

We present a novel space-time isogeometric discretization of the acoustic wave equation in second-order formulation that is intrinsically unconditionally stable. The method relies on a variational framework inspired by [Walkington 2014],…

Numerical Analysis · Mathematics 2025-06-19 Matteo Ferrari , Ilaria Perugia

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

Consider the problem of minimizing an expected logarithmic loss over either the probability simplex or the set of quantum density matrices. This problem includes tasks such as solving the Poisson inverse problem, computing the…

Optimization and Control · Mathematics 2024-03-12 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

A method for approximate solution of initial value and spectral problems for one dimensional Dirac equation based on an analytic approximation of the transmutation operator is presented. In fact the problem of numerical approximation of…

Classical Analysis and ODEs · Mathematics 2021-01-29 Nelson Gutiérrez Jiménez , Sergii M. Torba

We consider in this paper a class of single-ratio fractional minimization problems, in which the numerator part of the objective is the sum of a nonsmooth nonconvex function and a smooth nonconvex function while the denominator part is a…

Optimization and Control · Mathematics 2020-12-23 Na Zhang , Qia Li

In this paper, we propose an adaptive finite element method for computing the first eigenpair of the $p$-Laplacian problem. We prove that starting from a fine initial mesh our proposed adaptive algorithm produces a sequence of discrete…

Numerical Analysis · Mathematics 2025-03-10 Guanglian Li , Jing Li , Julie Merten , Yifeng Xu , Shengfeng Zhu

We prove that the weak version of the SPDE problem \begin{align*} dV_{t}(x) & = [-\mu V_{t}'(x) + \frac{1}{2} (\sigma_{M}^{2} + \sigma_{I}^{2})V_{t}"(x)]dt - \sigma_{M} V_{t}'(x)dW^{M}_{t}, \quad x > 0, \\ V_{t}(0) &= 0 \end{align*} with a…

Probability · Mathematics 2015-07-24 Sean Ledger

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration…

Optimization and Control · Mathematics 2024-04-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

Recent theoretical studies proved that deep neural network (DNN) estimators obtained by minimizing empirical risk with a certain sparsity constraint can attain optimal convergence rates for regression and classification problems. However,…

Statistics Theory · Mathematics 2021-08-10 Ilsang Ohn , Yongdai Kim

We propose a deterministic particle method for a one-dimensional nonlocal equation with interactions through the repulsive Morse potential. We show that the particle method converges as the number of particles goes to infinity towards weak…

Analysis of PDEs · Mathematics 2024-01-22 Marco Di Francesco , Valeria Iorio , Markus Schmidtchen

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

We study linear stochastic partial differential equations of parabolic type. We consider a new boundary value problem where a Cauchy condition is replaced by a prescribed average of the solution either over time and probabilistic space for…

Probability · Mathematics 2017-06-22 Nikolai Dokuchaev

The aim of the book is to present some recent results in the theory of stochastic It\^o equations with singular deterministic part (drift) and its applications to second-order elliptic and parabolic equations with singular first-order…

Probability · Mathematics 2026-05-06 N. V. Krylov

This work deals with a regularization method enforcing solution sparsity of linear ill-posed problems by appropriate discretization in the image space. Namely, we formulate the so called least error method in an $\ell^1$ setting and perform…

Numerical Analysis · Mathematics 2016-08-03 Kristian Bredies , Barbara Kaltenbacher , Elena Resmerita

This paper is devoted to order-one explicit approximations of random periodic solutions to multiplicative noise driven stochastic differential equations (SDEs) with non-globally Lipschitz coefficients. The existence of the random periodic…

Probability · Mathematics 2025-01-06 Yujia Guo , Xiaojie Wang , Yue Wu