English
Related papers

Related papers: Epigraphical Relaxation for Minimizing Layered Mix…

200 papers

In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point…

Statistics Theory · Mathematics 2019-11-20 Xin Li , Dongya Wu , Chong Li , Jinhua Wang , Jen-Chih Yao

This paper presents a regularization technique incorporating a non-convex and non-smooth term, $\ell_{1}^{2}-\eta\ell_{2}^{2}$, with parameters $0<\eta\leq 1$ designed to address ill-posed linear problems that yield sparse solutions. We…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

Inspired by several recent developments in regularization theory, optimization, and signal processing, we present and analyze a numerical approach to multi-penalty regularization in spaces of sparsely represented functions. The sparsity…

Numerical Analysis · Mathematics 2014-11-25 Valeriya Naumova , Steffen Peter

We study convex relaxations of the image labeling problem on a continuous domain with regularizers based on metric interaction potentials. The generic framework ensures existence of minimizers and covers a wide range of relaxations of the…

Computer Vision and Pattern Recognition · Computer Science 2011-03-02 Jan Lellmann , Christoph Schnörr

In this paper, we study multi-dimensional image recovery. Recently, transform-based tensor nuclear norm minimization methods are considered to capture low-rank tensor structures to recover third-order tensors in multi-dimensional image…

Image and Video Processing · Electrical Eng. & Systems 2022-06-15 Yi-Si Luo , Xi-Le Zhao , Tai-Xiang Jiang , Yi Chang , Michael K. Ng , Chao Li

Deep image classifiers often perform poorly when training data are heavily class-imbalanced. In this work, we propose a new regularization technique, Remix, that relaxes Mixup's formulation and enables the mixing factors of features and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Hsin-Ping Chou , Shih-Chieh Chang , Jia-Yu Pan , Wei Wei , Da-Cheng Juan

Non-regular sampling can reduce aliasing at the expense of noise. Recently, it has been shown that non-regular sampling can be carried out using a conventional regular imaging sensor when the surface of its individual pixels is partially…

Image and Video Processing · Electrical Eng. & Systems 2022-03-02 Simon Grosche , Jürgen Seiler , André Kaup

In image denoising problems, one widely-adopted approach is to minimize a regularized data-fit objective function, where the data-fit term is derived from a physical image acquisition model. Typically the regularizer is selected with two…

Optimization and Control · Mathematics 2015-08-13 Albert Oh , Rebecca Willett

Approximating a function with a finite series, e.g., involving polynomials or trigonometric functions, is a critical tool in computing and data analysis. The construction of such approximations via now-standard approaches like least squares…

Optimization and Control · Mathematics 2021-08-30 Dihan Dai , Yekaterina Epshteyn , Akil Narayan

Deep generative models have enabled the automated synthesis of high-quality data for diverse applications. However, the most effective generative models are specialized to data from a single domain (e.g., images or text). Real-world…

Image and Video Processing · Electrical Eng. & Systems 2021-01-19 Siddharth Biswal , Peiye Zhuang , Ayis Pyrros , Nasir Siddiqui , Sanmi Koyejo , Jimeng Sun

For a regularized least squares estimation of discrete-valued signals, we propose a Linearly involved Generalized Moreau Enhanced (LiGME) regularizer, as a nonconvex regularizer, of designated isolated minimizers. The proposed regularizer…

Signal Processing · Electrical Eng. & Systems 2025-05-29 Satoshi Shoji , Wataru Yata , Keita Kume , Isao Yamada

Recently, minimax optimization received renewed focus due to modern applications in machine learning, robust optimization, and reinforcement learning. The scale of these applications naturally leads to the use of first-order methods.…

Optimization and Control · Mathematics 2023-03-07 Saeed Hajizadeh , Haihao Lu , Benjamin Grimmer

One key ingredient of image restoration is to define a realistic prior on clean images to complete the missing information in the observation. State-of-the-art restoration methods rely on a neural network to encode this prior. Moreover,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Marien Renaud , Arthur Leclaire , Nicolas Papadakis

We investigate geometric regularization strategies for learned latent representations in encoder--decoder reduced-order models. In a fixed experimental setting for the advection--diffusion--reaction (ADR) equation, we model latent dynamics…

Machine Learning · Computer Science 2026-03-04 Mikhail Osipov

In numerous substitution models for the $\l_{0}$-norm minimization problem $(P_{0})$, the $\l_{p}$-norm minimization $(P_{p})$ with $0<p<1$ have been considered as the most natural choice. However, the non-convex optimization problem…

Optimization and Control · Mathematics 2018-04-27 Angang Cui , Jigen Peng , Haiyang Li

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

In this work, we study complex-valued data detection performance in massive multiple-input multiple-output (MIMO) systems. We focus on the problem of recovering an $n$-dimensional signal whose entries are drawn from an arbitrary…

Information Theory · Computer Science 2023-08-11 Ayed M. Alrashdi , Houssem Sifaou

Sparsity inducing regularization is an important part for learning over-complete visual representations. Despite the popularity of $\ell_1$ regularization, in this paper, we investigate the usage of non-convex regularizations in this…

Machine Learning · Computer Science 2017-11-09 Jianqiao Wangni , Dahua Lin

We present an information-theoretic regularization technique for few-shot novel view synthesis based on neural implicit representation. The proposed approach minimizes potential reconstruction inconsistency that happens due to insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Mijeong Kim , Seonguk Seo , Bohyung Han

We address the optimization problem in a data-driven variational reconstruction framework, where the regularizer is parameterized by an input-convex neural network (ICNN). While gradient-based methods are commonly used to solve such…

Optimization and Control · Mathematics 2025-10-24 Matthias J. Ehrhardt , Subhadip Mukherjee , Hok Shing Wong