English
Related papers

Related papers: A Penalty Function Promoting Sparsity Within and A…

200 papers

This article combines various methods of analysis to draw a comprehensive picture of penalty approximations to the value, hedge ratio, and optimal exercise strategy of American options. While convergence of the penalised solution for…

Computational Finance · Quantitative Finance 2013-05-21 Sam Howison , Christoph Reisinger , Jan Hendrik Witte

Punishment is an effective way to sustain cooperation among selfish individuals. In most of previous studies, objects of punishment are set to be defectors. In this paper, we propose a mechanism of punishment, in which individuals with the…

Physics and Society · Physics 2018-02-06 Han-Xin Yang , Xiaojie Chen

In a plethora of applications dealing with inverse problems, e.g. in image processing, social networks, compressive sensing, biological data processing etc., the signal of interest is known to be structured in several ways at the same time.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Paris Giampouras , Konstantinos Themelis , Athanasios Rontogiannis , Konstantinos Koutroumbas

This work studies the problem of sparse signal recovery with automatic grouping of variables. To this end, we investigate sorted nonsmooth penalties as a regularization approach for generalized linear models. We focus on a family of sorted…

Optimization and Control · Mathematics 2025-06-19 Anne Gagneux , Mathurin Massias , Emmanuel Soubies

We discuss the fundamental issue of identification in linear instrumental variable (IV) models with unknown IV validity. With the assumption of the "sparsest rule", which is equivalent to the plurality rule but becomes operational in…

Methodology · Statistics 2023-12-06 Yiqi Lin , Frank Windmeijer , Xinyuan Song , Qingliang Fan

Safety constraints and optimality are important, but sometimes conflicting criteria for controllers. Although these criteria are often solved separately with different tools to maintain formal guarantees, it is also common practice in…

Systems and Control · Electrical Eng. & Systems 2024-06-10 Pierre-François Massiani , Steve Heim , Friedrich Solowjow , Sebastian Trimpe

A new class of smooth exact penalty functions was recently introduced by Huyer and Neumaier. In this paper, we prove that the new smooth penalty function for a constrained optimization problem is exact if and only if the standard nonsmooth…

Optimization and Control · Mathematics 2018-01-30 M. V. Dolgopolik

In sparse Bayesian learning (SBL), Gaussian scale mixtures (GSMs) have been used to model sparsity-inducing priors that realize a class of concave penalty functions for the regression task in real-valued signal models. Motivated by the…

In many scientific and engineering applications, covariates are naturally grouped. When the group structures are available among covariates, people are usually interested in identifying both important groups and important variables within…

Methodology · Statistics 2013-06-20 Zhigeng Geng , Sijian Wang , Menggang Yu , Patrick O. Monahan , Victoria Champion , Grace Wahba

We revisit the classical dual ascent algorithm for minimization of convex functionals in the presence of linear constraints, and give convergence results which apply even for non-convex functionals. We describe limit points in terms of the…

Optimization and Control · Mathematics 2016-09-22 Fredrik Andersson , Marcus Carlsson , Carl Olsson

Recent medical imaging studies have given rise to distinct but inter-related datasets corresponding to multiple experimental tasks or longitudinal visits. Standard scalar-on-image regression models that fit each dataset separately are not…

Methodology · Statistics 2022-01-21 Xin Ma , Suprateek Kundu

A variety of fairness constraints have been proposed in the literature to mitigate group-level statistical bias. Their impacts have been largely evaluated for different groups of populations corresponding to a set of sensitive attributes,…

Machine Learning · Computer Science 2022-07-01 Jialu Wang , Xin Eric Wang , Yang Liu

Compared with digital methods, sparse recovery based on spiking neural networks has great advantages like high computational efficiency and low power-consumption. However, current spiking algorithms cannot guarantee more accurate estimates…

Signal Processing · Electrical Eng. & Systems 2020-09-22 Xiang Zhang , Lei Yu , Gang Zheng

In compressed sensing, the l0-norm minimization of sparse signal reconstruction is NP-hard. Recent work shows that compared with the best convex relaxation (l1-norm), nonconvex penalties can better approximate the l0-norm and can…

Signal Processing · Electrical Eng. & Systems 2018-05-03 Hao Wang , Zhanglei Shi , Chi-Sing Leung , Hing Cheung So

Joint sparsity has attracted considerable attention in recent years in many fields including sparse signal recovery in compressed sensing (CS), statistics, and machine learning. Traditional convex models suffer from the suboptimal…

Numerical Analysis · Computer Science 2017-06-27 Yaru Fan , Yilun Wang , Tingzhu Huang

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

Machine Learning · Computer Science 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

This work proposes a new loss function targeting classification problems, utilizing a source of information overlooked by cross entropy loss. First, we derive a series of the tightest upper and lower bounds for the probability of a random…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ali Ghobadzadeh , Amir Lashkari

A new family of penalty functions, adaptive to likelihood, is introduced for model selection in general regression models. It arises naturally through assuming certain types of prior distribution on the regression parameters. To study…

Methodology · Statistics 2013-08-26 Yang Feng , Tengfei Li , Zhiliang Ying

We propose an image deconvolution algorithm when the data is contaminated by Poisson noise. The image to restore is assumed to be sparsely represented in a dictionary of waveforms such as the wavelet or curvelet transform. Our key…

Optimization and Control · Mathematics 2008-03-25 François-Xavier Dupé , Jalal Fadili , Jean Luc Starck

This article investigates the problem of noisy low-rank matrix completion with a shared factor structure, leveraging the auxiliary information from the missing indicator matrix to enhance prediction accuracy. Despite decades of development…

Methodology · Statistics 2025-04-08 Yuanhong A , Xinyan Fan , Bingyi Jing , Bo Zhang