English
Related papers

Related papers: Linear Reweighted Regularization Algorithms for Gr…

200 papers

Regularized regression problems are ubiquitous in statistical modeling, signal processing, and machine learning. Sparse regression in particular has been instrumental in scientific model discovery, including compressed sensing applications,…

Machine Learning · Statistics 2018-11-09 Peng Zheng , Travis Askham , Steven L. Brunton , J. Nathan Kutz , Aleksandr Y. Aravkin

We propose a fast approximate algorithm for large graph matching. A new projected fixed-point method is defined and a new doubly stochastic projection is adopted to derive the algorithm. Previous graph matching algorithms suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2012-08-13 Yao Lu , Kaizhu Huang , Cheng-Lin Liu

We propose a general formulation of nonconvex and nonsmooth sparse optimization problems with convex set constraint, which can take into account most existing types of nonconvex sparsity-inducing terms, bringing strong applicability to a…

Information Theory · Computer Science 2021-08-23 Hao Wang , Fan Zhang , Yuanming Shi , Yaohua Hu

Normalization methods such as batch [Ioffe and Szegedy, 2015], weight [Salimansand Kingma, 2016], instance [Ulyanov et al., 2016], and layer normalization [Baet al., 2016] have been widely used in modern machine learning. Here, we study the…

Machine Learning · Computer Science 2022-08-31 Xiaoxia Wu , Edgar Dobriban , Tongzheng Ren , Shanshan Wu , Zhiyuan Li , Suriya Gunasekar , Rachel Ward , Qiang Liu

In this paper, we present a practical algorithm based on sparsity regularization to effectively solve nonlinear dynamic inverse problems that are encountered in subsurface model calibration. We use an iteratively reweighted algorithm that…

Numerical Analysis · Computer Science 2009-11-13 Lianlin Li , B. Jafarpour

The network alignment problem asks for the best correspondence between two given graphs, so that the largest possible number of edges are matched. This problem appears in many scientific problems (like the study of protein-protein…

Computation · Statistics 2017-07-18 Efe Onaran , Soledad Villar

A critical task in graph signal processing is to estimate the true signal from noisy observations over a subset of nodes, also known as the reconstruction problem. In this paper, we propose a node-adaptive regularization for graph signal…

Signal Processing · Electrical Eng. & Systems 2021-02-08 Maosheng Yang , Mario Coutino , Geert Leus , Elvin Isufi

In recent years, Graph Neural Networks (GNNs) have been utilized for various applications ranging from drug discovery to network design and social networks. In many applications, it is impossible to observe some properties of the graph…

Machine Learning · Computer Science 2025-03-12 Moshe Eliasof , Md Shahriar Rahim Siddiqui , Carola-Bibiane Schönlieb , Eldad Haber

We propose a new exact approach to the generalized graph layering problem that is based on a particular quadratic assignment formulation. It expresses, in a natural way, the associated layout restrictions and several possible objectives,…

Data Structures and Algorithms · Computer Science 2019-08-13 Sven Mallach

In recent studies on sparse modeling, the nonconvex regularization approaches (particularly, $L_{q}$ regularization with $q\in(0,1)$) have been demonstrated to possess capability of gaining much benefit in sparsity-inducing and efficiency.…

Numerical Analysis · Computer Science 2015-06-17 Jinshan Zeng , Shaobo Lin , Yao Wang , Zongben Xu

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

We consider the densest $k$-subgraph problem, which seeks to identify the $k$-node subgraph of a given input graph with maximum number of edges. This problem is well-known to be NP-hard, by reduction to the maximum clique problem. We…

Optimization and Control · Mathematics 2019-04-09 Polina Bombina , Brendan Ames

This paper is about iteratively reweighted basis-pursuit algorithms for compressed sensing and matrix completion problems. In a first part, we give a theoretical explanation of the fact that reweighted basis pursuit can improve a lot upon…

Information Theory · Computer Science 2011-07-11 Stéphane Gaïffas , Guillaume Lecué

In representation learning (RL), how to make the learned representations easy to interpret and less overfitted to training data are two important but challenging issues. To address these problems, we study a new type of regulariza- tion…

Machine Learning · Computer Science 2017-11-28 Pengtao Xie , Hongbao Zhang , Eric P. Xing

The angular synchronization problem of estimating a set of unknown angles from their known noisy pairwise differences arises in various applications. It can be reformulated as a optimization problem on graphs involving the graph Laplacian…

Optimization and Control · Mathematics 2022-09-12 Frank Filbir , Felix Krahmer , Oleh Melnyk

In this article, we introduce a novel normalization technique for neural network weight matrices, which we term weight conditioning. This approach aims to narrow the gap between the smallest and largest singular values of the weight…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hemanth Saratchandran , Thomas X. Wang , Simon Lucey

Owing to their statistical properties, non-convex sparse regularizers have attracted much interest for estimating a sparse linear model from high dimensional data. Given that the solution is sparse, for accelerating convergence, a working…

Machine Learning · Computer Science 2021-10-22 Alain Rakotomamonjy , Rémi Flamary , Gilles Gasso , Joseph Salmon

This paper presents efficient algorithms for solving the problem of aligning a protein structure template to a query amino-acid sequence, known as protein threading problem. We consider the problem as a special case of graph matching…

Quantitative Methods · Quantitative Biology 2007-05-23 Nicola Yanev , Rumen Andonov , Philippe Veber , Stefan Balev

A fruitful approach for solving signal deconvolution problems consists of resorting to a frame-based convex variational formulation. In this context, parallel proximal algorithms and related alternating direction methods of multipliers have…

Other Computer Science · Computer Science 2015-05-28 Nelly Pustelnik , Jean-Christophe Pesquet , Caroline Chaux

This paper addresses the problem of approximate MAP-MRF inference in general graphical models. Following [36], we consider a family of linear programming relaxations of the problem where each relaxation is specified by a set of nested pairs…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Vladimir Kolmogorov , Thomas Schoenemann