English
Related papers

Related papers: The Numerically Optimized Regulator and the Functi…

200 papers

We develop R2N, a modified quasi-Newton method for minimizing the sum of a $\mathcal{C}^1$ function $f$ and a lower semi-continuous prox-bounded $h$. Both $f$ and $h$ may be nonconvex. At each iteration, our method computes a step by…

Optimization and Control · Mathematics 2025-12-01 Youssef Diouane , Mohamed Laghdaf Habiboullah , Dominique Orban

Non-smooth optimization is a core ingredient of many imaging or machine learning pipelines. Non-smoothness encodes structural constraints on the solutions, such as sparsity, group sparsity, low-rank and sharp edges. It is also the basis for…

Optimization and Control · Mathematics 2022-05-04 Clarice Poon , Gabriel Peyré

Maximizing submodular objectives under constraints is a fundamental problem in machine learning and optimization. We study the maximization of a nonnegative, non-monotone $\gamma$-weakly DR-submodular function over a down-closed convex…

Machine Learning · Computer Science 2026-01-05 Hareshkumar Jadav , Ranveer Singh , Vaneet Aggarwal

We study the problem of Regularized Unconstrained Submodular Maximization (RegularizedUSM) as defined by Bodek and Feldman [BF22]. In this problem, you are given a non-monotone non-negative submodular function $f:2^{\mathcal N}\to \mathbb…

Data Structures and Algorithms · Computer Science 2022-06-01 Benjamin Qi

We revisit optimization of functional renormalization group flows by analyzing regularized loop integrals. This leads us to a principle, the Principle of Strongest Singularity, and a corresponding order relation which allows to order…

High Energy Physics - Phenomenology · Physics 2024-10-17 Niklas Zorbach , Jonas Stoll , Jens Braun

A self-consistent (SC) renormalization group approach of the effective medium kind has been developed and applied to the solution of the Ising model (IM). A renormalization group equation in the local potential approximation (LPA) derived…

Statistical Mechanics · Physics 2021-03-24 V. I. Tokar

We propose and analyze a perturbative regularization method to approximate quadratic optimization problems with finite-dimensional degeneracy. The original problem is first approximated by a regularized problem depending on a small positive…

Numerical Analysis · Mathematics 2026-03-16 C. G. Gebhardt , I. Romero

We present a certified version of the Natural-Norm Successive Constraint Method (cNNSCM) for fast and accurate Inf-Sup lower bound evaluation of parametric operators. Successive Constraint Methods (SCM) are essential tools for the…

Numerical Analysis · Mathematics 2015-03-17 Yanlai Chen

We study the numerical realisation of optimal consensus control laws for agent-based models. For a nonlinear multi-agent system of Cucker-Smale type, consensus control is cast as a dynamic optimisation problem for which we derive…

Optimization and Control · Mathematics 2018-09-24 Rafael Bailo , Mattia Bongini , José A. Carrillo , Dante Kalise

We investigate the influence of the momentum cutoff function on the field-dependent nonperturbative renormalization group flows for the three-dimensional Ising model, up to the second order of the derivative expansion. We show that, even…

High Energy Physics - Theory · Physics 2009-11-10 Léonie Canet

The non-perturbative functional renormalization group equation depends on the choice of a regulator function, whose main properties are a "coarse-graining scale" $k$ and an overall dimensionless amplitude $a$. In this paper we shall discuss…

High Energy Physics - Theory · Physics 2022-09-09 Alessio Baldazzi , Roberto Percacci , Luca Zambelli

We study regulator and cutoff artifacts in the quark-meson model at finite temperature and quark chemical potential within the functional renormalization-group approach using the local potential approximation. To this end, we discuss the…

High Energy Physics - Phenomenology · Physics 2026-02-02 Jonas Stoll , Niklas Zorbach , Lutz Kiefer , Fabrizio Murgana , Jens Braun , Dirk H. Rischke

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

Compressed sensing of simultaneously sparse and low-rank matrices enables recovery of sparse signals from a few linear measurements of their bilinear form. One important question is how many measurements are needed for a stable…

Information Theory · Computer Science 2016-07-01 Kiryung Lee , Yihong Wu , Yoram Bresler

In this paper, we propose a new regularization technique called "functional SCAD". We then combine this technique with the smoothing spline method to develop a smooth and locally sparse (i.e., zero on some sub-regions) estimator for the…

Statistics Theory · Mathematics 2020-09-21 Zhenhua Lin , Jiguo Cao , Liangliang Wang , Haonan Wang

We analyze and improve low rank representation (LRR), the state-of-the-art algorithm for subspace segmentation of data. We prove that for the noiseless case, the optimization model of LRR has a unique solution, which is the shape…

Computer Vision and Pattern Recognition · Computer Science 2015-03-19 Wei Siming , Lin Zhouchen

Many problems in computer vision and robotics can be phrased as non-linear least squares optimization problems represented by factor graphs, for example, simultaneous localization and mapping (SLAM), structure from motion (SfM), motion…

Robotics · Computer Science 2019-09-04 Jing Dong , Zhaoyang Lv

In this paper, we utilize stochastic optimization to reduce the space complexity of convex composite optimization with a nuclear norm regularizer, where the variable is a matrix of size $m \times n$. By constructing a low-rank estimate of…

Machine Learning · Computer Science 2015-12-08 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

We present a new method for minimizing the sum of a differentiable convex function and an $\ell_1$-norm regularizer. The main features of the new method include: $(i)$ an evolving set of indices corresponding to variables that are predicted…

Optimization and Control · Mathematics 2016-02-24 Tianyi Chen , Frank E. Curtis , Daniel P. Robinson

We investigate the precision of the numerical implementation of the functional renormalization group based on extracting the eigenvalues from the linearized RG transformation. For this purpose, we implement the LPA and $O(\partial^2)$…

Statistical Mechanics · Physics 2024-07-17 Andrzej Chlebicki