English
Related papers

Related papers: Mesh Independence of a Majorized ABCD Method for S…

200 papers

Sparsity constrained minimization captures a wide spectrum of applications in both machine learning and signal processing. This class of problems is difficult to solve since it is NP-hard and existing solutions are primarily based on…

Optimization and Control · Mathematics 2018-12-31 Ganzhao Yuan , Bernard Ghanem

Direct discretization of continuum kinetic equations, like the Vlasov equation, are under-utilized because the distribution function generally exists in a high-dimensional (>3D) space and computational cost increases geometrically with…

Mathematical Software · Computer Science 2015-06-04 J. A. F. Hittinger , J. W. Banks

This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective…

Optimization and Control · Mathematics 2025-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Binary optimization, a representative subclass of discrete optimization, plays an important role in mathematical optimization and has various applications in computer vision and machine learning. Usually, binary optimization problems are…

Optimization and Control · Mathematics 2021-05-18 Huan Xiong , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

The efficient optimization method for locally Lipschitz continuous multiobjective optimization problems from [1] is extended from finite-dimensional problems to general Hilbert spaces. The method iteratively computes Pareto critical points,…

Optimization and Control · Mathematics 2024-02-12 Konstantin Sonntag , Bennet Gebken , Georg Müller , Sebastian Peitz , Stefan Volkwein

In this work, we study advection-robust Hybrid High-Order discretizations of the Oseen equations. For a given integer $k\ge 0$, the discrete velocity unknowns are vector-valued polynomials of total degree $\le k$ on mesh elements and faces,…

Numerical Analysis · Mathematics 2018-02-20 Joubine Aghili , Daniele A. Di Pietro

In this work, we develop a discretisation method for the mixed formulation of the magnetostatic problem supporting arbitrary orders and polyhedral meshes. The method is based on a global discrete de Rham (DDR) sequence, obtained by patching…

Numerical Analysis · Mathematics 2020-11-12 Daniele A. Di Pietro , Jérôme Droniou

Stochastic optimal principle leads to the resolution of a partial differential equation (PDE), namely the Hamilton-Jacobi-Bellman (HJB) equation. In general, this equation cannot be solved analytically, thus numerical algorithms are the…

Numerical Analysis · Mathematics 2021-09-14 Christelle Dleuna Nyoumbi , Antoine Tambue

In this paper, we propose a low-rank coordinate descent approach to structured semidefinite programming with diagonal constraints. The approach, which we call the Mixing method, is extremely simple to implement, has no free parameters, and…

Optimization and Control · Mathematics 2026-05-12 Po-Wei Wang , Wei-Cheng Chang , J. Zico Kolter

We develop a new optimisation technique that combines multiresolution subdivision surfaces for boundary description with immersed finite elements for the discretisation of the primal and adjoint problems of optimisation. Similar to wavelets…

Numerical Analysis · Mathematics 2016-01-20 Kosala Bandara , Thomas Rüberg , Fehmi Cirak

We present and analyze a novel sparse polynomial technique for approximating high-dimensional Hilbert-valued functions, with application to parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our…

Numerical Analysis · Mathematics 2020-01-22 Nick Dexter , Hoang Tran , Clayton Webster

We propose an efficient ADMM method with guarantees for high-dimensional problems. We provide explicit bounds for the sparse optimization problem and the noisy matrix decomposition problem. For sparse optimization, we establish that the…

Machine Learning · Computer Science 2015-07-08 Hanie Sedghi , Anima Anandkumar , Edmond Jonckheere

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

We propose, analyze, and test new robust iterative solvers for systems of linear algebraic equations arising from the space-time finite element discretization of reduced optimality systems defining the approximate solution of hyperbolic…

Numerical Analysis · Mathematics 2024-04-08 Ulrich Langer , Richard Löscher , Olaf Steinbach , Huidong Yang

We present the Multilevel Bregman Proximal Gradient Descent (ML BPGD) method, a novel multilevel optimization framework tailored to constrained convex problems with relative Lipschitz smoothness. Our approach extends the classical…

Optimization and Control · Mathematics 2026-05-06 Yara Elshiaty , Stefania Petra

Memetic computation (MC) has emerged recently as a new paradigm of efficient algorithms for solving the hardest optimization problems. On the other hand, artificial bees colony (ABC) algorithms demonstrate good performances when solving…

Neural and Evolutionary Computing · Computer Science 2016-11-17 Iztok Fister , Iztok Fister , Janez Brest , Viljem Žumer

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

In this work, we consider unfitted finite element methods for the numerical approximation of the Stokes problem. It is well-known that this kind of methods lead to arbitrarily ill-conditioned systems. In order to solve this issue, we…

Numerical Analysis · Mathematics 2021-09-30 Santiago Badia , Alberto F. Martín , Francesc Verdugo

We study and develop (stochastic) primal--dual block-coordinate descent methods for convex problems based on the method due to Chambolle and Pock. Our methods have known convergence rates for the iterates and the ergodic gap: $O(1/N^2)$ if…

Optimization and Control · Mathematics 2020-02-13 Tuomo Valkonen

In the present work, we investigate the computational efficiency afforded by higher-order finite-element discretization of the saddle-point formulation of orbital-free density functional theory. We first investigate the robustness of viable…

Computational Physics · Physics 2015-05-30 Phani Motamarri , Mrinal Iyer , Jaroslaw Knap , Vikram Gavini