English
Related papers

Related papers: Global Minima by Penalized Full-dimensional Scalin…

200 papers

We study the problem of finding the one-dimensional structure in a given data set. In other words we consider ways to approximate a given measure (data) by curves. We consider an objective functional whose minimizers are a regularization of…

Analysis of PDEs · Mathematics 2016-08-31 Slav Kirov , Dejan Slepčev

We propose two classes of mixed finite elements for linear elasticity of any order, with interior penalty for nonconforming symmetric stress approximation. One key point of our method is to introduce some appropriate nonconforming…

Numerical Analysis · Mathematics 2017-05-22 Shuonan Wu , Shihua Gong , Jinchao Xu

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

Global minimization is a fundamental challenge in optimization, especially in machine learning, where finding the global minimum of a function directly impacts model performance and convergence. This article introduces a novel optimization…

Machine Learning · Computer Science 2024-10-31 Seifeddine Achour

A 3D-2D dimension reduction for a nonlinear optimal design problem with a perimeter penalization is performed in the realm of $\Gamma$-convergence, providing an integral representation for the limit functional.

Analysis of PDEs · Mathematics 2012-11-13 Graça Carita , Elvira Zappale

We construct an objective function that consists of a quadratic approximation term and a penalty term. Thanks to the quadratic approximation, we can deal with various kinds of loss functions into a unified way, and by taking advantage of…

Statistics Theory · Mathematics 2018-11-26 Takumi Suzuki , Nakahiro Yoshida

In this paper, we study a class of problems where the sum of truncated convex functions is minimized. In statistical applications, they are commonly encountered when $\ell_0$-penalized models are fitted and usually lead to NP-Hard…

Computation · Statistics 2017-06-28 Tzu-Ying Liu , Hui Jiang

A procedure for asymptotic bias reduction of maximum likelihood estimates of generic estimands is developed. The estimator is realized as a plug-in estimator, where the parameter maximizes the penalized likelihood with a penalty function…

Statistics Theory · Mathematics 2024-03-26 Masayo Y. Hirose , Shuhei Mano

A new algorithm for one-dimensional minimization is described in detail and the results of some tests on practical cases are reported and illustrated. The method requires only punctual computation of the function, and is suitable to be…

Optimization and Control · Mathematics 2017-08-24 Glauco Masotti

We introduce a derivative-free global optimization algorithm that efficiently computes minima for various classes of one-dimensional functions, including non-convex, and non-smooth functions.This algorithm numerically approximates the…

Optimization and Control · Mathematics 2023-08-21 Alexandra A. Gomes , Diogo A. Gomes

The extension of the classical Bayesian penalized spline method to inference on vector-valued functions is considered, with an emphasis on characterizing the suitability of the method for general application.We show that the standard…

Machine Learning · Statistics 2010-03-26 David M. Rogers , Thomas L. Beck

In high-dimensional model selection problems, penalized simple least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a…

Methodology · Statistics 2011-07-06 Jelena Bradic , Jianqing Fan , Weiwei Wang

A new exact projective penalty method is proposed for the equivalent reduction of constrained optimization problems to nonsmooth unconstrained ones. In the method, the original objective function is extended to infeasible points by summing…

Optimization and Control · Mathematics 2023-12-05 Vladimir Norkin

We consider the nonconvex minimization problem, with quartic objective function, that arises in the exact recovery of a configuration matrix $P\in \R^{nd}$ of $n$ points when a Euclidean distance matrix, \EDMp, is given with embedding…

Optimization and Control · Mathematics 2025-07-29 Mengmeng Song , Douglas Goncalves , Woosuk L. Jung , Carlile Lavor , Antonio Mucherino , Henry Wolkowicz

Penalized estimation can conduct variable selection and parameter estimation simultaneously. The general framework is to minimize a loss function subject to a penalty designed to generate sparse variable selection. The…

Computation · Statistics 2024-01-11 Zhu Wang

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

An optimal control problem subject to an elliptic obstacle problem is studied. We obtain a numerical approximation of this problem by discretising the PDE obtained via a Moreau--Yosida type penalisation. For the resulting discrete control…

Optimization and Control · Mathematics 2018-10-22 Ahmad Ahmad Ali , Klaus Deckelnick , Michael Hinze

In this paper, we describe a new method to compute the minimum of a real polynomial function and the ideal defining the points which minimize this polynomial function, assuming that the minimizer ideal is zero-dimensional. Our method is a…

Algebraic Geometry · Mathematics 2013-03-22 Marta Abril Bucero , Bernard Mourrain , Philippe Trebuchet

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

To program a quantum annealer, one must construct objective functions whose minima encode hard constraints imposed by the underlying problem. For such "penalty models," one desires the additional property that the gap in the objective value…

Quantum Physics · Physics 2017-04-25 Brad Lackey