English
Related papers

Related papers: Minimizing a Sum of Clipped Convex Functions

200 papers

We consider convex constrained optimization problems that also include a cardinality constraint. In general, optimization problems with cardinality constraints are difficult mathematical programs which are usually solved by global…

Optimization and Control · Mathematics 2022-09-08 Nataša Krejić , Evelin H. M. Krulikovski , Marcos Raydan

Parameterized convex minorant (PCM) method is proposed for the approximation of the objective function in amortized optimization. In the proposed method, the objective function approximator is expressed by the sum of a PCM and a nonnegative…

Machine Learning · Computer Science 2023-11-13 Jinrae Kim , Youdan Kim

This paper presents a convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems that are non-convex in the input norm, which is a…

Optimization and Control · Mathematics 2019-11-20 Danylo Malyuta , Michael Szmuk , Behcet Acikmese

The convex feasibility problem asks to find a point in the intersection of a collection of nonempty closed convex sets. This problem is of basic importance in mathematics and the physical sciences, and projection (or splitting) methods…

Optimization and Control · Mathematics 2013-12-03 Heinz H. Bauschke , Francesco Iorio , Valentin R. Koch

Approximations of functions with finite data often do not respect certain "structural" properties of the functions. For example, if a given function is non-negative, a polynomial approximation of the function is not necessarily also…

Numerical Analysis · Mathematics 2020-08-20 Vidhi Zala , Robert M. Kirby , Akil Narayan

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders

We propose a novel study of the stochastic proximal gradient method for minimizing the sum of two convex functions, one of which is smooth. Under suitable assumptions and without requiring any boundedness or control of the variance of the…

Optimization and Control · Mathematics 2026-04-16 Javier I. Madariaga

The (constrained) minimization of a ratio of set functions is a problem frequently occurring in clustering and community detection. As these optimization problems are typically NP-hard, one uses convex or spectral relaxations in practice.…

Machine Learning · Statistics 2013-06-17 Thomas Bühler , Syama Sundar Rangapuram , Simon Setzer , Matthias Hein

The purpose of the paper is to provide a characterization of the error of the best polynomial approximation of composite functions in weighted spaces. Such a characterization is essential for the convergence analysis of numerical methods…

Numerical Analysis · Mathematics 2023-08-14 Luisa Fermo , Concetta Laurita , Maria Grazia Russo

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

We study minimization of a structured objective function, being the sum of a smooth function and a composition of a weakly convex function with a linear operator. Applications include image reconstruction problems with regularizers that…

Optimization and Control · Mathematics 2021-06-01 Axel Böhm , Stephen J. Wright

A wide array of machine learning problems are formulated as the minimization of the expectation of a convex loss function on some parameter space. Since the probability distribution of the data of interest is usually unknown, it is is often…

Optimization and Control · Mathematics 2019-05-27 Emilie Chouzenoux , Henri Gérard , Jean-Christophe Pesquet

In this paper an iterated function system on the space of distribution functions is built. The inverse problem is introduced and studied by convex optimization problems. Some applications of this method to approximation of distribution…

Statistics Theory · Mathematics 2007-06-13 Stefano M. Iacus , Davide La Torre

In this paper, we consider a finite-dimensional optimization problem minimizing a continuous objective on a compact domain subject to a multi-dimensional constraint function. For the latter, we assume the availability of a global Lipschitz…

Optimization and Control · Mathematics 2026-02-11 Adrian Göß , Alexander Martin , Sebastian Pokutta , Kartikey Sharma

This article is concerned with the numerical solution of convex variational problems. More precisely, we develop an iterative minimisation technique which allows for the successive enrichment of an underlying discrete approximation space in…

Numerical Analysis · Mathematics 2015-07-07 Paul Houston , Thomas P. Wihler

The stochastic composition optimization proposed recently by Wang et al. [2014] minimizes the objective with the compositional expectation form: $\min_x~(\mathbb{E}_iF_i \circ \mathbb{E}_j G_j)(x).$ It summarizes many important applications…

Optimization and Control · Mathematics 2017-05-23 Xiangru Lian , Mengdi Wang , Ji Liu

The problem of finding the minimizer of a sum of convex functions is central to the field of distributed optimization. Thus, it is of interest to understand how that minimizer is related to the properties of the individual functions in the…

Optimization and Control · Mathematics 2018-12-05 Kananart Kuwaranancharoen , Shreyas Sundaram

Piecewise regression is a versatile approach used in various disciplines to approximate complex functions from limited, potentially noisy data points. In control, piecewise regression is, e.g., used to approximate the optimal control law of…

Optimization and Control · Mathematics 2024-07-10 Dieter Teichrib , Moritz Schulze Darup

Energy minimization has been an intensely studied core problem in computer vision. With growing image sizes (2D and 3D), it is now highly desirable to run energy minimization algorithms in parallel. But many existing algorithms, in…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 K. S. Sesh Kumar , Alvaro Barbero , Stefanie Jegelka , Suvrit Sra , Francis Bach

In this paper we first extend the diminishing stepsize method for nonconvex constrained problems presented in [4] to deal with equality constraints and a nonsmooth objective function of composite type. We then consider the particular case…

Optimization and Control · Mathematics 2023-07-07 Francisco Facchinei , Vyacheskav Kungurtsevb , Lorenzo Lampariello , Gesualdo Scutari