English
Related papers

Related papers: Projections onto the canonical simplex with additi…

200 papers

Recent advances in machine learning have emphasized the integration of structured optimization components into end-to-end differentiable models, enabling richer inductive biases and tighter alignment with task-specific objectives. In this…

Machine Learning · Computer Science 2026-02-27 Camilo Gomez , Pengyang Wang , Liansheng Tang

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

We first describe a general class of optimization problems that describe many natural, economic, and statistical phenomena. After noting the existence of a conserved quantity in a transformed coordinate system, we outline several instances…

Optimization and Control · Mathematics 2018-04-03 David Rushing Dewhurst

This paper proposes a robust approximation method for solving chance constrained optimization (CCO) of polynomials. Assume the CCO is defined with an individual chance constraint that is affine in the decision variables. We construct a…

Optimization and Control · Mathematics 2024-08-27 Bo Rao , Liu Yang , Suhan Zhong , Guangming Zhou

Perspective functions arise explicitly or implicitly in various forms in applied mathematics and in statistical data analysis. To date, no systematic strategy is available to solve the associated, typically nonsmooth, optimization problems.…

Optimization and Control · Mathematics 2016-12-15 Patrick L. Combettes , Christian L. Müller

Approximating a function with a finite series, e.g., involving polynomials or trigonometric functions, is a critical tool in computing and data analysis. The construction of such approximations via now-standard approaches like least squares…

Optimization and Control · Mathematics 2021-08-30 Dihan Dai , Yekaterina Epshteyn , Akil Narayan

In this paper, we propose two algorithms for solving convex optimization problems with linear ascending constraints. When the objective function is separable, we propose a dual method which terminates in a finite number of iterations. In…

Optimization and Control · Mathematics 2014-09-26 Zizhuo Wang

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. A system of sufficient and necessary first-order optimality…

Information Theory · Computer Science 2018-12-05 Michael Fauss , Abdelhak M. Zoubir

The classical problem of optimal transportation can be formulated as a linear optimization problem on a convex domain: among all joint measures with fixed marginals find the optimal one, where optimality is measured against a cost function.…

Optimization and Control · Mathematics 2012-11-29 Jonathan Korman , Robert J. McCann

We consider the problem of approximating the solution of variational problems subject to the constraint that the admissible functions must be convex. This problem is at the interface between convex analysis, convex optimization, variational…

Numerical Analysis · Mathematics 2015-03-19 Adam M. Oberman

In the current work we introduce a novel estimation of distribution algorithm to tackle a hard combinatorial optimization problem, namely the single-machine scheduling problem, with uncertain delivery times. The majority of the existing…

Data Structures and Algorithms · Computer Science 2013-12-05 Boris Mitavskiy , Jun He

This paper addresses constrained smooth saddle-point problems in settings where projection onto the feasible sets is computationally expensive. We bridge the gap between projection-based and projection-free optimization by introducing a…

Optimization and Control · Mathematics 2026-04-02 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

We investigate the calibration of estimations to increase performance with an optimal monotone transform on the estimator outputs. We start by studying the traditional square error setting with its weighted variant and show that the optimal…

Machine Learning · Computer Science 2021-11-02 Kaan Gokcesu , Hakan Gokcesu

We consider the task of decentralized minimization of the sum of smooth strongly convex functions stored across the nodes of a network. For this problem, lower bounds on the number of gradient computations and the number of communication…

Optimization and Control · Mathematics 2020-11-16 Dmitry Kovalev , Adil Salim , Peter Richtárik

This paper is concerned with objective value performance of the scenario approach for robust convex optimization. A novel method is proposed to derive probabilistic bounds for the objective value from scenario programs with a finite number…

Optimization and Control · Mathematics 2022-04-20 Zheming Wang , Raphaël M. Jungers

We study the fundamental limits to communication-efficient distributed methods for convex learning and optimization, under different assumptions on the information available to individual machines, and the types of functions considered. We…

Machine Learning · Computer Science 2015-10-29 Yossi Arjevani , Ohad Shamir

We study multistage distributionally robust linear optimization, where the uncertainty set is defined as a ball of distribution centered at a scenario tree using the nested distance. The resulting minimax problem is notoriously difficult to…

Optimization and Control · Mathematics 2024-07-24 Rui Gao , Rohit Arora , Yizhe Huang

In this paper, we consider convex feasibility problems where the underlying sets are loosely coupled, and we propose several algorithms to solve such problems in a distributed manner. These algorithms are obtained by applying proximal…

Optimization and Control · Mathematics 2013-07-01 Sina Khoshfetrat Pakazad , Martin S. Andersen , Anders Hansson

This work proposes an implementable proximal-type method for a broad class of optimization problems involving nonsmooth and nonconvex objective and constraint functions. In contrast to existing methods that rely on an ad hoc model…

Optimization and Control · Mathematics 2024-09-26 Gregorio M. Sempere , Welington de Oliveira , Johannes O. Royset

Distributed optimization for resource allocation problems is investigated and a sub-optimal continuous-time algorithm is proposed. Our algorithm has lower order dynamics than others to reduce burdens of computation and communication, and is…

Optimization and Control · Mathematics 2020-02-13 Shu Liang , Xianlin Zeng , Guanpu Chen , Yiguang Hong