English
Related papers

Related papers: Constrained Optimization of Rank-One Functions wit…

200 papers

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

Variable selection is a fundamental task in statistical data analysis. Sparsity-inducing regularization methods are a popular class of methods that simultaneously perform variable selection and model estimation. The central problem is a…

Machine Learning · Computer Science 2016-03-16 Hongbo Dong , Kun Chen , Jeff Linderoth

In an effort to develop an alternative approach to traditional sparse reformulations, we will provide a new type of convex reformulation of a large class of stochastic quadratically constrained quadratic optimization problems that is…

Optimization and Control · Mathematics 2023-01-31 Markus Gabl

In this paper, we focus on the problem of stochastic optimization where the objective function can be written as an expectation function over a closed convex set. We also consider multiple expectation constraints which restrict the domain…

Statistics Theory · Mathematics 2019-06-18 Kinjal Basu , Preetam Nandy

This work proposes a novel convex-non-convex formulation of the image segmentation and the image completion problems. The proposed approach is based on the minimization of a functional involving two distinct regularization terms: one…

Numerical Analysis · Mathematics 2025-09-01 Mohamed El Guide , Anas El Hachimi , Khalide Jbilou , Lothar Reichel

We develop tractable convex relaxations for rank-constrained quadratic optimization problems over $n \times m$ matrices, a setting for which tractable relaxations are typically only available when the objective or constraints admit spectral…

Optimization and Control · Mathematics 2026-05-22 Ryan Cory-Wright , Jean Pauphilet

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

This paper studies distributionally robust optimization for a rich class of risk measures with ambiguity sets defined by $\phi$-divergences. The risk measures are allowed to be non-linear in probabilities, are represented by Choquet…

Optimization and Control · Mathematics 2025-04-15 Guanyu Jin , Roger J. A. Laeven , Dick den Hertog

Separable convex optimization problems with linear ascending inequality and equality constraints are addressed in this paper. Under an ordering condition on the slopes of the functions at the origin, an algorithm that determines the optimum…

Information Theory · Computer Science 2011-07-22 Arun Padakandla , Rajesh Sundaresan

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

We propose conformal predictive programming (CPP), a framework to solve chance constrained optimization problems, i.e., optimization problems with constraints that are functions of random variables. CPP utilizes samples from these random…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Yiqi Zhao , Xinyi Yu , Matteo Sesia , Jyotirmoy V. Deshmukh , Lars Lindemann

We describe and analyze algorithms for shape-constrained symbolic regression, which allows the inclusion of prior knowledge about the shape of the regression function. This is relevant in many areas of engineering -- in particular whenever…

Neural and Evolutionary Computing · Computer Science 2021-07-21 Christian Haider , Fabricio Olivetti de França , Bogdan Burlacu , Gabriel Kronberger

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

Continuous optimization is an important problem in many areas of AI, including vision, robotics, probabilistic inference, and machine learning. Unfortunately, most real-world optimization problems are nonconvex, causing standard convex…

Artificial Intelligence · Computer Science 2016-11-10 Abram L. Friesen , Pedro Domingos

A geometric nonconvex conic optimization problem (COP) was recently proposed by Kim, Kojima and Toh as a unified framework for convex conic reformulation of a class of quadratic optimization problems and polynomial optimization problems.…

Optimization and Control · Mathematics 2024-09-11 Naohiko Arima , Sunyoung Kim , Masakazu Kojima

This study develops a framework for a class of constant modulus (CM) optimization problems, which covers binary constraints, discrete phase constraints, semi-orthogonal matrix constraints, non-negative semi-orthogonal matrix constraints,…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

In this paper, we investigate a constrained formulation of neural networks where the output is a convex function of the input. We show that the convexity constraints can be enforced on both fully connected and convolutional layers, making…

Machine Learning · Computer Science 2021-07-13 Sarath Sivaprasad , Ankur Singh , Naresh Manwani , Vineet Gandhi

Seeking the convex hull of an object is a very fundamental problem arising from various tasks. In this work, we propose two variational convex hull models using level set representation for 2-dimensional data. The first one is an exact…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Lingfeng Li , Shousheng Luo , Xue-Cheng Tai , Jiang Yang

In this paper, we consider convex quadratic optimization problems with indicator variables when the matrix $Q$ defining the quadratic term in the objective is sparse. We use a graphical representation of the support of $Q$, and show that if…

Optimization and Control · Mathematics 2021-10-26 Peijing Liu , Salar Fattahi , Andrés Gómez , Simge Küçükyavuz

Model instability and poor prediction of long-term behavior are common problems when modeling dynamical systems using nonlinear "black-box" techniques. Direct optimization of the long-term predictions, often called simulation error…

Systems and Control · Computer Science 2017-01-25 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski