English
Related papers

Related papers: On implicit variables in optimization theory

200 papers

We revisit a formulation technique for inequality constrained optimization problems that has been known for decades: the substitution of squared variables for nonnegative variables. Using this technique, inequality constraints are converted…

Optimization and Control · Mathematics 2024-11-07 Lijun Ding , Stephen J. Wright

The aim of this survey is to present the main important techniques and tools from variational analysis used for first and second order dynamical systems of implicit type for solving monotone inclusions and non-smooth optimization problems.…

Optimization and Control · Mathematics 2020-07-02 Ernö Robert Csetnek

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw

This paper describes valuation-based systems for representing and solving discrete optimization problems. In valuation-based systems, we represent information in an optimization problem using variables, sample spaces of variables, a set of…

Artificial Intelligence · Computer Science 2013-04-05 Prakash P. Shenoy , Glenn Shafer

A multi-convex optimization problem is one in which the variables can be partitioned into sets over which the problem is convex when the other variables are fixed. Multi-convex problems are generally solved approximately using variations on…

Optimization and Control · Mathematics 2016-10-11 Xinyue Shen , Steven Diamond , Madeleine Udell , Yuantao Gu , Stephen Boyd

For a given statistical model, it often happens that it is necessary to intervene the model to reduce the variances of the output variables. In structural equation models, this can be done by changing the values of the path coefficients by…

Methodology · Statistics 2011-08-16 Kentaro Tanaka , Atsushi Yagishita , Masami Miyakawa

Data-driven optimization uses contextual information and machine learning algorithms to find solutions to decision problems with uncertain parameters. While a vast body of work is dedicated to interpreting machine learning models in the…

Machine Learning · Computer Science 2023-07-21 Alexandre Forel , Axel Parmentier , Thibaut Vidal

Deriving system-level specifications from component specifications usually involves the elimination of variables that are not part of the interface of the top-level system. This paper presents algorithms for eliminating variables from…

Logic in Computer Science · Computer Science 2024-11-22 Inigo Incer , Albert Benveniste , Richard M. Murray , Alberto Sangiovanni-Vincentelli , Sanjit A. Seshia

Our aim is to explain mathematical programs with equilibrium constraints (MPECs), motivate them through applications, present the main equivalent formulations of equilibrium constraints, and summarize the basic existence theory for optimal…

Optimization and Control · Mathematics 2026-05-04 Louis Shuo Wang

For optimization models to be used in practice, it is crucial that users trust the results. A key factor in this aspect is the interpretability of the solution process. A previous framework for inherently interpretable optimization models…

Optimization and Control · Mathematics 2026-02-13 Marc Goerigk , Michael Hartisch , Sebastian Merten , Kartikey Sharma

Many statistical estimation procedures lead to nonconvex optimization problems. Algorithms to solve these are often guaranteed to output a stationary point of the optimization problem. Oracle inequalities are an important theoretical…

Statistics Theory · Mathematics 2018-02-28 Andreas Elsener , Sara van de Geer

We consider a popular family of constrained optimization problems arising in machine learning that involve optimizing a non-decomposable evaluation metric with a certain thresholded form, while constraining another metric of interest.…

Machine Learning · Computer Science 2021-07-30 Abhishek Kumar , Harikrishna Narasimhan , Andrew Cotter

An important factor in the practical implementation of optimization models is the acceptance by the intended users. This is influenced among other factors by the interpretability of the solution process. Decision rules that meet this…

Machine Learning · Computer Science 2024-12-03 Marc Goerigk , Michael Hartisch , Sebastian Merten

We consider a non-stationary variant of a sequential stochastic optimization problem, in which the underlying cost functions may change along the horizon. We propose a measure, termed variation budget, that controls the extent of said…

Probability · Mathematics 2019-06-07 O. Besbes , Y. Gur , A. Zeevi

To model combinatorial decision problems involving uncertainty and probability, we introduce scenario based stochastic constraint programming. Stochastic constraint programs contain both decision variables, which we can set, and stochastic…

Artificial Intelligence · Computer Science 2009-03-09 S. Armagan Tarim , Suresh Manandhar , Toby Walsh

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

Mathematical programming formulations of influence diagrams can bridge the gap between representing and solving decision problems. However, they suffer from both modeling and computational limitations. Aiming to address modeling…

Optimization and Control · Mathematics 2025-06-19 Olli Herrala , Tommi Ekholm , Fabricio Oliveira

Real-world experiments involve batched & delayed feedback, non-stationarity, multiple objectives & constraints, and (often some) personalization. Tailoring adaptive methods to address these challenges on a per-problem basis is infeasible,…

Machine Learning · Computer Science 2024-11-11 Ethan Che , Daniel R. Jiang , Hongseok Namkoong , Jimmy Wang

Mathematical models are used extensively for diverse tasks including analysis, optimization, and decision making. Frequently, those models are principled but imperfect representations of reality. This is either due to incomplete physical…

Machine Learning · Statistics 2017-11-15 Remi R. Lam , Lior Horesh , Haim Avron , Karen E. Willcox